staticlabs / dlm-code0.6b-exp

huggingface.co
Total runs: 97
24-hour runs: -5
7-day runs: -25
30-day runs: -319
Model's Last Updated: September 04 2026
text-generation

Introduction of dlm-code0.6b-exp

Model Details of dlm-code0.6b-exp

dlm-code0.6b-exp

Experimental masked-diffusion language model for code, from the thunder-fast project.

This is a discrete masked-diffusion (MDM) adaptation of a Qwen2-based pretrained code model (~0.5B). It is not an autoregressive next-token model: generation is a progressive un-masking loop under bidirectional attention , so a whole output window is filled in parallel over 24 diffusion steps.

Details
Backbone Qwen2 ( model_type: qwen2 ), 24 layers, hidden 896, 14 attention / 2 KV heads, GQA
Vocabulary 151,936 + <M> mask token (id 151665)
Diffusion discrete [MASK] , 24-step progressive un-masking, entropy-based position confidence ( alg_temp 0.6, top_k 500)
Context window-based (256 tokens) — not left-to-right; supports infilling
Weights bf16 ( model.safetensors )
How to run

This checkpoint is intended to be driven by a diffusion decoder (bidirectional attention + the iterative un-masking loop), e.g. the thunder-fast runtime. Loading it as a plain causal Qwen2ForCausalLM will not reproduce diffusion generation.

# thunder-fast runtime (ggml engine) or the reference DiffusionLM
# e.g. runtime --model dlm-code0.6b-exp.gguf --prompt "..."
Status

Experimental / work-in-progress ( .exp ). It is a diffusion code-generation checkpoint published for the thunder-fast project; see the repo for training, the masking schedule, and evaluation details.

Runs of staticlabs dlm-code0.6b-exp on huggingface.co

97
Total runs
-5
24-hour runs
-7
3-day runs
-25
7-day runs
-319
30-day runs

More Information About dlm-code0.6b-exp huggingface.co Model

dlm-code0.6b-exp huggingface.co

dlm-code0.6b-exp huggingface.co is an AI model on huggingface.co that provides dlm-code0.6b-exp's model effect (), which can be used instantly with this staticlabs dlm-code0.6b-exp model. huggingface.co supports a free trial of the dlm-code0.6b-exp model, and also provides paid use of the dlm-code0.6b-exp. Support call dlm-code0.6b-exp model through api, including Node.js, Python, http.

dlm-code0.6b-exp huggingface.co Url

https://huggingface.co/staticlabs/dlm-code0.6b-exp

staticlabs dlm-code0.6b-exp online free

dlm-code0.6b-exp huggingface.co is an online trial and call api platform, which integrates dlm-code0.6b-exp's modeling effects, including api services, and provides a free online trial of dlm-code0.6b-exp, you can try dlm-code0.6b-exp online for free by clicking the link below.

staticlabs dlm-code0.6b-exp online free url in huggingface.co:

https://huggingface.co/staticlabs/dlm-code0.6b-exp

dlm-code0.6b-exp install

dlm-code0.6b-exp is an open source model from GitHub that offers a free installation service, and any user can find dlm-code0.6b-exp on GitHub to install. At the same time, huggingface.co provides the effect of dlm-code0.6b-exp install, users can directly use dlm-code0.6b-exp installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

dlm-code0.6b-exp install url in huggingface.co:

https://huggingface.co/staticlabs/dlm-code0.6b-exp

Url of dlm-code0.6b-exp

dlm-code0.6b-exp huggingface.co Url

Provider of dlm-code0.6b-exp huggingface.co

staticlabs
ORGANIZATIONS