Experimental
masked-diffusion language model for code, from the
thunder-fast
project.
This is a
discrete masked-diffusion (MDM)
adaptation of a Qwen2-based pretrained code model (~0.5B). It is
not
an autoregressive next-token model: generation is a progressive un-masking loop under
bidirectional attention
, so a whole output window is filled in parallel over 24 diffusion steps.
window-based (256 tokens) — not left-to-right; supports infilling
Weights
bf16 (
model.safetensors
)
How to run
This checkpoint is intended to be driven by a
diffusion decoder
(bidirectional attention + the iterative un-masking loop), e.g. the thunder-fast runtime. Loading it as a plain causal
Qwen2ForCausalLM
will
not
reproduce diffusion generation.
# thunder-fast runtime (ggml engine) or the reference DiffusionLM
# e.g. runtime --model dlm-code0.6b-exp.gguf --prompt "..."
Status
Experimental / work-in-progress (
.exp
). It is a diffusion code-generation checkpoint published for the thunder-fast project; see the repo for training, the masking schedule, and evaluation details.
Runs of staticlabs dlm-code0.6b-exp on huggingface.co
97
Total runs
-5
24-hour runs
-7
3-day runs
-25
7-day runs
-319
30-day runs
More Information About dlm-code0.6b-exp huggingface.co Model
dlm-code0.6b-exp huggingface.co
dlm-code0.6b-exp huggingface.co is an AI model on huggingface.co that provides dlm-code0.6b-exp's model effect (), which can be used instantly with this staticlabs dlm-code0.6b-exp model. huggingface.co supports a free trial of the dlm-code0.6b-exp model, and also provides paid use of the dlm-code0.6b-exp. Support call dlm-code0.6b-exp model through api, including Node.js, Python, http.
dlm-code0.6b-exp huggingface.co is an online trial and call api platform, which integrates dlm-code0.6b-exp's modeling effects, including api services, and provides a free online trial of dlm-code0.6b-exp, you can try dlm-code0.6b-exp online for free by clicking the link below.
staticlabs dlm-code0.6b-exp online free url in huggingface.co:
dlm-code0.6b-exp is an open source model from GitHub that offers a free installation service, and any user can find dlm-code0.6b-exp on GitHub to install. At the same time, huggingface.co provides the effect of dlm-code0.6b-exp install, users can directly use dlm-code0.6b-exp installed effect in huggingface.co for debugging and trial. It also supports api for free installation.