Total runs:
4.8K
Run Growth:
2.1K
Growth Rate:
43.37%
Sponsored by
ThumbnailCreator.com
bofenghuang / doctomodernbert-fr-large-diffusion-v0.1
Model's Last Updated: July 06 2026
text-generation
Introduction of doctomodernbert-fr-large-diffusion-v0.1
Model Details of doctomodernbert-fr-large-diffusion-v0.1
DoctoModernBERT-fr-large-diffusion-v0.1
A text diffusion model based on DoctoModernBERT-fr-large , finetuned on a medical instruction-following dataset.
Unlike an autoregressive LLM, which decodes strictly left to right one token at a time, this model works by iterative denoising. It starts from a fully masked canvas and, at each step, predicts all masked positions at once and keeps only the most confident ones. It still moves through the sequence one block at a time, so generation is parallel inside each block but left to right across blocks.
This is an exploratory checkpoint. It's small and lightly trained, so expect mistakes and weaker answers.
🚀 How to Use
Training and generation are done through the dLLM library.
Setup
git clone https://github.com/ZHZisZZ/dllm
cd dllm
pip install -e .
Sampling
import dllm
model_id = "bofenghuang/doctomodernbert-fr-large-diffusion-v0.1" # or a local path
model = dllm.utils.get_model(model_name_or_path=model_id).eval()
tokenizer = dllm.utils.get_tokenizer(model_name_or_path=model_id)
sampler = dllm.core.samplers.MDLMSampler(model=model, tokenizer=tokenizer)
config = dllm.core.samplers.MDLMSamplerConfig(
steps=128, # total diffusion steps
max_new_tokens=128, # length of the generated answer span
block_size=32, # semi-autoregressive block size
temperature=0.0, # 0.0 = greedy / low-confidence remasking
remasking="low_confidence",
)
messages = [
[{"role": "user", "content": "Quels sont les symptômes typiques d'une infection urinaire ?"}],
]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=True)
outputs = sampler.sample(inputs, config, return_dict=True)
print(dllm.utils.sample_trim(tokenizer, outputs.sequences.tolist(), inputs)[0])
Interactive chat
python -u examples/bert/chat.py --model_name_or_path "bofenghuang/doctomodernbert-fr-large-diffusion-v0.1"
The chat template wraps turns as
[SYS] … [/SYS]
,
[Question] … [/Question]
,
[Answer] … [/Answer]
.
Runs of bofenghuang doctomodernbert-fr-large-diffusion-v0.1 on huggingface.co
62
Total runs
-3
24-hour runs
-1
3-day runs
-2
7-day runs
23
30-day runs
More Information About doctomodernbert-fr-large-diffusion-v0.1 huggingface.co Model
Url of doctomodernbert-fr-large-diffusion-v0.1
doctomodernbert-fr-large-diffusion-v0.1 huggingface.co Url
Provider of doctomodernbert-fr-large-diffusion-v0.1 huggingface.co
Other API from bofenghuang
Updated:July 06 2023
Total runs:
967
Run Growth:
-277
Growth Rate:
-28.65%
Total runs:
376
Run Growth:
-63
Growth Rate:
-16.76%
Total runs:
291
Run Growth:
134
Growth Rate:
46.05%
Total runs:
217
Run Growth:
213
Growth Rate:
100.00%
Total runs:
216
Run Growth:
55
Growth Rate:
25.46%
Total runs:
197
Run Growth:
136
Growth Rate:
72.34%
Total runs:
193
Run Growth:
159
Growth Rate:
82.38%
Total runs:
173
Run Growth:
170
Growth Rate:
100.00%
Total runs:
157
Run Growth:
97
Growth Rate:
63.82%
Total runs:
150
Run Growth:
-236
Growth Rate:
-157.33%
Total runs:
143
Run Growth:
103
Growth Rate:
72.03%
Total runs:
129
Run Growth:
-56
Growth Rate:
-43.41%
Total runs:
126
Run Growth:
-6
Growth Rate:
-4.76%
Total runs:
124
Run Growth:
33
Growth Rate:
26.61%
Total runs:
120
Run Growth:
98
Growth Rate:
83.05%
Total runs:
115
Run Growth:
87
Growth Rate:
76.99%
Total runs:
90
Run Growth:
3
Growth Rate:
3.33%
Total runs:
89
Run Growth:
-117
Growth Rate:
-131.46%
Total runs:
88
Run Growth:
85
Growth Rate:
100.00%
Total runs:
81
Run Growth:
20
Growth Rate:
24.69%
Total runs:
80
Run Growth:
4
Growth Rate:
5.00%
Total runs:
75
Run Growth:
62
Growth Rate:
87.32%
Total runs:
68
Run Growth:
17
Growth Rate:
25.00%
Total runs:
65
Run Growth:
-40
Growth Rate:
-61.54%
Total runs:
64
Run Growth:
1
Growth Rate:
1.56%
Total runs:
60
Run Growth:
-50
Growth Rate:
-83.33%
Total runs:
58
Run Growth:
-1
Growth Rate:
-1.72%
Total runs:
54
Run Growth:
-18
Growth Rate:
-33.33%
Total runs:
53
Run Growth:
26
Growth Rate:
49.06%
Total runs:
52
Run Growth:
-6
Growth Rate:
-11.54%
Total runs:
52
Run Growth:
25
Growth Rate:
48.08%
Total runs:
47
Run Growth:
27
Growth Rate:
57.45%
Total runs:
45
Run Growth:
45
Growth Rate:
100.00%
Total runs:
41
Run Growth:
41
Growth Rate:
100.00%
Total runs:
40
Run Growth:
15
Growth Rate:
37.50%
Total runs:
38
Run Growth:
13
Growth Rate:
34.21%
Total runs:
37
Run Growth:
5
Growth Rate:
13.51%
Total runs:
36
Run Growth:
-5
Growth Rate:
-13.89%
Total runs:
36
Run Growth:
15
Growth Rate:
41.67%
Total runs:
35
Run Growth:
-2
Growth Rate:
-5.71%
Total runs:
32
Run Growth:
-8
Growth Rate:
-25.00%
Total runs:
29
Run Growth:
6
Growth Rate:
22.22%
Total runs:
28
Run Growth:
1
Growth Rate:
3.57%
Total runs:
27
Run Growth:
1
Growth Rate:
3.70%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
-5
Growth Rate:
-21.74%
Total runs:
22
Run Growth:
-8
Growth Rate:
-36.36%
Total runs:
20
Run Growth:
3
Growth Rate:
15.00%
Total runs:
20
Run Growth:
20
Growth Rate:
100.00%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
2
Growth Rate:
10.53%
Total runs:
15
Run Growth:
-3
Growth Rate:
-20.00%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
15
Growth Rate:
100.00%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
7
Run Growth:
-3
Growth Rate:
-42.86%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
5
Run Growth:
-2
Growth Rate:
-40.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%