Total runs:
357.6K
Run Growth:
-69.4K
Growth Rate:
-19.40%
Sponsored by
iMean AI Trip Planner
mlabonne / gemma-3-4b-it-abliterated
Model's Last Updated: March 22 2025
image-text-to-text
Introduction of gemma-3-4b-it-abliterated
Model Details of gemma-3-4b-it-abliterated
💎 Gemma 3 4B IT Abliterated
This is an uncensored version of google/gemma-3-4b-it created with a new abliteration technique. See this article to know more about abliteration.
I was playing with model weights and noticed that Gemma 3 was much more resilient to abliteration than other models like Qwen 2.5. I experimented with a few recipes to remove refusals while preserving most of the model capabilities.
Note that this is fairly experimental, so it might not turn out as well as expected. I saw some garbled text from time to time (e.g., "It' my" instead of "It's my").
I recommend using these generation parameters:
temperature=1.0
,
top_k=64
,
top_p=0.95
.
✂️ Layerwise abliteration
In the original technique, a refusal direction is computed by comparing the residual streams between target (harmful) and baseline (harmless) samples.
Here, the model was abliterated by computing a refusal direction based on hidden states (inspired by Sumandora's repo ) for most layers (layer 7 to 29), independently. This is combined with a refusal weight that follows a symmetric pattern from 0.05 to a peak of 0.55.
This created a very high acceptance rate (>90%) and still produced coherent outputs.
⚡️ Quantization
TBD.
Runs of mlabonne gemma-3-4b-it-abliterated on huggingface.co
379
Total runs
0
24-hour runs
19
3-day runs
-156
7-day runs
-118
30-day runs
More Information About gemma-3-4b-it-abliterated huggingface.co Model
Url of gemma-3-4b-it-abliterated
gemma-3-4b-it-abliterated huggingface.co Url
Provider of gemma-3-4b-it-abliterated huggingface.co
Other API from mlabonne
Updated:May 19 2025
Total runs:
29.9K
Run Growth:
1.3K
Growth Rate:
4.18%
Total runs:
28.2K
Run Growth:
-2.7K
Growth Rate:
-9.44%
Total runs:
15.1K
Run Growth:
455
Growth Rate:
3.01%
Total runs:
9.1K
Run Growth:
225
Growth Rate:
2.46%
Total runs:
8.6K
Run Growth:
20
Growth Rate:
0.23%
Total runs:
8.2K
Run Growth:
552
Growth Rate:
6.74%
Total runs:
8.2K
Run Growth:
429
Growth Rate:
5.26%
Total runs:
7.2K
Run Growth:
4.0K
Growth Rate:
54.91%
Total runs:
7.1K
Run Growth:
-4.2K
Growth Rate:
-58.11%
Total runs:
6.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.1K
Run Growth:
795
Growth Rate:
19.46%
Total runs:
3.0K
Run Growth:
-99
Growth Rate:
-3.35%
Total runs:
2.9K
Run Growth:
232
Growth Rate:
7.88%
Total runs:
2.0K
Run Growth:
435
Growth Rate:
21.59%
Total runs:
1.8K
Run Growth:
631
Growth Rate:
35.91%
Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
89.83%
Total runs:
1.6K
Run Growth:
559
Growth Rate:
35.79%
Total runs:
1.5K
Run Growth:
-97
Growth Rate:
-6.58%
Total runs:
1.5K
Run Growth:
-6
Growth Rate:
-0.41%
Total runs:
1.3K
Run Growth:
1.2K
Growth Rate:
98.26%
Total runs:
1.1K
Run Growth:
-186
Growth Rate:
-17.02%
Total runs:
1.0K
Run Growth:
314
Growth Rate:
29.99%
Total runs:
999
Run Growth:
22
Growth Rate:
2.20%
Total runs:
976
Run Growth:
435
Growth Rate:
44.57%
Total runs:
669
Run Growth:
0
Growth Rate:
0.00%
Total runs:
621
Run Growth:
290
Growth Rate:
46.70%
Total runs:
567
Run Growth:
120
Growth Rate:
21.16%
Total runs:
483
Run Growth:
320
Growth Rate:
66.25%
Total runs:
413
Run Growth:
-27
Growth Rate:
-6.54%
Total runs:
402
Run Growth:
-1.6K
Growth Rate:
-409.45%
Total runs:
372
Run Growth:
-16
Growth Rate:
-4.30%
Total runs:
358
Run Growth:
0
Growth Rate:
0.00%
Total runs:
354
Run Growth:
12
Growth Rate:
3.39%
Total runs:
324
Run Growth:
-7
Growth Rate:
-2.16%
Total runs:
322
Run Growth:
35
Growth Rate:
10.87%
Total runs:
313
Run Growth:
-7
Growth Rate:
-2.24%
Total runs:
311
Run Growth:
-198
Growth Rate:
-63.67%
Total runs:
308
Run Growth:
0
Growth Rate:
0.00%
Total runs:
274
Run Growth:
101
Growth Rate:
36.86%
Total runs:
271
Run Growth:
187
Growth Rate:
69.00%
Total runs:
224
Run Growth:
136
Growth Rate:
60.71%
Total runs:
189
Run Growth:
-10
Growth Rate:
-5.29%
Total runs:
176
Run Growth:
0
Growth Rate:
0.00%
Total runs:
159
Run Growth:
84
Growth Rate:
52.83%
Total runs:
158
Run Growth:
64
Growth Rate:
40.51%
Total runs:
157
Run Growth:
-829
Growth Rate:
-528.03%
Total runs:
157
Run Growth:
17
Growth Rate:
10.83%
Total runs:
131
Run Growth:
-354
Growth Rate:
-270.23%
Total runs:
128
Run Growth:
43
Growth Rate:
33.59%
Total runs:
127
Run Growth:
-5
Growth Rate:
-3.94%
Total runs:
116
Run Growth:
63
Growth Rate:
54.31%
Total runs:
111
Run Growth:
-49
Growth Rate:
-44.14%
Total runs:
108
Run Growth:
-67
Growth Rate:
-62.04%
Total runs:
103
Run Growth:
19
Growth Rate:
18.45%
Total runs:
98
Run Growth:
-316
Growth Rate:
-322.45%
Total runs:
96
Run Growth:
23
Growth Rate:
23.96%
Total runs:
93
Run Growth:
-24
Growth Rate:
-25.81%
Total runs:
89
Run Growth:
-178
Growth Rate:
-200.00%
Total runs:
85
Run Growth:
-444
Growth Rate:
-522.35%
Total runs:
76
Run Growth:
-29
Growth Rate:
-38.16%
Total runs:
72
Run Growth:
51
Growth Rate:
70.83%
Total runs:
69
Run Growth:
-23
Growth Rate:
-33.33%
Total runs:
67
Run Growth:
-52
Growth Rate:
-77.61%
Total runs:
68
Run Growth:
-20
Growth Rate:
-31.25%
Total runs:
58
Run Growth:
-40
Growth Rate:
-68.97%
Total runs:
57
Run Growth:
42
Growth Rate:
76.36%
Total runs:
54
Run Growth:
-11
Growth Rate:
-20.37%
Total runs:
53
Run Growth:
-16
Growth Rate:
-30.19%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%