Sponsored by
Vmake Labs Video Enhancer
-Vmake Labs Video Enhancer uses AI to improve video quality, restore details, reduce blur, and upscale videos to 8K.
How to Run Ling 3.1 flash Without Refusals Locally
inclusionAI's refusal behaviour projected out of the released weights. Baked GGUF builds now; more builds, the LoRA adapter and the full measurements land on this card today.
Refusals on validation prompts: 98.1% → 2.9%, none on harmless prompts; the same edit along a random direction changes nothing (97.1%). No empty or looping replies.
The refusal sits in the attention outputs as much as in the experts: editing only the experts and the shared expert left most English refusals in place, so the edit covers every matrix that writes into the residual stream.
Same layout and importance matrix as our
Ling 3.1 flash quants
; each file is the size of the original build with the same name.
The builds
Build
On disk
Mean KLD
Same top-1
Status
AD-Q4_K_M
354.4 GB
0.0154
96.22%
available
AD-IQ2_M
218.1 GB
measuring
measuring
available
AD-Q5_K_M
400.2 GB
measuring
measuring
available
KLD and top-1 are against the
original, unmodified
BF16 model on our
held-out neutral text (144 chunks of 4096 tokens), so they hold the edit and the
quantization together. For scale, our plain
AD-Q4_K_M
of the original model is
0.0111 and 96.86%: the edit itself adds about 0.004.
The chat template is inside every file. Thinking is on by default; put
detailed thinking off
in the system prompt to turn it off. Memory: the file
plus about 0.5 GB per conversation and 10 KB per token of context.
How it was made
Direction.
Difference of means of the residual stream at the last prompt
token, thinking off, chat template applied: 544 harmful against 544 harmless
prompts, on the released weights. The
component along the harmless mean is removed. One direction, measured at the
input of block 43 of 72.
Edit.
W' = W - 1.25 r rᵀW
on all 213 matrices that write into the
residual stream: the attention output of every block (63 linear, 9 latent),
the down projections of the 4 dense blocks, of the shared expert and of all
512 experts in the 68 MoE blocks, and the token embeddings. The router and
the multi-token-prediction head are untouched.
Choice.
The row, the set of edited matrices and the scale were picked in
a screen of variants on validation prompts (writer sets, rows, scales,
one direction per block, English-only directions), with edits of the same
shape along a random direction as the control.
Bake.
The same edit applied to the BF16 weights in f32 and rounded once,
then quantized with the importance matrix and layout of our
original quants
.
What we measured so far
Validation prompts (104 harmful, 104 harmless),
the edit applied as an adapter on the Q8_0 of the released weights, replies of
up to 64 tokens:
Refused harmful
Refused harmless
Original
98.1%
0.0%
This edit
2.9%
0.0%
Random direction, same size
97.1%
0.0%
Limitations
Day-one release: the held-out test numbers (JailbreakBench,
XSTest), MMLU, thinking, tool calls, long context and the KL divergence of each
file are being measured now and land on this card today.
The refusal count reads the opening of each reply; a soft refusal phrased as
an answer would be missed.
Refusals are measured on English prompts.
Responsible use
This model has its learned refusal behaviour removed, so it will answer
requests the original declines. Nothing about it makes the output safe, correct
or lawful, and any deployment needs its own access controls and policy
enforcement.
License and credits
MIT, as the original. Base model
Ling 3.1 flash
by
inclusionAI
. Direction, edit,
quantization and evaluation by
AtomicChat
. The method follows Arditi et
al.,
Refusal in Language Models Is Mediated by a Single Direction
(2024).
Runs of AtomicChat Ling-3.1-flash-Uncensored-GGUF on huggingface.co
90
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About Ling-3.1-flash-Uncensored-GGUF huggingface.co Model
More Ling-3.1-flash-Uncensored-GGUF license Visit here:
Ling-3.1-flash-Uncensored-GGUF huggingface.co is an AI model on huggingface.co that provides Ling-3.1-flash-Uncensored-GGUF's model effect (), which can be used instantly with this AtomicChat Ling-3.1-flash-Uncensored-GGUF model. huggingface.co supports a free trial of the Ling-3.1-flash-Uncensored-GGUF model, and also provides paid use of the Ling-3.1-flash-Uncensored-GGUF. Support call Ling-3.1-flash-Uncensored-GGUF model through api, including Node.js, Python, http.
Ling-3.1-flash-Uncensored-GGUF huggingface.co is an online trial and call api platform, which integrates Ling-3.1-flash-Uncensored-GGUF's modeling effects, including api services, and provides a free online trial of Ling-3.1-flash-Uncensored-GGUF, you can try Ling-3.1-flash-Uncensored-GGUF online for free by clicking the link below.
AtomicChat Ling-3.1-flash-Uncensored-GGUF online free url in huggingface.co:
Ling-3.1-flash-Uncensored-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Ling-3.1-flash-Uncensored-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Ling-3.1-flash-Uncensored-GGUF install, users can directly use Ling-3.1-flash-Uncensored-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Ling-3.1-flash-Uncensored-GGUF install url in huggingface.co: