drowzeys / keys-Mac-DeepSeek-V4-Flash-0731-MXFP4-MLX-Abliterated

keys-Mac DeepSeek-V4-Flash-0731 MXFP4-MLX Abliterated

Drop-in uncensored / abliterated MXFP4-MLX weights for official DeepSeek-V4-Flash-0731 , with DSpark MTP heads kept stock , for a single Mac Studio (M3 Ultra) via oMLX .

Recipe + first-prompt Hermes fix + 1M-context knobs:
drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps

Sister DGX/FP8 pack (same direction): drowzeys/keys-DeepSeekV4-Flash-GA-0731-Dspark-Abliterated-32-32 .

⚠️ Responsible Use & gated access (required)

WARNING: This model has had safety refusals removed . That makes it useful for red-teaming, security research, evaluation, and unfiltered assistant tasks — and also removes guardrails you must supply yourself.

Access is gated. By requesting Hugging Face access, downloading, or using these weights, you agree to the terms below (same gate family as the other Keys DSV4F abliterated releases).

See RESPONSIBLE_USE.md for the full agreement text.

Prohibited uses

1. Anything involving the sexual exploitation or endangerment of minors.
2. You must be of age 18 years or older to use and download this model.
3. You agree any information generated that can cause harm in terms of generating recipe, knowledge to make any materials/substances is your own input and responsibility . You will be accountable for any harm/damage caused by your action/input .
4. Content promoting self-harm or suicide.
5. Generation of material that is illegal in your jurisdiction , or that targets real individuals for harassment, doxxing, or fraud.
6. Any use prohibited by the upstream DeepSeek license.

Abliteration

mx.quantize is not used for the edit — it re-derives per-32 scales and adds ~5% Frobenius noise on an untouched tensor.

Download + serve (oMLX)

There is no Docker/GHCR image (Apple Metal). Prebuilts: Homebrew oMLX ≥ 0.5.7 + this weight pack. Full one-shot: AGENTS.md .

# after gated access is approved
brew install [email protected] huggingface-cli
brew tap jundot/omlx https://github.com/jundot/omlx && brew install omlx

git clone https://github.com/drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps
cd keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps
bash scripts/setup-mac.sh
# pulls this HF repo → ~/models/dsv4f-mxfp4-ablit and wires ~/.omlx

omlx serve --model-dir ~/.omlx/models --host 0.0.0.0 --port 11500

Requests: chat_template_kwargs.enable_thinking = false .

Hermes first-prompt stall (20k system prefix looks “stuck”): disable auxiliary.title_generation , set streaming.enabled: true , enable the 32 GB hot cache, then /new . Details in the GitHub recipe.

Credits

• DeepSeek-AI — DeepSeek-V4-Flash-0731
• Vontra — bit-exact MXFP4-MLX conversion that keeps MTP
• oMLX / jundot — runtime, DSpark MTP, DSA Metal kernels
• Keys (drowzeys) — Mida wo_b abliteration, Mac packing, recipe

License

Inherited from the upstream DeepSeek base model. Review and comply before use or redistribution.