QuantFactory / gemma-2-27b-it-abliterated-GGUF

huggingface.co
Total runs: 1.3K
24-hour runs: -5
7-day runs: 299
30-day runs: -133
Model's Last Updated: November 06 2024
text-generation

Introduction of gemma-2-27b-it-abliterated-GGUF

Model Details of gemma-2-27b-it-abliterated-GGUF

QuantFactory Banner

QuantFactory/gemma-2-27b-it-abliterated-GGUF

This is quantized version of byroneverson/gemma-2-27b-it-abliterated created using llama.cpp

Original Model Card

gemma-2-27b-it-abliterated

Now accepting abliteration requests. If you would like to see a model abliterated, follow me and leave me a message with model link.

This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.

  1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
  2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)

Check out the jupyter notebook for details of how this model was abliterated from gemma-2-27b-it.

Logo

Runs of QuantFactory gemma-2-27b-it-abliterated-GGUF on huggingface.co

1.3K
Total runs
-5
24-hour runs
157
3-day runs
299
7-day runs
-133
30-day runs

More Information About gemma-2-27b-it-abliterated-GGUF huggingface.co Model

More gemma-2-27b-it-abliterated-GGUF license Visit here:

https://choosealicense.com/licenses/gemma

gemma-2-27b-it-abliterated-GGUF huggingface.co

gemma-2-27b-it-abliterated-GGUF huggingface.co is an AI model on huggingface.co that provides gemma-2-27b-it-abliterated-GGUF's model effect (), which can be used instantly with this QuantFactory gemma-2-27b-it-abliterated-GGUF model. huggingface.co supports a free trial of the gemma-2-27b-it-abliterated-GGUF model, and also provides paid use of the gemma-2-27b-it-abliterated-GGUF. Support call gemma-2-27b-it-abliterated-GGUF model through api, including Node.js, Python, http.

gemma-2-27b-it-abliterated-GGUF huggingface.co Url

https://huggingface.co/QuantFactory/gemma-2-27b-it-abliterated-GGUF

QuantFactory gemma-2-27b-it-abliterated-GGUF online free

gemma-2-27b-it-abliterated-GGUF huggingface.co is an online trial and call api platform, which integrates gemma-2-27b-it-abliterated-GGUF's modeling effects, including api services, and provides a free online trial of gemma-2-27b-it-abliterated-GGUF, you can try gemma-2-27b-it-abliterated-GGUF online for free by clicking the link below.

QuantFactory gemma-2-27b-it-abliterated-GGUF online free url in huggingface.co:

https://huggingface.co/QuantFactory/gemma-2-27b-it-abliterated-GGUF

gemma-2-27b-it-abliterated-GGUF install

gemma-2-27b-it-abliterated-GGUF is an open source model from GitHub that offers a free installation service, and any user can find gemma-2-27b-it-abliterated-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of gemma-2-27b-it-abliterated-GGUF install, users can directly use gemma-2-27b-it-abliterated-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-2-27b-it-abliterated-GGUF install url in huggingface.co:

https://huggingface.co/QuantFactory/gemma-2-27b-it-abliterated-GGUF

Url of gemma-2-27b-it-abliterated-GGUF

gemma-2-27b-it-abliterated-GGUF huggingface.co Url

Provider of gemma-2-27b-it-abliterated-GGUF huggingface.co

QuantFactory
ORGANIZATIONS

Other API from QuantFactory