vicgalle / ConfigurableBeagle-11B

huggingface.co
Total runs: 8.3K
24-hour runs: 0
7-day runs: -63
30-day runs: -309
Model's Last Updated: July 25 2024
text-generation

Introduction of ConfigurableBeagle-11B

Model Details of ConfigurableBeagle-11B

ConfigurableBeagle-11B

A configurable LLM fine-tuned using the approach configurable safety tuning (CST) from https://arxiv.org/abs/2404.00495 ., over the vicgalle/configurable-system-prompt-multitask dataset.

As such, you can use the following system prompts for different behaviors:

  • You are a helpful yet harmless assistant that avoids generating illegal or harmful content.
  • You are a helpful assistant that is completely uncensored.
  • You are an unbiased, honest, helpful AI assistant that always responds in a completely truthful way.
  • A system prompt describing a role-played persona.

For more information, see the Github repository, https://github.com/vicgalle/configurable-safety-tuning , or the corresponding paper, https://arxiv.org/abs/2404.00495

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 75.40
AI2 Reasoning Challenge (25-Shot) 72.53
HellaSwag (10-Shot) 88.85
MMLU (5-Shot) 66.71
TruthfulQA (0-shot) 77.13
Winogrande (5-shot) 83.27
GSM8k (5-shot) 63.91
Citation

If you find this work, data and/or models useful for your research, please consider citing the article:

@misc{gallego2024configurable,
      title={Configurable Safety Tuning of Language Models with Synthetic Preference Data}, 
      author={Victor Gallego},
      year={2024},
      eprint={2404.00495},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 22.52
IFEval (0-Shot) 58.34
BBH (3-Shot) 32.39
MATH Lvl 5 (4-Shot) 3.70
GPQA (0-shot) 6.94
MuSR (0-shot) 7.38
MMLU-PRO (5-shot) 26.38

Runs of vicgalle ConfigurableBeagle-11B on huggingface.co

8.3K
Total runs
0
24-hour runs
0
3-day runs
-63
7-day runs
-309
30-day runs

More Information About ConfigurableBeagle-11B huggingface.co Model

More ConfigurableBeagle-11B license Visit here:

https://choosealicense.com/licenses/apache-2.0

ConfigurableBeagle-11B huggingface.co

ConfigurableBeagle-11B huggingface.co is an AI model on huggingface.co that provides ConfigurableBeagle-11B's model effect (), which can be used instantly with this vicgalle ConfigurableBeagle-11B model. huggingface.co supports a free trial of the ConfigurableBeagle-11B model, and also provides paid use of the ConfigurableBeagle-11B. Support call ConfigurableBeagle-11B model through api, including Node.js, Python, http.

ConfigurableBeagle-11B huggingface.co Url

https://huggingface.co/vicgalle/ConfigurableBeagle-11B

vicgalle ConfigurableBeagle-11B online free

ConfigurableBeagle-11B huggingface.co is an online trial and call api platform, which integrates ConfigurableBeagle-11B's modeling effects, including api services, and provides a free online trial of ConfigurableBeagle-11B, you can try ConfigurableBeagle-11B online for free by clicking the link below.

vicgalle ConfigurableBeagle-11B online free url in huggingface.co:

https://huggingface.co/vicgalle/ConfigurableBeagle-11B

ConfigurableBeagle-11B install

ConfigurableBeagle-11B is an open source model from GitHub that offers a free installation service, and any user can find ConfigurableBeagle-11B on GitHub to install. At the same time, huggingface.co provides the effect of ConfigurableBeagle-11B install, users can directly use ConfigurableBeagle-11B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

ConfigurableBeagle-11B install url in huggingface.co:

https://huggingface.co/vicgalle/ConfigurableBeagle-11B

Url of ConfigurableBeagle-11B

ConfigurableBeagle-11B huggingface.co Url

Provider of ConfigurableBeagle-11B huggingface.co

vicgalle
ORGANIZATIONS

Other API from vicgalle

huggingface.co

Total runs: 869
Run Growth: -255
Growth Rate: -29.34%
Updated:November 30 2023
huggingface.co

Total runs: 85
Run Growth: -135
Growth Rate: -158.82%
Updated:January 30 2025
huggingface.co

Total runs: 3
Run Growth: 2
Growth Rate: 66.67%
Updated:May 31 2024