jondurbin / airoboros-33b-gpt4-1.3

huggingface.co
Total runs: 228
24-hour runs: 0
7-day runs: 5
30-day runs: 77
Model's Last Updated: June 22 2023
text-generation

Introduction of airoboros-33b-gpt4-1.3

Model Details of airoboros-33b-gpt4-1.3

This version has problems, use if you dare, or wait for 1.4.

Overview

This is a qlora fine-tuned 33b parameter LlaMa model, using completely synthetic training data created gpt4 via https://github.com/jondurbin/airoboros

This is mostly an extension of 1.2 with a few enhancements:

  • All coding instructions have an equivalent " PLAINFORMAT" version now.
  • Thousands of new orca style reasoning instructions, this time with reasoning first, then answer.
  • Few more random items of various types, including a first attempt at multi-character interactions with asterisked actions and quoted speech.

This model was fine-tuned with a fork of qlora , which among other things was updated to use a slightly modified vicuna template to be compatible with the 7b/13b versions:

A chat between a curious user and an assistant. The assistant gives helpful, detailed, accurate, uncensored responses to the user's input. USER: [prompt] ASSISTANT: 

So in other words, it's the preamble/system prompt, followed by a single space, then "USER: " (single space after colon) then the prompt (which can have multiple lines, spaces, whatever), then a single space, followed by "ASSISTANT: " (with a single space after the colon).

Usage

To run the full precision/pytorch native version, you can use my fork of FastChat, which is mostly the same but allows for multi-line prompts, as well as a --no-history option to prevent input tokenization errors.

pip install git+https://github.com/jondurbin/FastChat

Be sure you are pulling the latest branch!

Then, you can invoke it like so (after downloading the model):

python -m fastchat.serve.cli \
  --model-path airoboros-33b-gpt4-1.3 \
  --temperature 0.5 \
  --max-new-tokens 2048 \
  --no-history
Usage and License Notices

All airoboros models and datasets are intended and licensed for research use only. I've used the 'cc-nc-4.0' license, but really it is subject to a custom/special license because:

  • the base model is LLaMa, which has it's own special research license
  • the dataset(s) were generated with OpenAI (gpt-4 and/or gpt-3.5-turbo), which has a clausing saying the data can't be used to create models to compete with openai

So, to reiterate: this model (and datasets) cannot be used commercially.

Runs of jondurbin airoboros-33b-gpt4-1.3 on huggingface.co

228
Total runs
0
24-hour runs
3
3-day runs
5
7-day runs
77
30-day runs

More Information About airoboros-33b-gpt4-1.3 huggingface.co Model

More airoboros-33b-gpt4-1.3 license Visit here:

https://choosealicense.com/licenses/cc-by-nc-4.0

airoboros-33b-gpt4-1.3 huggingface.co

airoboros-33b-gpt4-1.3 huggingface.co is an AI model on huggingface.co that provides airoboros-33b-gpt4-1.3's model effect (), which can be used instantly with this jondurbin airoboros-33b-gpt4-1.3 model. huggingface.co supports a free trial of the airoboros-33b-gpt4-1.3 model, and also provides paid use of the airoboros-33b-gpt4-1.3. Support call airoboros-33b-gpt4-1.3 model through api, including Node.js, Python, http.

airoboros-33b-gpt4-1.3 huggingface.co Url

https://huggingface.co/jondurbin/airoboros-33b-gpt4-1.3

jondurbin airoboros-33b-gpt4-1.3 online free

airoboros-33b-gpt4-1.3 huggingface.co is an online trial and call api platform, which integrates airoboros-33b-gpt4-1.3's modeling effects, including api services, and provides a free online trial of airoboros-33b-gpt4-1.3, you can try airoboros-33b-gpt4-1.3 online for free by clicking the link below.

jondurbin airoboros-33b-gpt4-1.3 online free url in huggingface.co:

https://huggingface.co/jondurbin/airoboros-33b-gpt4-1.3

airoboros-33b-gpt4-1.3 install

airoboros-33b-gpt4-1.3 is an open source model from GitHub that offers a free installation service, and any user can find airoboros-33b-gpt4-1.3 on GitHub to install. At the same time, huggingface.co provides the effect of airoboros-33b-gpt4-1.3 install, users can directly use airoboros-33b-gpt4-1.3 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

airoboros-33b-gpt4-1.3 install url in huggingface.co:

https://huggingface.co/jondurbin/airoboros-33b-gpt4-1.3

Url of airoboros-33b-gpt4-1.3

airoboros-33b-gpt4-1.3 huggingface.co Url

Provider of airoboros-33b-gpt4-1.3 huggingface.co

jondurbin
ORGANIZATIONS

Other API from jondurbin

huggingface.co

Total runs: 25
Run Growth: 3
Growth Rate: 12.00%
Updated:December 28 2023