ContextualAI / archangel_sft_pythia2-8b

huggingface.co
Total runs: 68
24-hour runs: -6
7-day runs: 8
30-day runs: -16
Model's Last Updated: January 12 2024
text-generation

Introduction of archangel_sft_pythia2-8b

Model Details of archangel_sft_pythia2-8b

halos

This repo contains the model checkpoints for:

  • model family pythia2-8b
  • optimized with the loss SFT
  • aligned using the SHP, Anthropic HH and Open Assistant datasets.

To prompt Archangel models, ensure that the format is consistent with that of TuluV2. For example, a prompt should be formatted as follows, where <|user|> corresponds to the human's role and <|assistant|> corresponds to the LLM's role. The human should speak first:

<|user|>
Hi! I'm looking for a cake recipe.
<|assistant|>
What kind of cake?
<|user|>
Chocolate cake.
<|assistant|>

Note that a beginning-of-sequence (BOS) token is automatically added by all Archangel models during tokenization and does not have to be added by you. No end-of-sequence (EOS) token is added to the prompt.

For models trained with our conditional SFT model, the tokenizers have additional tokens <|good|> and <|bad|> included in the embeddings. To generate with these control tokens in the context, postpend either to the prompt.

Please refer to our code repository or blog which contains intructions for training your own HALOs and links to our model cards.

If you find this repo or the technical paper useful in your research, please feel free to cite our work :

@techreport{ethayarajh2023halos,
  author = {Ethayarajh, Kawin and Xu, Winnie, and Jurafsky, Dan and Kiela, Douwe},
  title = {Human-Centered Loss Functions (HALOs)},
  institution = {Contextual AI},
  note = {https://github.com/ContextualAI/HALOs/blob/main/assets/report.pdf},
  year = {2023},
}

Runs of ContextualAI archangel_sft_pythia2-8b on huggingface.co

68
Total runs
-6
24-hour runs
-4
3-day runs
8
7-day runs
-16
30-day runs

More Information About archangel_sft_pythia2-8b huggingface.co Model

More archangel_sft_pythia2-8b license Visit here:

https://choosealicense.com/licenses/apache-2.0

archangel_sft_pythia2-8b huggingface.co

archangel_sft_pythia2-8b huggingface.co is an AI model on huggingface.co that provides archangel_sft_pythia2-8b's model effect (), which can be used instantly with this ContextualAI archangel_sft_pythia2-8b model. huggingface.co supports a free trial of the archangel_sft_pythia2-8b model, and also provides paid use of the archangel_sft_pythia2-8b. Support call archangel_sft_pythia2-8b model through api, including Node.js, Python, http.

archangel_sft_pythia2-8b huggingface.co Url

https://huggingface.co/ContextualAI/archangel_sft_pythia2-8b

ContextualAI archangel_sft_pythia2-8b online free

archangel_sft_pythia2-8b huggingface.co is an online trial and call api platform, which integrates archangel_sft_pythia2-8b's modeling effects, including api services, and provides a free online trial of archangel_sft_pythia2-8b, you can try archangel_sft_pythia2-8b online for free by clicking the link below.

ContextualAI archangel_sft_pythia2-8b online free url in huggingface.co:

https://huggingface.co/ContextualAI/archangel_sft_pythia2-8b

archangel_sft_pythia2-8b install

archangel_sft_pythia2-8b is an open source model from GitHub that offers a free installation service, and any user can find archangel_sft_pythia2-8b on GitHub to install. At the same time, huggingface.co provides the effect of archangel_sft_pythia2-8b install, users can directly use archangel_sft_pythia2-8b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

archangel_sft_pythia2-8b install url in huggingface.co:

https://huggingface.co/ContextualAI/archangel_sft_pythia2-8b

Url of archangel_sft_pythia2-8b

archangel_sft_pythia2-8b huggingface.co Url

Provider of archangel_sft_pythia2-8b huggingface.co

ContextualAI
ORGANIZATIONS

Other API from ContextualAI