ContextualAI / archangel_ppo_llama13b

huggingface.co
Total runs: 27
24-hour runs: 1
7-day runs: -2
30-day runs: 0
Model's Last Updated: January 12 2024
text-generation

Introduction of archangel_ppo_llama13b

Model Details of archangel_ppo_llama13b

halos

This repo contains the model checkpoints for:

  • model family llama13b
  • optimized with the loss PPO
  • aligned using the SHP, Anthropic HH and Open Assistant datasets.

To prompt Archangel models, ensure that the format is consistent with that of TuluV2. For example, a prompt should be formatted as follows, where <|user|> corresponds to the human's role and <|assistant|> corresponds to the LLM's role. The human should speak first:

<|user|>
Hi! I'm looking for a cake recipe.
<|assistant|>
What kind of cake?
<|user|>
Chocolate cake.
<|assistant|>

Note that a beginning-of-sequence (BOS) token is automatically added by all Archangel models during tokenization and does not have to be added by you. No end-of-sequence (EOS) token is added to the prompt.

For models trained with our conditional SFT model, the tokenizers have additional tokens <|good|> and <|bad|> included in the embeddings. To generate with these control tokens in the context, postpend either to the prompt.

Please refer to our code repository or blog which contains intructions for training your own HALOs and links to our model cards.

If you find this repo or the technical paper useful in your research, please feel free to cite our work :

@techreport{ethayarajh2023halos,
  author = {Ethayarajh, Kawin and Xu, Winnie, and Jurafsky, Dan and Kiela, Douwe},
  title = {Human-Centered Loss Functions (HALOs)},
  institution = {Contextual AI},
  note = {https://github.com/ContextualAI/HALOs/blob/main/assets/report.pdf},
  year = {2023},
}

Runs of ContextualAI archangel_ppo_llama13b on huggingface.co

27
Total runs
1
24-hour runs
1
3-day runs
-2
7-day runs
0
30-day runs

More Information About archangel_ppo_llama13b huggingface.co Model

More archangel_ppo_llama13b license Visit here:

https://choosealicense.com/licenses/apache-2.0

archangel_ppo_llama13b huggingface.co

archangel_ppo_llama13b huggingface.co is an AI model on huggingface.co that provides archangel_ppo_llama13b's model effect (), which can be used instantly with this ContextualAI archangel_ppo_llama13b model. huggingface.co supports a free trial of the archangel_ppo_llama13b model, and also provides paid use of the archangel_ppo_llama13b. Support call archangel_ppo_llama13b model through api, including Node.js, Python, http.

archangel_ppo_llama13b huggingface.co Url

https://huggingface.co/ContextualAI/archangel_ppo_llama13b

ContextualAI archangel_ppo_llama13b online free

archangel_ppo_llama13b huggingface.co is an online trial and call api platform, which integrates archangel_ppo_llama13b's modeling effects, including api services, and provides a free online trial of archangel_ppo_llama13b, you can try archangel_ppo_llama13b online for free by clicking the link below.

ContextualAI archangel_ppo_llama13b online free url in huggingface.co:

https://huggingface.co/ContextualAI/archangel_ppo_llama13b

archangel_ppo_llama13b install

archangel_ppo_llama13b is an open source model from GitHub that offers a free installation service, and any user can find archangel_ppo_llama13b on GitHub to install. At the same time, huggingface.co provides the effect of archangel_ppo_llama13b install, users can directly use archangel_ppo_llama13b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

archangel_ppo_llama13b install url in huggingface.co:

https://huggingface.co/ContextualAI/archangel_ppo_llama13b

Url of archangel_ppo_llama13b

archangel_ppo_llama13b huggingface.co Url

Provider of archangel_ppo_llama13b huggingface.co

ContextualAI
ORGANIZATIONS

Other API from ContextualAI