ContextualAI / Contextual_KTO_Mistral_PairRM

huggingface.co
Total runs: 75
24-hour runs: 0
7-day runs: 2
30-day runs: -64
Model's Last Updated: April 27 2024
text-generation

Introduction of Contextual_KTO_Mistral_PairRM

Model Details of Contextual_KTO_Mistral_PairRM

This repo contains the model and tokenizer checkpoints for:

[03/06/2024] : We are #2 on the (verified) Alpaca Eval 2.0 Leaderboard scoring 33.23 !

To prompt this model, ensure that the format is consistent with that of TuluV2. For example, a prompt should be formatted as follows, where <|user|> corresponds to the human's role and <|assistant|> corresponds to the LLM's role. The human should speak first:


<|user|>
Hi! I'm looking for a cake recipe.
<|assistant|>
What kind of cake?
<|user|>
Chocolate cake.
<|assistant|>

Note that a beginning-of-sequence (BOS) token is automatically added at tokenization time and does not have to be added by you. No end-of-sequence (EOS) token is added to the prompt. You may also use our tokenizer's apply_chat_template if doing inference with chatml set or evaluating generations through non-local clients.

For more info on KTO refer to our code repository or blog for more details on the methodology.

If you found this work useful, feel free to cite our work :

@techreport{ethayarajh2023halos,
  author = {Ethayarajh, Kawin and Xu, Winnie, and Jurafsky, Dan and Kiela, Douwe},
  title = {Human-Centered Loss Functions (HALOs)},
  institution = {Contextual AI},
  note = {https://github.com/ContextualAI/HALOs/blob/main/assets/report.pdf},
  year = {2023},
}

Runs of ContextualAI Contextual_KTO_Mistral_PairRM on huggingface.co

75
Total runs
0
24-hour runs
-2
3-day runs
2
7-day runs
-64
30-day runs

More Information About Contextual_KTO_Mistral_PairRM huggingface.co Model

More Contextual_KTO_Mistral_PairRM license Visit here:

https://choosealicense.com/licenses/apache-2.0

Contextual_KTO_Mistral_PairRM huggingface.co

Contextual_KTO_Mistral_PairRM huggingface.co is an AI model on huggingface.co that provides Contextual_KTO_Mistral_PairRM's model effect (), which can be used instantly with this ContextualAI Contextual_KTO_Mistral_PairRM model. huggingface.co supports a free trial of the Contextual_KTO_Mistral_PairRM model, and also provides paid use of the Contextual_KTO_Mistral_PairRM. Support call Contextual_KTO_Mistral_PairRM model through api, including Node.js, Python, http.

Contextual_KTO_Mistral_PairRM huggingface.co Url

https://huggingface.co/ContextualAI/Contextual_KTO_Mistral_PairRM

ContextualAI Contextual_KTO_Mistral_PairRM online free

Contextual_KTO_Mistral_PairRM huggingface.co is an online trial and call api platform, which integrates Contextual_KTO_Mistral_PairRM's modeling effects, including api services, and provides a free online trial of Contextual_KTO_Mistral_PairRM, you can try Contextual_KTO_Mistral_PairRM online for free by clicking the link below.

ContextualAI Contextual_KTO_Mistral_PairRM online free url in huggingface.co:

https://huggingface.co/ContextualAI/Contextual_KTO_Mistral_PairRM

Contextual_KTO_Mistral_PairRM install

Contextual_KTO_Mistral_PairRM is an open source model from GitHub that offers a free installation service, and any user can find Contextual_KTO_Mistral_PairRM on GitHub to install. At the same time, huggingface.co provides the effect of Contextual_KTO_Mistral_PairRM install, users can directly use Contextual_KTO_Mistral_PairRM installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Contextual_KTO_Mistral_PairRM install url in huggingface.co:

https://huggingface.co/ContextualAI/Contextual_KTO_Mistral_PairRM

Url of Contextual_KTO_Mistral_PairRM

Contextual_KTO_Mistral_PairRM huggingface.co Url

Provider of Contextual_KTO_Mistral_PairRM huggingface.co

ContextualAI
ORGANIZATIONS

Other API from ContextualAI