We fine-tuned tau-1.8B on a high quality mix for general-purpose assistants. A DPO version of this will be released soon. We use the ChatML prompt format.
Model Details
Model Description
This model has capabilities in math, coding, writing, and more. We fine-tuned it using a high quality mix for general-purpose assistants.
General purpose assistant, question answering, chain-of-thought, etc..
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
Evaluation
Coming soon
Training Details
Training Data
Open-Orca/SlimOrca
m-a-p/Code-Feedback
MaziyarPanahi/WizardLM_evol_instruct_V2_196k
camel-ai/math
camel-ai/physics
camel-ai/biology
camel-ai/chemistry
LDJnr/Capybara
jondurbin/airoboros-3.2
microsoft/orca-math-word-problems-200k
Evaluations
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
agieval_nous
N/A
none
0
acc
0.2537
±
0.0086
none
0
acc_norm
0.2474
±
0.0085
- agieval_aqua_rat
1
none
0
acc
0.2283
±
0.0264
none
0
acc_norm
0.2441
±
0.0270
- agieval_logiqa_en
1
none
0
acc
0.2750
±
0.0175
none
0
acc_norm
0.3164
±
0.0182
- agieval_lsat_ar
1
none
0
acc
0.2087
±
0.0269
none
0
acc_norm
0.1739
±
0.0250
- agieval_lsat_lr
1
none
0
acc
0.1843
±
0.0172
none
0
acc_norm
0.2353
±
0.0188
- agieval_lsat_rc
1
none
0
acc
0.2602
±
0.0268
none
0
acc_norm
0.1784
±
0.0234
- agieval_sat_en
1
none
0
acc
0.3544
±
0.0334
none
0
acc_norm
0.2961
±
0.0319
- agieval_sat_en_without_passage
1
none
0
acc
0.3107
±
0.0323
none
0
acc_norm
0.2282
±
0.0293
- agieval_sat_math
1
none
0
acc
0.2727
±
0.0301
none
0
acc_norm
0.2091
±
0.0275
truthfulqa_mc2
2
none
0
acc
0.3923
±
0.0139
Training Hyperparameters
Training regime:
bf16 non-mixed precision
Technical Specifications
Hardware
We used 8 Kaggle TPUs, and we trained at a global batch size of 128 and sequence length of 2048.
Orca-2.0-Tau-1.8B huggingface.co is an AI model on huggingface.co that provides Orca-2.0-Tau-1.8B's model effect (), which can be used instantly with this M4-ai Orca-2.0-Tau-1.8B model. huggingface.co supports a free trial of the Orca-2.0-Tau-1.8B model, and also provides paid use of the Orca-2.0-Tau-1.8B. Support call Orca-2.0-Tau-1.8B model through api, including Node.js, Python, http.
Orca-2.0-Tau-1.8B huggingface.co is an online trial and call api platform, which integrates Orca-2.0-Tau-1.8B's modeling effects, including api services, and provides a free online trial of Orca-2.0-Tau-1.8B, you can try Orca-2.0-Tau-1.8B online for free by clicking the link below.
M4-ai Orca-2.0-Tau-1.8B online free url in huggingface.co:
Orca-2.0-Tau-1.8B is an open source model from GitHub that offers a free installation service, and any user can find Orca-2.0-Tau-1.8B on GitHub to install. At the same time, huggingface.co provides the effect of Orca-2.0-Tau-1.8B install, users can directly use Orca-2.0-Tau-1.8B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.