M4-ai / Orca-2.0-Tau-1.8B

huggingface.co
Total runs: 10
24-hour runs: 0
7-day runs: 0
30-day runs: -4
Model's Last Updated: December 02 2025
text-generation

Introduction of Orca-2.0-Tau-1.8B

Model Details of Orca-2.0-Tau-1.8B

Orca-2.0-Tau-1.8B

We fine-tuned tau-1.8B on a high quality mix for general-purpose assistants. A DPO version of this will be released soon. We use the ChatML prompt format.

Model Details
Model Description

This model has capabilities in math, coding, writing, and more. We fine-tuned it using a high quality mix for general-purpose assistants.

  • Developed by: M4-ai
  • Language(s) (NLP): English and maybe Chinese
  • License: tongyi-qianwen license
  • Finetuned from model: tau-1.8B
Uses

General purpose assistant, question answering, chain-of-thought, etc..

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

Evaluation

Coming soon

Training Details
Training Data
  • Open-Orca/SlimOrca
  • m-a-p/Code-Feedback
  • MaziyarPanahi/WizardLM_evol_instruct_V2_196k
  • camel-ai/math
  • camel-ai/physics
  • camel-ai/biology
  • camel-ai/chemistry
  • LDJnr/Capybara
  • jondurbin/airoboros-3.2
  • microsoft/orca-math-word-problems-200k
Evaluations
Tasks Version Filter n-shot Metric Value Stderr
agieval_nous N/A none 0 acc 0.2537 ± 0.0086
none 0 acc_norm 0.2474 ± 0.0085
- agieval_aqua_rat 1 none 0 acc 0.2283 ± 0.0264
none 0 acc_norm 0.2441 ± 0.0270
- agieval_logiqa_en 1 none 0 acc 0.2750 ± 0.0175
none 0 acc_norm 0.3164 ± 0.0182
- agieval_lsat_ar 1 none 0 acc 0.2087 ± 0.0269
none 0 acc_norm 0.1739 ± 0.0250
- agieval_lsat_lr 1 none 0 acc 0.1843 ± 0.0172
none 0 acc_norm 0.2353 ± 0.0188
- agieval_lsat_rc 1 none 0 acc 0.2602 ± 0.0268
none 0 acc_norm 0.1784 ± 0.0234
- agieval_sat_en 1 none 0 acc 0.3544 ± 0.0334
none 0 acc_norm 0.2961 ± 0.0319
- agieval_sat_en_without_passage 1 none 0 acc 0.3107 ± 0.0323
none 0 acc_norm 0.2282 ± 0.0293
- agieval_sat_math 1 none 0 acc 0.2727 ± 0.0301
none 0 acc_norm 0.2091 ± 0.0275
truthfulqa_mc2 2 none 0 acc 0.3923 ± 0.0139
Training Hyperparameters
  • Training regime: bf16 non-mixed precision
Technical Specifications
Hardware

We used 8 Kaggle TPUs, and we trained at a global batch size of 128 and sequence length of 2048.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 45.20
AI2 Reasoning Challenge (25-Shot) 37.12
HellaSwag (10-Shot) 61.13
MMLU (5-Shot) 45.27
TruthfulQA (0-shot) 39.10
Winogrande (5-shot) 59.59
GSM8k (5-shot) 28.96

Runs of M4-ai Orca-2.0-Tau-1.8B on huggingface.co

10
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-4
30-day runs

More Information About Orca-2.0-Tau-1.8B huggingface.co Model

More Orca-2.0-Tau-1.8B license Visit here:

https://choosealicense.com/licenses/other

Orca-2.0-Tau-1.8B huggingface.co

Orca-2.0-Tau-1.8B huggingface.co is an AI model on huggingface.co that provides Orca-2.0-Tau-1.8B's model effect (), which can be used instantly with this M4-ai Orca-2.0-Tau-1.8B model. huggingface.co supports a free trial of the Orca-2.0-Tau-1.8B model, and also provides paid use of the Orca-2.0-Tau-1.8B. Support call Orca-2.0-Tau-1.8B model through api, including Node.js, Python, http.

Orca-2.0-Tau-1.8B huggingface.co Url

https://huggingface.co/M4-ai/Orca-2.0-Tau-1.8B

M4-ai Orca-2.0-Tau-1.8B online free

Orca-2.0-Tau-1.8B huggingface.co is an online trial and call api platform, which integrates Orca-2.0-Tau-1.8B's modeling effects, including api services, and provides a free online trial of Orca-2.0-Tau-1.8B, you can try Orca-2.0-Tau-1.8B online for free by clicking the link below.

M4-ai Orca-2.0-Tau-1.8B online free url in huggingface.co:

https://huggingface.co/M4-ai/Orca-2.0-Tau-1.8B

Orca-2.0-Tau-1.8B install

Orca-2.0-Tau-1.8B is an open source model from GitHub that offers a free installation service, and any user can find Orca-2.0-Tau-1.8B on GitHub to install. At the same time, huggingface.co provides the effect of Orca-2.0-Tau-1.8B install, users can directly use Orca-2.0-Tau-1.8B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Orca-2.0-Tau-1.8B install url in huggingface.co:

https://huggingface.co/M4-ai/Orca-2.0-Tau-1.8B

Url of Orca-2.0-Tau-1.8B

Orca-2.0-Tau-1.8B huggingface.co Url

Provider of Orca-2.0-Tau-1.8B huggingface.co

M4-ai
ORGANIZATIONS

Other API from M4-ai

huggingface.co

Total runs: 62
Run Growth: 0
Growth Rate: 0.00%
Updated:March 27 2024
huggingface.co

Total runs: 55
Run Growth: 0
Growth Rate: 0.00%
Updated:March 28 2024