Total runs:
471
Run Growth:
440
Growth Rate:
93.42%
Sponsored by
APIMart
blockblockblock / Faro-Yi-9B-200K-bpw4.6
Model's Last Updated: April 01 2024
text-generation
Introduction of Faro-Yi-9B-200K-bpw4.6
Model Details of Faro-Yi-9B-200K-bpw4.6
The Faro chat model focuses on practicality and long-context modeling. It handles various downstream tasks with higher quality, delivering stable and reliable results even when inputs contain lengthy documents or complex instructions. Faro seamlessly works in both English and Chinese.
Faro-Yi-9B
Faro-Yi-9B is an improved Yi-9B-200K with extensive instruction tuning on Fusang-V1 . Compared to Yi-9B-200K, Faro-Yi-9B has gained greater capability in various downstream tasks and long-context modeling thanks to the large-scale synthetic data in Fusang-V1.
How to Use
Faro-Yi-9B uses chatml template. This make it easy to set up system prompt and multi-turn conversations.
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
model_path,
device_map="cuda"
)
tokenizer = AutoTokenizer.from_pretrained(model_path)
messages = [
{"role": "system", "content": "You are a helpful assistant. Always answer with a short response."},
{"role": "user", "content": "Tell me what is Pythagorean theorem like you are a pirate."}
]
input_ids = tokenizer.apply_chat_template(
messages,
tokenize=True,
add_generation_prompt=True,
return_tensors="pt",
).to(model.device)
generated_ids = model.generate(input_ids, max_new_tokens=512, temperature=0.5)
response = tokenizer.decode(generated_ids[0], skip_special_tokens=True)
# Aye, matey! The Pythagorean theorem is a nautical rule that helps us find the length of the third side of a triangle. It's like this: if you have a triangle with two sides, you can find the length of the third side by squaring the two sides and then adding them together. The square root of that sum will give you the length of the third side! It's useful for sailing and navigating, so you always know how far you've traveled. Remember, it's all about the sum of squares, me hearties!
Performance
Faro-Yi-9B enhances its ability compared to Yi-9B-200K in most dimensions, especially in long-range modeling and bilingual (English, Chinese) understanding. Faro is competitive among all open-sourced models at around 9B parameters.
Benchmark Results
Fact-based Evaluation (Open LLM Leaderboard)
| Metric | MMLU | GSM8K | HellaSwag | TruthfulQA | Arc | Winogrande |
|---|---|---|---|---|---|---|
| Yi-9B-200K | 65.73 | 50.49 | 56.72 | 33.80 | 69.25 | 71.67 |
| Faro-Yi-9B | 68.80 | 63.08 | 57.28 | 40.86 | 72.58 | 71.11 |
Long-context Modeling ( LongBench )
| Name | Average_zh | Average_en | Code Completion |
|---|---|---|---|
| Yi-9B-200K | 30.288 | 36.7071 | 72.2 |
| Faro-Yi-9B | 41.092 | 40.9536 | 46.0 |
Score breakdown
| Name | Few-shot Learning_en | Synthetic Tasks_en | Single-Doc QA_en | Multi-Doc QA_en | Summarization_en | Few-shot Learning_zh | Synthetic Tasks_zh | Single-Doc QA_zh | Multi-Doc QA_zh | Summarization_zh |
|---|---|---|---|---|---|---|---|---|---|---|
| Yi-9B-200K | 60.6 | 22.8 | 30.9 | 38.9 | 25.8 | 46.5 | 28.0 | 49.6 | 17.7 | 9.7 |
| Faro-Yi-9B | 63.8 | 40.2 | 36.2 | 38.0 | 26.3 | 30.0 | 75.1 | 55.6 | 30.7 | 14.1 |
Bilingual Ability (CMMLU & MMLU)
| Name | MMLU | CMMLU |
|---|---|---|
| Yi-9B-200K | 65.73 | 71.97 |
| Faro-Yi-9B | 68.80 | 73.28 |
Runs of blockblockblock Faro-Yi-9B-200K-bpw4.6 on huggingface.co
17
Total runs
0
24-hour runs
-2
3-day runs
-6
7-day runs
-1
30-day runs
More Information About Faro-Yi-9B-200K-bpw4.6 huggingface.co Model
Url of Faro-Yi-9B-200K-bpw4.6
Faro-Yi-9B-200K-bpw4.6 huggingface.co Url
Provider of Faro-Yi-9B-200K-bpw4.6 huggingface.co
Other API from blockblockblock
Updated:July 04 2026
Total runs:
382
Run Growth:
382
Growth Rate:
100.00%
Total runs:
253
Run Growth:
112
Growth Rate:
44.27%
Total runs:
202
Run Growth:
36
Growth Rate:
17.82%
Total runs:
179
Run Growth:
179
Growth Rate:
100.00%
Total runs:
157
Run Growth:
48
Growth Rate:
30.57%
Total runs:
151
Run Growth:
13
Growth Rate:
8.78%
Total runs:
141
Run Growth:
-51
Growth Rate:
-36.96%
Total runs:
96
Run Growth:
24
Growth Rate:
25.00%
Total runs:
93
Run Growth:
32
Growth Rate:
34.41%
Total runs:
91
Run Growth:
-6
Growth Rate:
-6.74%
Total runs:
89
Run Growth:
31
Growth Rate:
32.98%
Total runs:
64
Run Growth:
14
Growth Rate:
21.88%
Total runs:
63
Run Growth:
-2
Growth Rate:
-3.17%
Total runs:
63
Run Growth:
7
Growth Rate:
10.77%
Total runs:
61
Run Growth:
4
Growth Rate:
6.15%
Total runs:
60
Run Growth:
12
Growth Rate:
20.00%
Total runs:
48
Run Growth:
30
Growth Rate:
61.22%
Total runs:
46
Run Growth:
12
Growth Rate:
25.00%
Total runs:
44
Run Growth:
-3
Growth Rate:
-6.82%
Total runs:
43
Run Growth:
24
Growth Rate:
54.55%
Total runs:
41
Run Growth:
29
Growth Rate:
69.05%
Total runs:
41
Run Growth:
10
Growth Rate:
24.39%
Total runs:
38
Run Growth:
4
Growth Rate:
11.11%
Total runs:
37
Run Growth:
23
Growth Rate:
60.53%
Total runs:
36
Run Growth:
17
Growth Rate:
45.95%
Total runs:
35
Run Growth:
-14
Growth Rate:
-38.89%
Total runs:
34
Run Growth:
24
Growth Rate:
68.57%
Total runs:
33
Run Growth:
33
Growth Rate:
100.00%
Total runs:
33
Run Growth:
18
Growth Rate:
52.94%
Total runs:
32
Run Growth:
-36
Growth Rate:
-112.50%
Total runs:
32
Run Growth:
21
Growth Rate:
63.64%
Total runs:
31
Run Growth:
16
Growth Rate:
50.00%
Total runs:
31
Run Growth:
17
Growth Rate:
53.13%
Total runs:
31
Run Growth:
19
Growth Rate:
59.38%
Total runs:
31
Run Growth:
-7
Growth Rate:
-22.58%
Total runs:
31
Run Growth:
19
Growth Rate:
59.38%
Total runs:
31
Run Growth:
17
Growth Rate:
53.13%
Total runs:
30
Run Growth:
18
Growth Rate:
58.06%
Total runs:
30
Run Growth:
17
Growth Rate:
54.84%
Total runs:
30
Run Growth:
15
Growth Rate:
48.39%
Total runs:
30
Run Growth:
18
Growth Rate:
56.25%
Total runs:
29
Run Growth:
-4
Growth Rate:
-13.79%
Total runs:
29
Run Growth:
15
Growth Rate:
51.72%
Total runs:
29
Run Growth:
15
Growth Rate:
50.00%
Total runs:
29
Run Growth:
-35
Growth Rate:
-120.69%
Total runs:
29
Run Growth:
15
Growth Rate:
51.72%
Total runs:
29
Run Growth:
11
Growth Rate:
37.93%
Total runs:
28
Run Growth:
16
Growth Rate:
55.17%
Total runs:
28
Run Growth:
14
Growth Rate:
48.28%
Total runs:
28
Run Growth:
16
Growth Rate:
57.14%
Total runs:
28
Run Growth:
8
Growth Rate:
28.57%
Total runs:
28
Run Growth:
14
Growth Rate:
46.67%
Total runs:
28
Run Growth:
12
Growth Rate:
41.38%
Total runs:
27
Run Growth:
8
Growth Rate:
29.63%
Total runs:
27
Run Growth:
14
Growth Rate:
50.00%
Total runs:
26
Run Growth:
-18
Growth Rate:
-69.23%
Total runs:
26
Run Growth:
14
Growth Rate:
51.85%
Total runs:
26
Run Growth:
15
Growth Rate:
55.56%
Total runs:
25
Run Growth:
10
Growth Rate:
38.46%
Total runs:
25
Run Growth:
14
Growth Rate:
53.85%
Total runs:
25
Run Growth:
14
Growth Rate:
53.85%
Total runs:
24
Run Growth:
12
Growth Rate:
50.00%
Total runs:
24
Run Growth:
8
Growth Rate:
33.33%
Total runs:
24
Run Growth:
10
Growth Rate:
41.67%
Total runs:
24
Run Growth:
7
Growth Rate:
30.43%
Total runs:
24
Run Growth:
-9
Growth Rate:
-37.50%
Total runs:
24
Run Growth:
9
Growth Rate:
39.13%
Total runs:
23
Run Growth:
9
Growth Rate:
37.50%
Total runs:
23
Run Growth:
9
Growth Rate:
40.91%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
10
Growth Rate:
43.48%
Total runs:
23
Run Growth:
8
Growth Rate:
33.33%
Total runs:
23
Run Growth:
7
Growth Rate:
31.82%
Total runs:
23
Run Growth:
10
Growth Rate:
45.45%
Total runs:
23
Run Growth:
7
Growth Rate:
31.82%
Total runs:
23
Run Growth:
3
Growth Rate:
13.64%
Total runs:
23
Run Growth:
5
Growth Rate:
21.74%
Total runs:
22
Run Growth:
10
Growth Rate:
45.45%
Total runs:
22
Run Growth:
4
Growth Rate:
19.05%
Total runs:
22
Run Growth:
8
Growth Rate:
38.10%
Total runs:
22
Run Growth:
4
Growth Rate:
18.18%
Total runs:
22
Run Growth:
-13
Growth Rate:
-59.09%
Total runs:
22
Run Growth:
-11
Growth Rate:
-50.00%
Total runs:
22
Run Growth:
8
Growth Rate:
38.10%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
22
Run Growth:
3
Growth Rate:
14.29%
Total runs:
22
Run Growth:
11
Growth Rate:
52.38%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
22
Run Growth:
-13
Growth Rate:
-59.09%
Total runs:
22
Run Growth:
5
Growth Rate:
23.81%
Total runs:
21
Run Growth:
10
Growth Rate:
45.45%
Total runs:
21
Run Growth:
7
Growth Rate:
35.00%
Total runs:
21
Run Growth:
5
Growth Rate:
23.81%
Total runs:
21
Run Growth:
7
Growth Rate:
35.00%
Total runs:
21
Run Growth:
7
Growth Rate:
31.82%
Total runs:
21
Run Growth:
6
Growth Rate:
30.00%