Total runs:
64.4K
Run Growth:
11.5K
Growth Rate:
17.92%
Sponsored by
YouArt
QuantFactory / TinySlime-1.1B-Chat-v1.0-GGUF
Model's Last Updated: September 11 2024
text-generation
Introduction of TinySlime-1.1B-Chat-v1.0-GGUF
Model Details of TinySlime-1.1B-Chat-v1.0-GGUF
QuantFactory/TinySlime-1.1B-Chat-v1.0-GGUF
This is quantized version of 2121-8/TinySlime-1.1B-Chat-v1.0 created using llama.cpp
Original Model Card
TinySlime-1.1B-Chat-v1.0
TinySlime は日本語に特化した小規模言語モデルです。
モデルの一覧
このモデルのフルチューニングは、 Axolotl を使用して行われました。
モデル概要
TinySlime-1.1B-Chat-v1.0 は、TinySlime-1.1B-Chat-v1.0 をベースに、Mixtral-8x7B-Instruct-v0.1 が作成した合成データを使用して微調整されたチャットモデルです。
このモデルは、スマートフォンや NVIDIA Jetson などの組み込み環境で動かすことを想定して作成されました。
ベンチマーク(JP Language Model Evaluation Harness)
| model name | JCommonsenseQA (3-shot) | JNLI (3-shot) | MARC-ja (0-shot) | JSQuAD (2-shot) | jaqket-v2 (1-shot) | xlsum (1-shot) | xwinograd (0-shot) | mgsm (5-shot) | AVERAGE |
|---|---|---|---|---|---|---|---|---|---|
| lkarasu-1.1B | 24.84 | 34.78 | 50.48 | 51.33 | 18.95 | 9.21 | 62.15 | 2.80 | 31.82 |
| TinySlime-Chat | 66.49 | 64.36 | 92.68 | 84.60 | 42.14 | 7.79 | 60.69** | 9.20 | 53.50 |
| japanese-large-lm-3.6b-instruction-sft | 38.87 | 34.68 | 50.52 | 58.57 | 56.54 | 6.25 | 64.23 | 1.60 | 38.91 |
| open-calm-3b | 31.64 | 36.56 | 50.99 | 51.47 | 50.99 | 4.63 | 63.30 | 2.00 | 35.97 |
| bilingual-gpt-neox-4b-instruction-ppo | 50.49 | 38.90 | 88.65 | 72.82 | 65.65 | 4.69 | 64.75 | 3.80 | 48.72 |
| japanese-gpt-neox-3.6b-instruction-ppo | 44.59 | 35.25 | 64.34 | 58.53 | 26.67 | 3.79 | 68.72 | 3.20 | 33.26 |
使用方法
インストール
このモデルを使用するには、Hugging Face の
transformers
ライブラリをインストールする必要があります
pip install -U transformers
モデルの読み込み
transformers
ライブラリを使用してモデルを読み込むことができます
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "2121-8/TinySlime-1.1B-Chat-v1.0"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)
テキスト生成
以下の例では、読み込んだモデルを使用してテキストを生成する方法を示します
text = "こんにちは"
messages = [
{
"role": "system",
"content": "You are an assistant called ChatBot. You are a friendly and very good chatbot.",
},
{"role": "user", "content": text},
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
input_ids = tokenizer(prompt, return_tensors="pt")
# テキストを生成
outputs = model.generate(input_ids, max_length=50, num_return_sequences=1)
generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(generated_text)
謝辞
このモデルは、TinyLlama プロジェクトの成果に基づいて構築されました。NLP コミュニティへの貢献に感謝します。 また、このモデルの開発にあたり、 Axolotl のサポートとツールを利用しました。 NLP コミュニティへの貢献に感謝します。
Runs of QuantFactory TinySlime-1.1B-Chat-v1.0-GGUF on huggingface.co
824
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About TinySlime-1.1B-Chat-v1.0-GGUF huggingface.co Model
Url of TinySlime-1.1B-Chat-v1.0-GGUF
TinySlime-1.1B-Chat-v1.0-GGUF huggingface.co Url
Provider of TinySlime-1.1B-Chat-v1.0-GGUF huggingface.co
Other API from QuantFactory
Updated:July 26 2024
Total runs:
26.6K
Run Growth:
13.1K
Growth Rate:
48.97%
Total runs:
18.8K
Run Growth:
3.5K
Growth Rate:
20.33%
Total runs:
13.4K
Run Growth:
3.1K
Growth Rate:
23.41%
Total runs:
9.6K
Run Growth:
5.5K
Growth Rate:
57.40%
Total runs:
8.7K
Run Growth:
6.9K
Growth Rate:
79.93%
Total runs:
8.1K
Run Growth:
1.2K
Growth Rate:
17.73%
Total runs:
8.0K
Run Growth:
-457
Growth Rate:
-5.82%
Total runs:
5.3K
Run Growth:
2.9K
Growth Rate:
54.84%
Total runs:
5.3K
Run Growth:
1.4K
Growth Rate:
25.70%
Total runs:
4.9K
Run Growth:
3.4K
Growth Rate:
69.50%
Total runs:
3.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.8K
Run Growth:
3.2K
Growth Rate:
83.68%
Total runs:
3.7K
Run Growth:
749
Growth Rate:
20.02%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.1K
Run Growth:
2.4K
Growth Rate:
75.03%
Total runs:
3.1K
Run Growth:
-1.6K
Growth Rate:
-53.12%
Total runs:
3.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
543
Growth Rate:
18.25%
Total runs:
3.0K
Run Growth:
-383
Growth Rate:
-12.89%
Total runs:
3.0K
Run Growth:
189
Growth Rate:
6.38%
Total runs:
2.9K
Run Growth:
-55
Growth Rate:
-1.89%
Total runs:
2.9K
Run Growth:
99
Growth Rate:
3.22%
Total runs:
2.8K
Run Growth:
381
Growth Rate:
13.54%
Total runs:
2.8K
Run Growth:
104
Growth Rate:
3.71%
Total runs:
2.8K
Run Growth:
-600
Growth Rate:
-21.75%
Total runs:
2.7K
Run Growth:
42
Growth Rate:
1.53%
Total runs:
2.7K
Run Growth:
410
Growth Rate:
15.47%
Total runs:
2.6K
Run Growth:
-1.3K
Growth Rate:
-49.76%
Total runs:
2.4K
Run Growth:
825
Growth Rate:
34.94%
Total runs:
2.4K
Run Growth:
-23
Growth Rate:
-0.97%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
97.43%
Total runs:
2.2K
Run Growth:
799
Growth Rate:
42.68%
Total runs:
2.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
1.1K
Growth Rate:
56.71%
Total runs:
2.0K
Run Growth:
746
Growth Rate:
37.53%
Total runs:
2.0K
Run Growth:
757
Growth Rate:
38.62%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
56.81%
Total runs:
1.9K
Run Growth:
523
Growth Rate:
26.97%
Total runs:
1.8K
Run Growth:
229
Growth Rate:
12.41%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
-169
Growth Rate:
-9.46%
Total runs:
1.8K
Run Growth:
574
Growth Rate:
32.67%
Total runs:
1.7K
Run Growth:
312
Growth Rate:
17.99%
Total runs:
1.7K
Run Growth:
259
Growth Rate:
15.12%
Total runs:
1.7K
Run Growth:
698
Growth Rate:
41.33%
Total runs:
1.7K
Run Growth:
405
Growth Rate:
24.76%
Total runs:
1.7K
Run Growth:
47
Growth Rate:
3.01%
Total runs:
1.7K
Run Growth:
331
Growth Rate:
20.20%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
91.00%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.6K
Run Growth:
339
Growth Rate:
20.91%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
211
Growth Rate:
13.47%
Total runs:
1.6K
Run Growth:
1.1K
Growth Rate:
73.05%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
444
Growth Rate:
34.05%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
389
Growth Rate:
27.75%
Total runs:
1.4K
Run Growth:
612
Growth Rate:
46.97%
Total runs:
1.4K
Run Growth:
588
Growth Rate:
43.85%
Total runs:
1.4K
Run Growth:
496
Growth Rate:
36.31%
Total runs:
1.4K
Run Growth:
617
Growth Rate:
53.65%
Total runs:
1.3K
Run Growth:
361
Growth Rate:
26.94%
Total runs:
1.3K
Run Growth:
681
Growth Rate:
50.86%
Total runs:
1.3K
Run Growth:
-22
Growth Rate:
-1.64%
Total runs:
1.3K
Run Growth:
-47
Growth Rate:
-3.54%
Total runs:
1.3K
Run Growth:
818
Growth Rate:
70.95%
Total runs:
1.3K
Run Growth:
765
Growth Rate:
65.55%
Total runs:
1.3K
Run Growth:
29
Growth Rate:
2.87%
Total runs:
1.3K
Run Growth:
-251
Growth Rate:
-22.31%
Total runs:
1.3K
Run Growth:
709
Growth Rate:
59.43%
Total runs:
1.3K
Run Growth:
616
Growth Rate:
50.95%
Total runs:
1.3K
Run Growth:
906
Growth Rate:
89.44%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
251
Growth Rate:
20.37%
Total runs:
1.2K
Run Growth:
197
Growth Rate:
16.24%
Total runs:
1.2K
Run Growth:
728
Growth Rate:
62.28%
Total runs:
1.2K
Run Growth:
468
Growth Rate:
38.61%
Total runs:
1.2K
Run Growth:
965
Growth Rate:
85.85%
Total runs:
1.2K
Run Growth:
707
Growth Rate:
60.53%
Total runs:
1.2K
Run Growth:
673
Growth Rate:
67.03%
Total runs:
1.2K
Run Growth:
109
Growth Rate:
11.35%
Total runs:
1.2K
Run Growth:
502
Growth Rate:
45.68%
Total runs:
1.2K
Run Growth:
101
Growth Rate:
10.88%
Total runs:
1.2K
Run Growth:
728
Growth Rate:
74.13%
Total runs:
1.2K
Run Growth:
531
Growth Rate:
45.46%
Total runs:
1.2K
Run Growth:
624
Growth Rate:
74.02%
Total runs:
1.2K
Run Growth:
440
Growth Rate:
51.34%
Total runs:
1.2K
Run Growth:
438
Growth Rate:
52.08%
Total runs:
1.2K
Run Growth:
393
Growth Rate:
34.75%
Total runs:
1.2K
Run Growth:
531
Growth Rate:
48.45%
Total runs:
1.1K
Run Growth:
415
Growth Rate:
36.12%
Total runs:
1.1K
Run Growth:
68
Growth Rate:
5.95%
Total runs:
1.1K
Run Growth:
67
Growth Rate:
5.99%
Total runs:
1.1K
Run Growth:
38
Growth Rate:
3.40%