Total runs:
8.1K
Run Growth:
70
Growth Rate:
0.87%
Sponsored by
APIMart
maywell / TinyWand-DPO
Model's Last Updated: February 02 2024
text-generation
Introduction of TinyWand-DPO
Model Details of TinyWand-DPO
TinyWand-DPO
한국어 모델 설명
1.63B, 하찮은 크기의 SLM은 어떨까요?
모델 소개
TinyWand-DPO 는 1.63B의 SLM 모델입니다. 이 모델은 1.63B라는 작은 크기를 가짐으로써 소형기기에서 구동되거나 큰 toks/s를 가질 수 있음과 동시에 강력한 성능을 보여줍니다.
모델 라이센스
OPEN
모델 성능
TBD
학습 과정
TBD
사용 안내
추론에 필요한 VRAM
| 양자화 | 입력 토큰 수 | 출력 토큰 수 | 메모리 사용량 |
|---|---|---|---|
| bf16(base) | 64 | 256 | 3,888 MiB |
| q4_K_M | 64 | 256 | 1,788 MiB |
프롬프트 템플릿
본 모델은 Alpaca 프롬프트 템플릿을 사용합니다.
해당 템플릿은
apply_chat_template()
를 통해
허깅페이스 템플릿
에서 확인 하실 수 있습니다.
아래 파이썬 코드를 사용하여 모델을 로드 및 사용 할 수 있습니다. transformers, torch가 사전 설치되어야함
from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda" # nvidia 그래픽카드 기준
tokenizer = AutoTokenizer.from_pretrained("maywell/TinyWand-DPO")
model = AutoModelForCausalLM.from_pretrained(
"maywell/TinyWand-DPO",
device_map="auto",
torch_dtype=torch.bfloat16, # 사용하는 장비가 bfloat16을 지원하지 않는 경우 torch.float16으로 바꿔주세요.
)
messages = [
{"role": "system", "content": "Below is an instruction that describes a task. Write a response that appropriately completes the request."}, # 비울 경우에도 동일하게 적용 됨.
{"role": "user", "content": "언어모델의 파라미터 수가 작으면 어떤 이점이 있어?"},
]
encodeds = tokenizer.apply_chat_template(messages, return_tensors="pt")
model_inputs = encodeds.to(device)
model.to(device)
generated_ids = model.generate(model_inputs, max_new_tokens=1000, do_sample=True)
decoded = tokenizer.batch_decode(generated_ids)
print(decoded[0])
Runs of maywell TinyWand-DPO on huggingface.co
101
Total runs
0
24-hour runs
-3
3-day runs
-7
7-day runs
20
30-day runs
More Information About TinyWand-DPO huggingface.co Model
Url of TinyWand-DPO
TinyWand-DPO huggingface.co Url
Provider of TinyWand-DPO huggingface.co
Other API from maywell
Updated:November 21 2023
Total runs:
905
Run Growth:
-25
Growth Rate:
-2.76%
Total runs:
897
Run Growth:
-45
Growth Rate:
-5.02%
Total runs:
893
Run Growth:
-48
Growth Rate:
-5.38%
Total runs:
832
Run Growth:
-34
Growth Rate:
-4.09%
Total runs:
826
Run Growth:
-28
Growth Rate:
-3.39%
Total runs:
825
Run Growth:
-42
Growth Rate:
-5.09%
Total runs:
476
Run Growth:
-457
Growth Rate:
-96.01%
Total runs:
185
Run Growth:
0
Growth Rate:
0.00%
Total runs:
176
Run Growth:
139
Growth Rate:
81.29%
Total runs:
147
Run Growth:
55
Growth Rate:
36.91%
Total runs:
132
Run Growth:
50
Growth Rate:
38.17%
Total runs:
120
Run Growth:
-352
Growth Rate:
-293.33%
Total runs:
100
Run Growth:
-306
Growth Rate:
-306.00%
Total runs:
98
Run Growth:
-309
Growth Rate:
-315.31%
Total runs:
78
Run Growth:
62
Growth Rate:
79.49%
Total runs:
78
Run Growth:
55
Growth Rate:
71.43%
Total runs:
76
Run Growth:
4
Growth Rate:
5.26%
Total runs:
71
Run Growth:
-12
Growth Rate:
-16.90%
Total runs:
58
Run Growth:
10
Growth Rate:
17.24%
Total runs:
55
Run Growth:
13
Growth Rate:
23.64%
Total runs:
48
Run Growth:
17
Growth Rate:
35.42%
Total runs:
44
Run Growth:
34
Growth Rate:
77.27%
Total runs:
24
Run Growth:
-2
Growth Rate:
-8.33%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
16
Run Growth:
1
Growth Rate:
6.25%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
2
Growth Rate:
12.50%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%
Total runs:
13
Run Growth:
11
Growth Rate:
84.62%
Total runs:
13
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
11
Run Growth:
-17
Growth Rate:
-154.55%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
9
Run Growth:
-5
Growth Rate:
-55.56%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
-1
Growth Rate:
-11.11%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%