Sponsored by
ThumbnailCreator.com
p1atdev / nekoqarasu-14b-chat
Model's Last Updated: December 31 2023
text-generation
Introduction of nekoqarasu-14b-chat
Model Details of nekoqarasu-14b-chat
Nekoqarasu
nekoqarasu-14b-chat = rinna/nekomata-14b + lightblue/qarasu-14B-chat-plus-unleashed - Qwen/Qwen-14B
Example
pip install accelerate transformers tiktoken einops scipy transformers_stream_generator
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, TextStreamer
MODEL_NAME = "p1atdev/nekoqarasu-14b-chat"
tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
MODEL_NAME,
load_in_4bit=True,
torch_dtype=torch.float16,
device_map="auto",
trust_remote_code=True,
)
model.eval()
# model = torch.compile(model) # recommended if you're using linux
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)
prompt = """\
# system
誠実で紳士的で優秀なAIアシスタントとして、簡潔でわかりやすく役に立つ回答を自信をもって答えなさい。
# question
まどか☆マギカでは誰が一番かわいい?
# answer
"""
input_ids = tokenizer(prompt, return_tensors="pt", add_special_tokens=False).to(model.device)
_ = model.generate(
**input_ids,
max_new_tokens=256,
do_sample=True,
top_k=20,
top_p=0.95,
temperature=1.0,
repetition_penalty=1.1,
num_beams=1,
eos_token_id=151643,
pad_token_id=151643,
streamer=streamer
)
The output:
この問題は主観的な評価に基づくため、個人の好みや考え方によって異なることがあります。しかし、一般的に「まどか☆マギカ」の登場人物の中で最も可愛いとされるのは、鹿目まどか（かなめ まどか）です。彼女は純粋で優しい性格でありながら、他のキャラクターたちとは一味違う可愛らしさを持っています。
ただし、「可愛い」という基準には個人差があり、同じ作品に対する感覚や好みも異なることがあります。そのため、特定のキャラクターを選ぶだけでなく、複数のキャラクターから好きな要素を見つけたり、全体的に楽しむことが大切だと思います。
Merge process
See merge.ipynb . (this worked on 8GB VRAM GPU)
Features
- Fluent Japanese responses
- Good knowledge of common sense in Japanese culture
Limitation
-
This model often generates too long responses, that are not related to user's instructions or questions. Also, this model does not seem to know how to end a text.
- Due to these issues, ChatML format prompt works worse compared to other Qwen based models, such as Qwen-Chat or Qarasu.
-
Since I have not measured any benchmarks, this model cannot be quantitatively evaluated.
License
Runs of p1atdev nekoqarasu-14b-chat on huggingface.co
10
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
1
30-day runs
More Information About nekoqarasu-14b-chat huggingface.co Model
Url of nekoqarasu-14b-chat
nekoqarasu-14b-chat huggingface.co Url
Provider of nekoqarasu-14b-chat huggingface.co
Other API from p1atdev
Total runs:
2.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
308
Run Growth:
158
Growth Rate:
53.38%
Total runs:
115
Run Growth:
-80
Growth Rate:
-70.80%
Total runs:
104
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
4
Growth Rate:
3.88%
Total runs:
74
Run Growth:
63
Growth Rate:
85.14%
Total runs:
69
Run Growth:
-143
Growth Rate:
-213.43%
Total runs:
54
Run Growth:
45
Growth Rate:
83.33%
Total runs:
43
Run Growth:
29
Growth Rate:
67.44%
Total runs:
27
Run Growth:
-6
Growth Rate:
-22.22%
Total runs:
18
Run Growth:
-1
Growth Rate:
-5.56%
Total runs:
18
Run Growth:
-17
Growth Rate:
-94.44%
Total runs:
13
Run Growth:
10
Growth Rate:
76.92%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
8
Run Growth:
-3
Growth Rate:
-37.50%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
3
Run Growth:
-7
Growth Rate:
-233.33%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-4
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-3
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%