Total runs:
64.4K
Run Growth:
11.5K
Growth Rate:
17.92%
Sponsored by
AdControlCenter
QuantFactory / deepseek-math-7b-instruct-GGUF
Model's Last Updated: June 10 2024
text-generation
Introduction of deepseek-math-7b-instruct-GGUF
Model Details of deepseek-math-7b-instruct-GGUF
QuantFactory/deepseek-math-7b-instruct-GGUF
This is quanitzed version of deepseek-ai/deepseek-math-7b-instruct created using llama.cpp
Model Description
[🏠Homepage] | [🤖 Chat with DeepSeek LLM] | [Discord] | [Wechat(微信)]
1. Introduction to DeepSeekMath
See the Introduction for more details.
2. How to Use
Here give some examples of how to use our model.
Chat Completion
❗❗❗ Please use chain-of-thought prompt to test DeepSeekMath-Instruct and DeepSeekMath-RL:
-
English questions: {question}\nPlease reason step by step, and put your final answer within \boxed{}.
-
Chinese questions: {question}\n请通过逐步推理来解答问题，并把最终答案放置于\boxed{}中。
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
model_name = "deepseek-ai/deepseek-math-7b-instruct"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")
model.generation_config = GenerationConfig.from_pretrained(model_name)
model.generation_config.pad_token_id = model.generation_config.eos_token_id
messages = [
{"role": "user", "content": "what is the integral of x^2 from 0 to 2?\nPlease reason step by step, and put your final answer within \\boxed{}."}
]
input_tensor = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_tensor.to(model.device), max_new_tokens=100)
result = tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True)
print(result)
Avoiding the use of the provided function
apply_chat_template
, you can also interact with our model following the sample template. Note that
messages
should be replaced by your input.
User: {messages[0]['content']}
Assistant: {messages[1]['content']}<｜end▁of▁sentence｜>User: {messages[2]['content']}
Assistant:
Note:
By default (
add_special_tokens=True
), our tokenizer automatically adds a
bos_token
(
<｜begin▁of▁sentence｜>
) before the input text. Additionally, since the system prompt is not compatible with this version of our models, we DO NOT RECOMMEND including the system prompt in your input.
3. License
This code repository is licensed under the MIT License. The use of DeepSeekMath models is subject to the Model License. DeepSeekMath supports commercial use.
See the LICENSE-MODEL for more details.
4. Contact
If you have any questions, please raise an issue or contact us at [email protected] .
Runs of QuantFactory deepseek-math-7b-instruct-GGUF on huggingface.co
961
Total runs
23
24-hour runs
-31
3-day runs
-32
7-day runs
-55
30-day runs
More Information About deepseek-math-7b-instruct-GGUF huggingface.co Model
Url of deepseek-math-7b-instruct-GGUF
deepseek-math-7b-instruct-GGUF huggingface.co Url
Provider of deepseek-math-7b-instruct-GGUF huggingface.co
Other API from QuantFactory
Updated:July 26 2024
Total runs:
26.6K
Run Growth:
13.1K
Growth Rate:
48.97%
Total runs:
14.6K
Run Growth:
371
Growth Rate:
2.54%
Total runs:
9.6K
Run Growth:
5.5K
Growth Rate:
57.40%
Total runs:
9.3K
Run Growth:
1.1K
Growth Rate:
12.82%
Total runs:
8.7K
Run Growth:
6.9K
Growth Rate:
79.93%
Total runs:
8.3K
Run Growth:
214
Growth Rate:
2.60%
Total runs:
6.1K
Run Growth:
5.0K
Growth Rate:
82.13%
Total runs:
6.0K
Run Growth:
1.1K
Growth Rate:
18.66%
Total runs:
5.3K
Run Growth:
1.4K
Growth Rate:
25.70%
Total runs:
4.9K
Run Growth:
3.4K
Growth Rate:
69.50%
Total runs:
3.9K
Run Growth:
984
Growth Rate:
25.96%
Total runs:
3.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.7K
Run Growth:
749
Growth Rate:
20.02%
Total runs:
3.4K
Run Growth:
2.6K
Growth Rate:
79.11%
Total runs:
3.3K
Run Growth:
-1.1K
Growth Rate:
-34.34%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.1K
Run Growth:
2.4K
Growth Rate:
75.03%
Total runs:
3.1K
Run Growth:
-1.6K
Growth Rate:
-53.12%
Total runs:
3.0K
Run Growth:
990
Growth Rate:
34.19%
Total runs:
3.0K
Run Growth:
-1.5K
Growth Rate:
-48.42%
Total runs:
3.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
543
Growth Rate:
18.25%
Total runs:
3.0K
Run Growth:
-383
Growth Rate:
-12.89%
Total runs:
3.0K
Run Growth:
189
Growth Rate:
6.38%
Total runs:
2.9K
Run Growth:
-55
Growth Rate:
-1.89%
Total runs:
2.8K
Run Growth:
104
Growth Rate:
3.71%
Total runs:
2.8K
Run Growth:
-600
Growth Rate:
-21.75%
Total runs:
2.7K
Run Growth:
42
Growth Rate:
1.53%
Total runs:
2.7K
Run Growth:
410
Growth Rate:
15.47%
Total runs:
2.4K
Run Growth:
-23
Growth Rate:
-0.97%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
97.43%
Total runs:
2.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
746
Growth Rate:
37.53%
Total runs:
2.0K
Run Growth:
757
Growth Rate:
38.62%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
56.81%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
55.36%
Total runs:
1.8K
Run Growth:
229
Growth Rate:
12.41%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
-169
Growth Rate:
-9.46%
Total runs:
1.7K
Run Growth:
312
Growth Rate:
17.99%
Total runs:
1.7K
Run Growth:
47
Growth Rate:
3.02%
Total runs:
1.7K
Run Growth:
698
Growth Rate:
41.33%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
91.00%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.6K
Run Growth:
339
Growth Rate:
20.91%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
503
Growth Rate:
35.57%
Total runs:
1.4K
Run Growth:
197
Growth Rate:
13.89%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
389
Growth Rate:
27.75%
Total runs:
1.4K
Run Growth:
-329
Growth Rate:
-25.50%
Total runs:
1.3K
Run Growth:
-22
Growth Rate:
-1.64%
Total runs:
1.3K
Run Growth:
-47
Growth Rate:
-3.54%
Total runs:
1.3K
Run Growth:
-54
Growth Rate:
-4.24%
Total runs:
1.3K
Run Growth:
684
Growth Rate:
56.30%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
251
Growth Rate:
20.37%
Total runs:
1.1K
Run Growth:
67
Growth Rate:
5.99%
Total runs:
1.1K
Run Growth:
38
Growth Rate:
3.40%
Total runs:
1.1K
Run Growth:
273
Growth Rate:
25.73%
Total runs:
1.1K
Run Growth:
279
Growth Rate:
26.50%
Total runs:
1.1K
Run Growth:
1.0K
Growth Rate:
93.59%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
587
Growth Rate:
55.69%
Total runs:
1.0K
Run Growth:
361
Growth Rate:
35.96%
Total runs:
999
Run Growth:
0
Growth Rate:
0.00%
Total runs:
989
Run Growth:
748
Growth Rate:
75.63%
Total runs:
988
Run Growth:
-379
Growth Rate:
-38.36%
Total runs:
963
Run Growth:
98
Growth Rate:
10.05%
Total runs:
959
Run Growth:
0
Growth Rate:
0.00%
Total runs:
948
Run Growth:
0
Growth Rate:
0.00%
Total runs:
942
Run Growth:
-458
Growth Rate:
-51.87%
Total runs:
939
Run Growth:
0
Growth Rate:
0.00%
Total runs:
931
Run Growth:
0
Growth Rate:
0.00%
Total runs:
926
Run Growth:
0
Growth Rate:
0.00%
Total runs:
920
Run Growth:
0
Growth Rate:
0.00%
Total runs:
919
Run Growth:
0
Growth Rate:
0.00%
Total runs:
914
Run Growth:
398
Growth Rate:
43.83%
Total runs:
913
Run Growth:
223
Growth Rate:
23.72%
Total runs:
909
Run Growth:
206
Growth Rate:
22.66%
Total runs:
901
Run Growth:
556
Growth Rate:
63.91%
Total runs:
900
Run Growth:
155
Growth Rate:
20.89%
Total runs:
900
Run Growth:
738
Growth Rate:
82.00%
Total runs:
888
Run Growth:
0
Growth Rate:
0.00%
Total runs:
877
Run Growth:
0
Growth Rate:
0.00%
Total runs:
875
Run Growth:
450
Growth Rate:
51.43%
Total runs:
875
Run Growth:
0
Growth Rate:
0.00%
Total runs:
871
Run Growth:
0
Growth Rate:
0.00%
Total runs:
861
Run Growth:
0
Growth Rate:
0.00%
Total runs:
855
Run Growth:
0
Growth Rate:
0.00%
Total runs:
853
Run Growth:
0
Growth Rate:
0.00%
Total runs:
851
Run Growth:
-30
Growth Rate:
-3.53%
Total runs:
845
Run Growth:
106
Growth Rate:
12.40%