Sponsored by
Vmake Labs Video Enhancer
Undi95 / MistralThinker-v1.1-GGUF
Model's Last Updated: February 27 2025
Introduction of MistralThinker-v1.1-GGUF
Model Details of MistralThinker-v1.1-GGUF
MistralThinker Model Card
Please, read this:
https://huggingface.co/Undi95/MistralThinker-v1.1/discussions/1
Prefill required for the Assistant:
<think>\n
Model Description
Model Name:
MistralThinker
Version:
1.1
Prompt Format:
Mistral-V7
[SYSTEM_PROMPT]{system prompt}[/SYSTEM_PROMPT][INST]{user message}[/INST]{assistant response}</s>
This model is a specialized variant of Mistral-Small-24B-Base-2501 , adapted using a DeepSeek R1 distillation process. It is primarily designed for roleplay (RP) and storywriting applications, focusing on character interactions, narrative generation, and creative storytelling. Approximately 40% of the training dataset consists of roleplay/storywriting/character card data, ensuring rich and contextually immersive outputs in these domains.
Model Sources
- Base Model: Mistral-Small-24B-Base-2501
- Fine-Tuning Approach: DeepSeek R1 process (focused on RP)
- Dataset Size: The dataset used in training doubled since the last version, adding more neutral logs, training the Base model to stick more on my new format.
Intended Use
-
Primary Use Cases:
- Roleplay (RP): Engaging with users in fictional or scenario-based interactions.
- Storywriting: Generating narratives, character dialogues, and creative texts.
- Character Lore Generation: Serving as a resource to craft or expand on character backstories and interactions.
-
How To Use:
- User-First Message: The first message in any interaction should come from the user, ensuring the model responds in a narrative or roleplay context guided by user input.
- Contextual Information: User or assistant details can be placed either in the system prompt or the user's first message. A system prompt is not mandatory , but any contextual instructions or role descriptions can help set the stage.
- DeepSeek-Style Interaction: The model can also be used purely as a DeepSeek distill without additional system prompts, providing flexible usage for direct storytelling or roleplay scenarios. The model still can be biased toward Roleplay data, and it is expected.
Training Data
- DeepSeek R1 Thinking Process: The model inherits a refined chain-of-thought (thinking process) from DeepSeek R1, which places heavy emphasis on roleplay and narrative coherence.
-
Dataset Composition:
- 40%: RP/Storywriting/Character Cards
- 60%: Various curated data for broad language, math, logical, space... understanding
- Data Scaling: The dataset size was doubled compared to previous iterations, which enhances the model’s creative and contextual capabilities.
Model Performance
-
Strengths:
- Storytelling & Roleplay: Rich in creative generation, character portrayal, and scenario building.
- Dialogue & Interaction: Capable of sustaining engaging and context-driven dialogues.
- Adaptability: Can be used with or without a system prompt to match a range of user preferences.
-
Limitations & Bias:
- Hallucination: It can generate fictitious information in the thinking process, but still end up with a succesfull reply.
-
Thinking can be dismissed:
Being a distillation of DeepSeek R1 is essence, this model, even trained on Base, could forget to add
<think>\nin some scenario.
Ethical Considerations
- Yes
Usage Recommendations
-
System Prompt (Optional):
You may provide a high-level system prompt detailing the scenario or the desired style of roleplay and storywriting.
Example: "You are a friendly fantasy innkeeper who greets travelers from distant lands." -
User’s First Message:
-
Must clearly state or imply the scenario or context if no system prompt is provided.
Example: "Hello, I’m a wandering knight seeking shelter. Could you share a story about local legends?"
-
Must clearly state or imply the scenario or context if no system prompt is provided.
-
Roleplay & Storywriting Focus:
- Encourage the model to develop characters, backstories, and immersive dialogues.
- For more direct, unfiltered or freeform creativity, skip the system prompt.
- If you still want to have some "logs" from previous message before starting a conversation, put them in the first user message, or in the system prompt.
- You can put exemple message of the character you RP with in the system prompt, too.
Runs of Undi95 MistralThinker-v1.1-GGUF on huggingface.co
386
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
-11
30-day runs
More Information About MistralThinker-v1.1-GGUF huggingface.co Model
Url of MistralThinker-v1.1-GGUF
MistralThinker-v1.1-GGUF huggingface.co Url
Provider of MistralThinker-v1.1-GGUF huggingface.co
Other API from Undi95
Total runs:
876
Run Growth:
268
Growth Rate:
30.59%
Total runs:
804
Run Growth:
-245
Growth Rate:
-30.47%
Total runs:
802
Run Growth:
-251
Growth Rate:
-31.30%
Total runs:
800
Run Growth:
-229
Growth Rate:
-28.63%
Total runs:
729
Run Growth:
-253
Growth Rate:
-34.71%
Total runs:
719
Run Growth:
-277
Growth Rate:
-38.53%
Total runs:
717
Run Growth:
-225
Growth Rate:
-31.38%
Total runs:
713
Run Growth:
-252
Growth Rate:
-35.34%
Total runs:
704
Run Growth:
-258
Growth Rate:
-36.65%
Total runs:
691
Run Growth:
69
Growth Rate:
9.99%
Total runs:
532
Run Growth:
502
Growth Rate:
94.36%
Total runs:
310
Run Growth:
-63
Growth Rate:
-20.32%
Total runs:
284
Run Growth:
-27.0K
Growth Rate:
-9501.06%
Total runs:
228
Run Growth:
142
Growth Rate:
61.47%
Total runs:
197
Run Growth:
-825
Growth Rate:
-418.78%
Total runs:
190
Run Growth:
-155
Growth Rate:
-81.58%
Total runs:
185
Run Growth:
83
Growth Rate:
44.86%
Total runs:
182
Run Growth:
116
Growth Rate:
63.74%
Total runs:
157
Run Growth:
18
Growth Rate:
11.46%
Total runs:
157
Run Growth:
84
Growth Rate:
53.50%
Total runs:
150
Run Growth:
76
Growth Rate:
53.52%
Total runs:
146
Run Growth:
-449
Growth Rate:
-307.53%
Total runs:
141
Run Growth:
-469
Growth Rate:
-332.62%
Total runs:
141
Run Growth:
-477
Growth Rate:
-338.30%
Total runs:
139
Run Growth:
-20
Growth Rate:
-14.71%
Total runs:
138
Run Growth:
-60
Growth Rate:
-43.48%
Total runs:
138
Run Growth:
-96
Growth Rate:
-69.57%
Total runs:
135
Run Growth:
-37
Growth Rate:
-26.24%
Total runs:
134
Run Growth:
-322
Growth Rate:
-240.30%
Total runs:
134
Run Growth:
94
Growth Rate:
70.68%
Total runs:
123
Run Growth:
-314
Growth Rate:
-255.28%
Total runs:
122
Run Growth:
-477
Growth Rate:
-390.98%
Total runs:
120
Run Growth:
-485
Growth Rate:
-404.17%
Total runs:
114
Run Growth:
-109
Growth Rate:
-96.46%
Total runs:
106
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
22
Growth Rate:
21.15%
Total runs:
97
Run Growth:
17
Growth Rate:
17.53%
Total runs:
95
Run Growth:
54
Growth Rate:
56.84%
Total runs:
95
Run Growth:
-354
Growth Rate:
-372.63%
Total runs:
93
Run Growth:
-64
Growth Rate:
-65.98%
Total runs:
86
Run Growth:
-71
Growth Rate:
-78.89%
Total runs:
85
Run Growth:
-42
Growth Rate:
-49.41%
Total runs:
85
Run Growth:
77
Growth Rate:
90.59%
Total runs:
84
Run Growth:
63
Growth Rate:
75.00%
Total runs:
83
Run Growth:
-9
Growth Rate:
-10.84%
Total runs:
82
Run Growth:
3
Growth Rate:
3.66%
Total runs:
82
Run Growth:
-4
Growth Rate:
-4.82%
Total runs:
73
Run Growth:
-134
Growth Rate:
-183.56%
Total runs:
72
Run Growth:
-1
Growth Rate:
-1.39%
Total runs:
70
Run Growth:
32
Growth Rate:
45.71%
Total runs:
69
Run Growth:
0
Growth Rate:
0.00%
Total runs:
65
Run Growth:
-43
Growth Rate:
-62.32%
Total runs:
64
Run Growth:
20
Growth Rate:
31.25%
Total runs:
63
Run Growth:
-35
Growth Rate:
-55.56%
Total runs:
62
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58
Run Growth:
-17
Growth Rate:
-28.81%
Total runs:
58
Run Growth:
-45
Growth Rate:
-77.59%
Total runs:
57
Run Growth:
41
Growth Rate:
71.93%
Total runs:
57
Run Growth:
51
Growth Rate:
89.47%
Total runs:
56
Run Growth:
-165
Growth Rate:
-294.64%
Total runs:
55
Run Growth:
-31
Growth Rate:
-56.36%
Total runs:
55
Run Growth:
-9
Growth Rate:
-16.36%
Total runs:
54
Run Growth:
5
Growth Rate:
9.26%
Total runs:
53
Run Growth:
-13
Growth Rate:
-24.53%
Total runs:
52
Run Growth:
-1.1K
Growth Rate:
-2084.62%
Total runs:
51
Run Growth:
11
Growth Rate:
22.00%
Total runs:
50
Run Growth:
-33
Growth Rate:
-61.11%
Total runs:
49
Run Growth:
-28
Growth Rate:
-57.14%
Total runs:
49
Run Growth:
16
Growth Rate:
32.65%