Sponsored by
iMean AI Trip Planner
shuttleai / shuttle-2.5-mini
Model's Last Updated: July 28 2024
text-generation
Introduction of shuttle-2.5-mini
Model Details of shuttle-2.5-mini
Shuttle-2.5-mini (beta) [2024/07/27]
We are excited to introduce Shuttle-2.5-mini, our next-generation state-of-the-art language model designed to excel in complex chat, multilingual communication, reasoning, and agent tasks.
- Shuttle-2.5-mini is a fine-tuned version of Mistral-Nemo-Base-2407 , emulating the writing style of Claude 3 models and thoroughly trained on role-playing data.
Model Details
- Model Name : Shuttle-2.5-mini
- Developed by : ShuttleAI Inc.
- Base Model : Mistral-Nemo-Base-2407
- Parameters : 13B
- Language(s) : Multilingual
- Repository : https://huggingface.co/shuttleai
- Fine-Tuned Model : https://huggingface.co/shuttleai/shuttle-2.5-mini
- Paper : Shuttle-2.5-mini (Upcoming)
- License : Apache 2.0
Base Model Architecture
Mistral Nemo is a transformer model with the following architecture choices:
- Layers : 40
- Dimension : 5,120
- Head Dimension : 128
- Hidden Dimension : 14,436
- Activation Function : SwiGLU
- Number of Heads : 32
- Number of kv-heads : 8 (GQA)
- Vocabulary Size : 2^17 (approximately 128k)
- Rotary Embeddings : Theta = 1M
Key Features
- Released under the Apache 2 License
- Trained with a 128k context window
- Pretrained on a large proportion of multilingual and code data
- Finetuned to emulate the prose quality of Claude 3 models and extensively on role play data
Fine-Tuning Details
- Training Setup : Trained on 200 million tokens for 24 hours across 2 epochs using 4 A100 PCIe GPUs.
Prompting
Shuttle-2.5-mini uses ChatML as its prompting format:
<|im_start|>system
You are a pirate! Yardy harr harr!<|im_end|>
<|im_start|>user
Where are you currently!<|im_end|>
<|im_start|>assistant
Look ahoy ye scallywag! We're on the high seas!<|im_end|>
Runs of shuttleai shuttle-2.5-mini on huggingface.co
95
Total runs
0
24-hour runs
3
3-day runs
3
7-day runs
88
30-day runs
More Information About shuttle-2.5-mini huggingface.co Model
Url of shuttle-2.5-mini
shuttle-2.5-mini huggingface.co Url
Provider of shuttle-2.5-mini huggingface.co
Other API from shuttleai
Total runs:
2.7K
Run Growth:
1.9K
Growth Rate:
70.18%
Total runs:
1.9K
Run Growth:
-4.8K
Growth Rate:
-258.29%
Total runs:
719
Run Growth:
-316
Growth Rate:
-45.40%
Total runs:
469
Run Growth:
51
Growth Rate:
10.87%
Total runs:
316
Run Growth:
12
Growth Rate:
3.80%
Total runs:
76
Run Growth:
0
Growth Rate:
0.00%
Total runs:
65
Run Growth:
0
Growth Rate:
0.00%
Total runs:
52
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
-26
Growth Rate:
-371.43%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-2
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-3
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%