Total runs:
372.0K
Run Growth:
-158.2K
Growth Rate:
-42.77%
Sponsored by
YouArt
NousResearch / Nous-Puffin-70B
Model's Last Updated: September 25 2023
text-generation
Introduction of Nous-Puffin-70B
Model Details of Nous-Puffin-70B
Redmond-Puffin-70B
Based off Puffin 13B which was the first commercially available language model released by Nous Research!
Compute provided by PygmalionAI, thank you! Follow PygmalionAI on Twitter @pygmalion_ai.
This is a larger version of Puffin which was originally the worlds first third-party llama-2 fine-tune. leveraging a hand curated set of 3K high quality examples, many of which take full advantage of the 4096 context length of Llama 2. This model was fine-tuned by Nous Research, with LDJ leading the training and dataset curation, along with significant dataset formation contributions by J-Supha.
Special thank you to Pygmalion AI for sponsoring the compute.
Special thank you to Emozilla for assisting with training experimentations and benchmarking.
Model Training
Redmond-Puffin 70B is a new model trained for multiple epochs on a dataset of 3,000 carefully curated GPT-4 examples, most of which are long context conversations between a real human and GPT-4.
Additional data came from carefully curated sub sections of datasets such as CamelAI's Physics, Chemistry, Biology and Math.
Prompt Format
The reccomended model usage is:
WARNING, THE PREVIOUS RECCOMENDATION THAT SAID TO USE "### human" and "# response" WAS A CRITICAL ERROR, PLEASE USE THE ACCURATE PREFIX AND SUFFIX BELOW.
USER:
ASSISTANT:
When should I use Puffin or Hermes 2?
Although full benchmarks have not completed for Puffin, Original Puffin 13B and Hermes-2 13B both beat previous SOTA for GPT4ALL benchmarks, with Hermes-2 winning by a 0.1% margin over Puffin.
Overall, for general purpose zero-shot and/or single turn instructions, Hermes will likely be the way to go. Puffin may be prefferred for creative long conversation interactions, like having Puffin play a character or help brain storm creative ideas or concepts that make contextual sense within an already deep conversation.
Thank you to the comprehensive analysis and comparison of Puffin and Hermes by reddit user WolframRavenwolf here: https://www.reddit.com/r/LocalLLaMA/comments/158j9r9/nous_hermes_llama2_vs_redmond_puffin_13b/
Example Outputs!:
Notable Features:
-
The first Llama-2 based fine-tuned model released by Nous Research.
-
Ability to recall information upto 2023 without internet (ChatGPT cut off date is in 2021)
-
Pretrained on 2 trillion tokens of text. (This is double the amount of most Open LLM's)
-
Pretrained with a context length of 4096 tokens, and fine-tuned on a significant amount of multi-turn conversations reaching that full token limit.
-
The first commercially available language model released by Nous Research.
Future Plans
This is a relatively early build amongst the grand plans for the future of Puffin!
Current limitations: Some token mismatch problems have been identified, these may effect the current output quality, we plan to have this solved in Puffin V2 along with other improvements.
How you can help!
In the near future we plan on leveraging the help of domain specific expert volunteers to eliminate any mathematically/verifiably incorrect answers from our training curations.
If you have at-least a bachelors in mathematics, physics, biology or chemistry and would like to volunteer even just 30 minutes of your expertise time, please contact LDJ on discord!
Benchmarks (New benchmarks coming soon, however here are the 13B benchmarks for now)!
As of Puffins release, it achieves a new SOTA for the GPT4All benchmarks! Supplanting Hermes for the #1 position! (Rounded to nearest tenth)
Previous Sota: Hermes - 68.8 New Sota: Puffin - 69.9 (+1.1)
Puffin 13B supplants Hermes-2 for the #1 spot in Arc-E, HellaSwag and Winogrande!
Puffin also perfectly ties with Hermes in PIQA, however Hermes-2 still excels in much of Big Bench and AGIEval, so it's highly reccomended you give it a try as well!
Runs of NousResearch Nous-Puffin-70B on huggingface.co
923
Total runs
0
24-hour runs
-10
3-day runs
-22
7-day runs
121
30-day runs
More Information About Nous-Puffin-70B huggingface.co Model
Url of Nous-Puffin-70B
Nous-Puffin-70B huggingface.co Url
Provider of Nous-Puffin-70B huggingface.co
Other API from NousResearch
Updated:September 08 2024
Total runs:
227.4K
Run Growth:
20.5K
Growth Rate:
9.02%
Total runs:
157.9K
Run Growth:
67.6K
Growth Rate:
42.80%
Total runs:
134.2K
Run Growth:
98.1K
Growth Rate:
73.10%
Total runs:
49.1K
Run Growth:
6.6K
Growth Rate:
13.52%
Total runs:
44.7K
Run Growth:
1.3K
Growth Rate:
2.97%
Total runs:
40.6K
Run Growth:
16.2K
Growth Rate:
39.97%
Total runs:
30.3K
Run Growth:
-1.6K
Growth Rate:
-5.27%
Total runs:
25.9K
Run Growth:
14.8K
Growth Rate:
54.48%
Total runs:
16.0K
Run Growth:
1.6K
Growth Rate:
9.76%
Total runs:
15.9K
Run Growth:
8.1K
Growth Rate:
70.94%
Total runs:
13.9K
Run Growth:
-20.4K
Growth Rate:
-147.68%
Total runs:
10.7K
Run Growth:
1.7K
Growth Rate:
16.23%
Total runs:
10.6K
Run Growth:
-1.1K
Growth Rate:
-10.00%
Total runs:
9.7K
Run Growth:
-117
Growth Rate:
-1.22%
Total runs:
9.0K
Run Growth:
351
Growth Rate:
3.94%
Total runs:
7.3K
Run Growth:
5.1K
Growth Rate:
67.03%
Total runs:
7.0K
Run Growth:
3.4K
Growth Rate:
48.20%
Total runs:
6.5K
Run Growth:
-4.2K
Growth Rate:
-64.55%
Total runs:
6.0K
Run Growth:
1.5K
Growth Rate:
25.24%
Total runs:
5.1K
Run Growth:
1.3K
Growth Rate:
25.51%
Total runs:
5.1K
Run Growth:
-2.6K
Growth Rate:
-51.69%
Total runs:
4.6K
Run Growth:
354
Growth Rate:
7.69%
Total runs:
4.2K
Run Growth:
3.0K
Growth Rate:
69.83%
Total runs:
3.7K
Run Growth:
2.1K
Growth Rate:
55.92%
Total runs:
3.6K
Run Growth:
1.0K
Growth Rate:
28.85%
Total runs:
3.6K
Run Growth:
-1.4K
Growth Rate:
-39.89%
Total runs:
3.4K
Run Growth:
-3.4K
Growth Rate:
-99.56%
Total runs:
3.2K
Run Growth:
-14.8K
Growth Rate:
-461.57%
Total runs:
3.0K
Run Growth:
-5.4K
Growth Rate:
-178.37%
Total runs:
3.0K
Run Growth:
-595
Growth Rate:
-19.73%
Total runs:
2.9K
Run Growth:
-521
Growth Rate:
-18.71%
Total runs:
2.8K
Run Growth:
1.1K
Growth Rate:
39.54%
Total runs:
2.7K
Run Growth:
-2.7K
Growth Rate:
-101.29%
Total runs:
2.5K
Run Growth:
903
Growth Rate:
36.38%
Total runs:
2.3K
Run Growth:
1.3K
Growth Rate:
56.85%
Total runs:
2.2K
Run Growth:
-611
Growth Rate:
-28.23%
Total runs:
2.2K
Run Growth:
922
Growth Rate:
42.57%
Total runs:
2.1K
Run Growth:
-1.5K
Growth Rate:
-72.53%
Total runs:
2.0K
Run Growth:
467
Growth Rate:
23.80%
Total runs:
1.8K
Run Growth:
102
Growth Rate:
5.72%
Total runs:
1.8K
Run Growth:
446
Growth Rate:
25.33%
Total runs:
1.7K
Run Growth:
176
Growth Rate:
10.54%
Total runs:
1.6K
Run Growth:
-915
Growth Rate:
-56.52%
Total runs:
1.5K
Run Growth:
-1.7K
Growth Rate:
-110.09%
Total runs:
1.5K
Run Growth:
579
Growth Rate:
37.92%
Total runs:
1.5K
Run Growth:
777
Growth Rate:
50.78%
Total runs:
1.3K
Run Growth:
577
Growth Rate:
42.77%
Total runs:
1.2K
Run Growth:
537
Growth Rate:
45.74%
Total runs:
1.2K
Run Growth:
237
Growth Rate:
20.86%
Total runs:
1.1K
Run Growth:
-603
Growth Rate:
-54.37%
Total runs:
1.1K
Run Growth:
-207
Growth Rate:
-19.55%
Total runs:
872
Run Growth:
-2
Growth Rate:
-0.23%
Total runs:
847
Run Growth:
180
Growth Rate:
21.25%
Total runs:
803
Run Growth:
126
Growth Rate:
15.69%
Total runs:
737
Run Growth:
-747
Growth Rate:
-105.96%
Total runs:
722
Run Growth:
0
Growth Rate:
0.00%
Total runs:
559
Run Growth:
255
Growth Rate:
46.70%
Total runs:
462
Run Growth:
-634
Growth Rate:
-137.23%
Total runs:
436
Run Growth:
31
Growth Rate:
7.11%
Total runs:
419
Run Growth:
100
Growth Rate:
23.87%
Total runs:
410
Run Growth:
-234
Growth Rate:
-57.07%
Total runs:
381
Run Growth:
117
Growth Rate:
31.28%
Total runs:
372
Run Growth:
30
Growth Rate:
8.31%
Total runs:
361
Run Growth:
-6.4K
Growth Rate:
-1724.93%
Total runs:
343
Run Growth:
51
Growth Rate:
14.87%
Total runs:
338
Run Growth:
82
Growth Rate:
24.26%
Total runs:
334
Run Growth:
120
Growth Rate:
35.93%
Total runs:
312
Run Growth:
143
Growth Rate:
45.83%
Total runs:
309
Run Growth:
287
Growth Rate:
92.88%
Total runs:
307
Run Growth:
-25
Growth Rate:
-8.14%
Total runs:
307
Run Growth:
60
Growth Rate:
19.54%
Total runs:
303
Run Growth:
103
Growth Rate:
33.99%
Total runs:
287
Run Growth:
52
Growth Rate:
18.12%
Total runs:
278
Run Growth:
-86
Growth Rate:
-30.94%
Total runs:
241
Run Growth:
78
Growth Rate:
33.77%
Total runs:
227
Run Growth:
61
Growth Rate:
27.35%
Total runs:
223
Run Growth:
-42
Growth Rate:
-18.83%
Total runs:
196
Run Growth:
-155
Growth Rate:
-81.58%
Total runs:
194
Run Growth:
-9
Growth Rate:
-4.74%
Total runs:
192
Run Growth:
57
Growth Rate:
29.84%
Total runs:
161
Run Growth:
66
Growth Rate:
40.99%
Total runs:
160
Run Growth:
29
Growth Rate:
18.13%
Total runs:
159
Run Growth:
-27
Growth Rate:
-17.31%
Total runs:
151
Run Growth:
20
Growth Rate:
13.07%
Total runs:
151
Run Growth:
-7
Growth Rate:
-4.64%
Total runs:
151
Run Growth:
26
Growth Rate:
17.22%
Total runs:
141
Run Growth:
29
Growth Rate:
20.57%
Total runs:
136
Run Growth:
23
Growth Rate:
16.91%
Total runs:
135
Run Growth:
42
Growth Rate:
31.58%
Total runs:
131
Run Growth:
35
Growth Rate:
26.72%
Total runs:
126
Run Growth:
42
Growth Rate:
33.07%
Total runs:
122
Run Growth:
29
Growth Rate:
23.39%
Total runs:
111
Run Growth:
-58
Growth Rate:
-52.25%
Total runs:
110
Run Growth:
2
Growth Rate:
1.82%
Total runs:
93
Run Growth:
13
Growth Rate:
13.83%
Total runs:
91
Run Growth:
4
Growth Rate:
4.35%