Total runs:
5.8K
Run Growth:
3.5K
Growth Rate:
59.63%
Sponsored by
APIMart
backyardai / Llama-3-Soliloquy-8B-v2-GGUF
Model's Last Updated: May 23 2024
Introduction of Llama-3-Soliloquy-8B-v2-GGUF
Model Details of Llama-3-Soliloquy-8B-v2-GGUF
The official library of GGUF format models for use in the local AI chat app, Backyard AI.
Download Backyard AI here to get started.
Request Additional models at r/LLM_Quants.
Llama 3 Soliloquy 8B v2
- Creator: openlynn
- Original: Llama 3 Soliloquy 8B v2
- Date Created: 2024-04-26
- Trained Context: 24576 tokens
- Description: A fast, highly capable roleplaying model designed for immersive, dynamic experiences. Trained on over 250 million tokens of roleplaying data, it has a vast knowledge base, rich literary expression, and support for up to 24k context length. It outperforms existing ~13B models, delivering enhanced roleplaying capabilities.
What is a GGUF?
GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware. GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.
Backyard AI
- Free, local AI chat application.
- One-click installation on Mac and PC.
- Automatically use GPU for maximum speed.
- Built-in model manager.
- High-quality character hub.
- Zero-config desktop-to-mobile tethering. Backyard AI makes it easy to start chatting with AI using your own characters or one of the many found in the built-in character hub. The model manager helps you find the latest and greatest models without worrying about whether it's the correct format. Backyard AI supports advanced features such as lorebooks, author's note, text formatting, custom context size, sampler settings, grammars, local TTS, cloud inference, and tethering, all implemented in a way that is straightforward and reliable. Join us on Discord
Runs of backyardai Llama-3-Soliloquy-8B-v2-GGUF on huggingface.co
1.5K
Total runs
-8
24-hour runs
-182
3-day runs
-571
7-day runs
493
30-day runs
More Information About Llama-3-Soliloquy-8B-v2-GGUF huggingface.co Model
Url of Llama-3-Soliloquy-8B-v2-GGUF
Llama-3-Soliloquy-8B-v2-GGUF huggingface.co Url
Provider of Llama-3-Soliloquy-8B-v2-GGUF huggingface.co
Other API from backyardai
Updated:July 24 2024
Total runs:
4.1K
Run Growth:
1.6K
Growth Rate:
39.24%
Total runs:
3.9K
Run Growth:
2.5K
Growth Rate:
66.50%
Total runs:
3.0K
Run Growth:
2.0K
Growth Rate:
65.41%
Total runs:
2.9K
Run Growth:
926
Growth Rate:
32.25%
Total runs:
2.5K
Run Growth:
1.6K
Growth Rate:
64.10%
Total runs:
2.5K
Run Growth:
2.0K
Growth Rate:
83.16%
Total runs:
2.4K
Run Growth:
2.1K
Growth Rate:
87.51%
Total runs:
2.3K
Run Growth:
1.3K
Growth Rate:
55.98%
Total runs:
2.3K
Run Growth:
2.0K
Growth Rate:
88.54%
Total runs:
2.3K
Run Growth:
2.0K
Growth Rate:
89.75%
Total runs:
2.1K
Run Growth:
1.2K
Growth Rate:
56.29%
Total runs:
2.0K
Run Growth:
1.2K
Growth Rate:
61.55%
Total runs:
2.0K
Run Growth:
29
Growth Rate:
1.46%
Total runs:
2.0K
Run Growth:
650
Growth Rate:
33.54%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
58.45%
Total runs:
1.9K
Run Growth:
975
Growth Rate:
50.28%
Total runs:
1.9K
Run Growth:
1.3K
Growth Rate:
66.60%
Total runs:
1.9K
Run Growth:
827
Growth Rate:
43.99%
Total runs:
1.8K
Run Growth:
454
Growth Rate:
25.28%
Total runs:
1.8K
Run Growth:
1.4K
Growth Rate:
76.49%
Total runs:
1.8K
Run Growth:
1.4K
Growth Rate:
76.71%
Total runs:
1.7K
Run Growth:
1.1K
Growth Rate:
61.75%
Total runs:
1.6K
Run Growth:
601
Growth Rate:
36.71%
Total runs:
1.6K
Run Growth:
1.1K
Growth Rate:
67.43%
Total runs:
1.6K
Run Growth:
116
Growth Rate:
7.23%
Total runs:
1.6K
Run Growth:
1.1K
Growth Rate:
71.55%
Total runs:
1.5K
Run Growth:
718
Growth Rate:
46.71%
Total runs:
1.5K
Run Growth:
-10
Growth Rate:
-0.68%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
74.13%
Total runs:
1.5K
Run Growth:
698
Growth Rate:
47.71%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
74.76%
Total runs:
1.4K
Run Growth:
1.0K
Growth Rate:
71.97%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
75.39%
Total runs:
1.4K
Run Growth:
82
Growth Rate:
6.12%
Total runs:
1.4K
Run Growth:
595
Growth Rate:
43.37%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
80.18%
Total runs:
1.3K
Run Growth:
742
Growth Rate:
55.09%
Total runs:
1.3K
Run Growth:
417
Growth Rate:
32.03%
Total runs:
1.3K
Run Growth:
665
Growth Rate:
52.74%
Total runs:
1.3K
Run Growth:
636
Growth Rate:
50.88%
Total runs:
1.2K
Run Growth:
313
Growth Rate:
25.66%
Total runs:
1.2K
Run Growth:
439
Growth Rate:
35.98%
Total runs:
1.2K
Run Growth:
-102
Growth Rate:
-10.05%
Total runs:
1.2K
Run Growth:
389
Growth Rate:
33.08%
Total runs:
1.2K
Run Growth:
537
Growth Rate:
46.33%
Total runs:
1.2K
Run Growth:
870
Growth Rate:
75.92%
Total runs:
1.1K
Run Growth:
474
Growth Rate:
41.47%
Total runs:
1.1K
Run Growth:
465
Growth Rate:
42.43%
Total runs:
1.1K
Run Growth:
-104
Growth Rate:
-9.67%
Total runs:
1.1K
Run Growth:
339
Growth Rate:
33.01%
Total runs:
1.0K
Run Growth:
424
Growth Rate:
41.90%
Total runs:
1.0K
Run Growth:
317
Growth Rate:
31.32%
Total runs:
1.0K
Run Growth:
89
Growth Rate:
8.80%
Total runs:
999
Run Growth:
561
Growth Rate:
56.16%
Total runs:
993
Run Growth:
129
Growth Rate:
13.00%
Total runs:
965
Run Growth:
263
Growth Rate:
27.25%
Total runs:
965
Run Growth:
333
Growth Rate:
34.37%
Total runs:
957
Run Growth:
226
Growth Rate:
23.64%
Total runs:
956
Run Growth:
203
Growth Rate:
21.28%
Total runs:
951
Run Growth:
834
Growth Rate:
86.69%
Total runs:
905
Run Growth:
59
Growth Rate:
6.61%
Total runs:
889
Run Growth:
-143
Growth Rate:
-16.29%
Total runs:
880
Run Growth:
6
Growth Rate:
0.67%
Total runs:
858
Run Growth:
-1
Growth Rate:
-0.12%
Total runs:
853
Run Growth:
145
Growth Rate:
16.88%
Total runs:
845
Run Growth:
-321
Growth Rate:
-38.12%
Total runs:
822
Run Growth:
-221
Growth Rate:
-26.40%
Total runs:
802
Run Growth:
556
Growth Rate:
69.24%
Total runs:
786
Run Growth:
287
Growth Rate:
36.19%
Total runs:
784
Run Growth:
278
Growth Rate:
35.92%
Total runs:
765
Run Growth:
347
Growth Rate:
46.21%
Total runs:
742
Run Growth:
-172
Growth Rate:
-22.93%
Total runs:
736
Run Growth:
9
Growth Rate:
1.21%
Total runs:
729
Run Growth:
217
Growth Rate:
29.64%
Total runs:
721
Run Growth:
-432
Growth Rate:
-60.17%
Total runs:
721
Run Growth:
163
Growth Rate:
22.64%
Total runs:
709
Run Growth:
417
Growth Rate:
60.00%
Total runs:
704
Run Growth:
344
Growth Rate:
48.86%
Total runs:
688
Run Growth:
-10
Growth Rate:
-1.52%
Total runs:
683
Run Growth:
272
Growth Rate:
38.75%
Total runs:
672
Run Growth:
139
Growth Rate:
20.26%
Total runs:
665
Run Growth:
-135
Growth Rate:
-20.39%
Total runs:
663
Run Growth:
-61
Growth Rate:
-9.20%
Total runs:
624
Run Growth:
-355
Growth Rate:
-57.35%
Total runs:
620
Run Growth:
35
Growth Rate:
5.52%
Total runs:
617
Run Growth:
-69
Growth Rate:
-11.11%
Total runs:
607
Run Growth:
60
Growth Rate:
9.88%
Total runs:
569
Run Growth:
365
Growth Rate:
64.60%
Total runs:
560
Run Growth:
123
Growth Rate:
21.47%
Total runs:
556
Run Growth:
180
Growth Rate:
32.37%
Total runs:
536
Run Growth:
50
Growth Rate:
9.11%
Total runs:
534
Run Growth:
108
Growth Rate:
20.22%
Total runs:
521
Run Growth:
283
Growth Rate:
54.32%
Total runs:
520
Run Growth:
0
Growth Rate:
0.00%
Total runs:
516
Run Growth:
278
Growth Rate:
52.95%
Total runs:
516
Run Growth:
-46
Growth Rate:
-8.90%
Total runs:
495
Run Growth:
17
Growth Rate:
3.39%