backyardai / Gemmasutra-Mini-2B-v1-GGUF

huggingface.co
Total runs: 1.1K
24-hour runs: -111
7-day runs: -295
30-day runs: 228
Model's Last Updated: August 06 2024

Introduction of Gemmasutra-Mini-2B-v1-GGUF

Model Details of Gemmasutra-Mini-2B-v1-GGUF

Backyard.ai

The official library of GGUF format models for use in the local AI chat app, Backyard AI.

Download Backyard AI here to get started.

Request Additional models at r/LLM_Quants.


Gemmasutra Mini V1 2B

  • Creator: TheDrummer
  • Original: Gemmasutra Mini V1 2B
  • Date Created: 2024-08-03
  • Trained Context: 8192 tokens
  • Description: Fast, and surprisingly strong for being so small. Uses only 4.5GB of VRAM at the highest quantization size, and much less for lower sizes. A good choice for machines without a GPU or for blazing fast but simpler chats.

What is a GGUF?

GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware. GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.


Backyard.ai
Backyard AI
  • Free, local AI chat application.
  • One-click installation on Mac and PC.
  • Automatically use GPU for maximum speed.
  • Built-in model manager.
  • High-quality character hub.
  • Zero-config desktop-to-mobile tethering. Backyard AI makes it easy to start chatting with AI using your own characters or one of the many found in the built-in character hub. The model manager helps you find the latest and greatest models without worrying about whether it's the correct format. Backyard AI supports advanced features such as lorebooks, author's note, text formatting, custom context size, sampler settings, grammars, local TTS, cloud inference, and tethering, all implemented in a way that is straightforward and reliable. Join us on Discord

Runs of backyardai Gemmasutra-Mini-2B-v1-GGUF on huggingface.co

1.1K
Total runs
-111
24-hour runs
-232
3-day runs
-295
7-day runs
228
30-day runs

More Information About Gemmasutra-Mini-2B-v1-GGUF huggingface.co Model

More Gemmasutra-Mini-2B-v1-GGUF license Visit here:

https://choosealicense.com/licenses/other

Gemmasutra-Mini-2B-v1-GGUF huggingface.co

Gemmasutra-Mini-2B-v1-GGUF huggingface.co is an AI model on huggingface.co that provides Gemmasutra-Mini-2B-v1-GGUF's model effect (), which can be used instantly with this backyardai Gemmasutra-Mini-2B-v1-GGUF model. huggingface.co supports a free trial of the Gemmasutra-Mini-2B-v1-GGUF model, and also provides paid use of the Gemmasutra-Mini-2B-v1-GGUF. Support call Gemmasutra-Mini-2B-v1-GGUF model through api, including Node.js, Python, http.

Gemmasutra-Mini-2B-v1-GGUF huggingface.co Url

https://huggingface.co/backyardai/Gemmasutra-Mini-2B-v1-GGUF

backyardai Gemmasutra-Mini-2B-v1-GGUF online free

Gemmasutra-Mini-2B-v1-GGUF huggingface.co is an online trial and call api platform, which integrates Gemmasutra-Mini-2B-v1-GGUF's modeling effects, including api services, and provides a free online trial of Gemmasutra-Mini-2B-v1-GGUF, you can try Gemmasutra-Mini-2B-v1-GGUF online for free by clicking the link below.

backyardai Gemmasutra-Mini-2B-v1-GGUF online free url in huggingface.co:

https://huggingface.co/backyardai/Gemmasutra-Mini-2B-v1-GGUF

Gemmasutra-Mini-2B-v1-GGUF install

Gemmasutra-Mini-2B-v1-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Gemmasutra-Mini-2B-v1-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Gemmasutra-Mini-2B-v1-GGUF install, users can directly use Gemmasutra-Mini-2B-v1-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Gemmasutra-Mini-2B-v1-GGUF install url in huggingface.co:

https://huggingface.co/backyardai/Gemmasutra-Mini-2B-v1-GGUF

Url of Gemmasutra-Mini-2B-v1-GGUF

Gemmasutra-Mini-2B-v1-GGUF huggingface.co Url

Provider of Gemmasutra-Mini-2B-v1-GGUF huggingface.co

backyardai
ORGANIZATIONS

Other API from backyardai