Kooten / DaringLotus-6bpw-exl2

huggingface.co
Total runs: 17
24-hour runs: 0
7-day runs: 2
30-day runs: 7
Model's Last Updated: January 17 2024
text-generation

Introduction of DaringLotus-6bpw-exl2

Model Details of DaringLotus-6bpw-exl2

DaringLotus-10.7B 6bpw EXL2

Description

EXL2 quant of BlueNipples/DaringLotus-10.7B

  • 6bpw should be comfortable on 12 gb with 8k context
  • 4bpw might just fit on 8gb of vram at 4k context
  • if you have more ram get the 8bpw
Other quants:

EXL2: 8bpw , 6bpw , 5bpw , 4bpw

Prompt Format
Alpaca:

I am not entirely certain of this but i think alpaca is correct for this model

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Input:
{input}

### Response:
Contact

Kooten on discord

Runs of Kooten DaringLotus-6bpw-exl2 on huggingface.co

17
Total runs
0
24-hour runs
-1
3-day runs
2
7-day runs
7
30-day runs

More Information About DaringLotus-6bpw-exl2 huggingface.co Model

More DaringLotus-6bpw-exl2 license Visit here:

https://choosealicense.com/licenses/apache-2.0

DaringLotus-6bpw-exl2 huggingface.co

DaringLotus-6bpw-exl2 huggingface.co is an AI model on huggingface.co that provides DaringLotus-6bpw-exl2's model effect (), which can be used instantly with this Kooten DaringLotus-6bpw-exl2 model. huggingface.co supports a free trial of the DaringLotus-6bpw-exl2 model, and also provides paid use of the DaringLotus-6bpw-exl2. Support call DaringLotus-6bpw-exl2 model through api, including Node.js, Python, http.

DaringLotus-6bpw-exl2 huggingface.co Url

https://huggingface.co/Kooten/DaringLotus-6bpw-exl2

Kooten DaringLotus-6bpw-exl2 online free

DaringLotus-6bpw-exl2 huggingface.co is an online trial and call api platform, which integrates DaringLotus-6bpw-exl2's modeling effects, including api services, and provides a free online trial of DaringLotus-6bpw-exl2, you can try DaringLotus-6bpw-exl2 online for free by clicking the link below.

Kooten DaringLotus-6bpw-exl2 online free url in huggingface.co:

https://huggingface.co/Kooten/DaringLotus-6bpw-exl2

DaringLotus-6bpw-exl2 install

DaringLotus-6bpw-exl2 is an open source model from GitHub that offers a free installation service, and any user can find DaringLotus-6bpw-exl2 on GitHub to install. At the same time, huggingface.co provides the effect of DaringLotus-6bpw-exl2 install, users can directly use DaringLotus-6bpw-exl2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

DaringLotus-6bpw-exl2 install url in huggingface.co:

https://huggingface.co/Kooten/DaringLotus-6bpw-exl2

Url of DaringLotus-6bpw-exl2

DaringLotus-6bpw-exl2 huggingface.co Url

Provider of DaringLotus-6bpw-exl2 huggingface.co

Kooten
ORGANIZATIONS

Other API from Kooten