Kooten / Nethena-20B-4bpw-h8-exl2

huggingface.co
Total runs: 10
24-hour runs: 0
7-day runs: 0
30-day runs: -1
Model's Last Updated: October 31 2023
text-generation

Introduction of Nethena-20B-4bpw-h8-exl2

Model Details of Nethena-20B-4bpw-h8-exl2

Description

Exllama 2 quant of NeverSleep/Nethena-20B

4 BPW, Head bit set to 8

Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
VRAM

My VRAM usage with 20B models are:

Bits per weight Context VRAM
6bpw 4k 24gb
4bpw 4k 18gb
4bpw 8k 24gb
3bpw 4k 16gb
3bpw 8k 21gb
I have rounded up, these arent exact numbers, this is also on a windows machine.

Runs of Kooten Nethena-20B-4bpw-h8-exl2 on huggingface.co

10
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-1
30-day runs

More Information About Nethena-20B-4bpw-h8-exl2 huggingface.co Model

More Nethena-20B-4bpw-h8-exl2 license Visit here:

https://choosealicense.com/licenses/cc-by-nc-4.0

Nethena-20B-4bpw-h8-exl2 huggingface.co

Nethena-20B-4bpw-h8-exl2 huggingface.co is an AI model on huggingface.co that provides Nethena-20B-4bpw-h8-exl2's model effect (), which can be used instantly with this Kooten Nethena-20B-4bpw-h8-exl2 model. huggingface.co supports a free trial of the Nethena-20B-4bpw-h8-exl2 model, and also provides paid use of the Nethena-20B-4bpw-h8-exl2. Support call Nethena-20B-4bpw-h8-exl2 model through api, including Node.js, Python, http.

Nethena-20B-4bpw-h8-exl2 huggingface.co Url

https://huggingface.co/Kooten/Nethena-20B-4bpw-h8-exl2

Kooten Nethena-20B-4bpw-h8-exl2 online free

Nethena-20B-4bpw-h8-exl2 huggingface.co is an online trial and call api platform, which integrates Nethena-20B-4bpw-h8-exl2's modeling effects, including api services, and provides a free online trial of Nethena-20B-4bpw-h8-exl2, you can try Nethena-20B-4bpw-h8-exl2 online for free by clicking the link below.

Kooten Nethena-20B-4bpw-h8-exl2 online free url in huggingface.co:

https://huggingface.co/Kooten/Nethena-20B-4bpw-h8-exl2

Nethena-20B-4bpw-h8-exl2 install

Nethena-20B-4bpw-h8-exl2 is an open source model from GitHub that offers a free installation service, and any user can find Nethena-20B-4bpw-h8-exl2 on GitHub to install. At the same time, huggingface.co provides the effect of Nethena-20B-4bpw-h8-exl2 install, users can directly use Nethena-20B-4bpw-h8-exl2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Nethena-20B-4bpw-h8-exl2 install url in huggingface.co:

https://huggingface.co/Kooten/Nethena-20B-4bpw-h8-exl2

Url of Nethena-20B-4bpw-h8-exl2

Nethena-20B-4bpw-h8-exl2 huggingface.co Url

Provider of Nethena-20B-4bpw-h8-exl2 huggingface.co

Kooten
ORGANIZATIONS

Other API from Kooten

huggingface.co

Total runs: 63
Run Growth: -73
Growth Rate: -115.87%
Updated:January 19 2024