turboderp / Mistral-7B-instruct-exl2

huggingface.co
Total runs: 7
24-hour runs: 0
7-day runs: 2
30-day runs: -8
Model's Last Updated: December 29 2023

Introduction of Mistral-7B-instruct-exl2

Model Details of Mistral-7B-instruct-exl2

EXL2 quants of Mistral-7B-instruct

Converted from Mistral-7B-Instruct-v0.1 . This is a straight conversion, but I have modified the config.json to make the default context size 7168 tokens, since in initial testing the model becomes unstable a while after that. It's possible that sliding window attention will allow the model to use its advertised 32k-token context, but this hasn't been tested yet.

2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json

Runs of turboderp Mistral-7B-instruct-exl2 on huggingface.co

7
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
-8
30-day runs

More Information About Mistral-7B-instruct-exl2 huggingface.co Model

Mistral-7B-instruct-exl2 huggingface.co

Mistral-7B-instruct-exl2 huggingface.co is an AI model on huggingface.co that provides Mistral-7B-instruct-exl2's model effect (), which can be used instantly with this turboderp Mistral-7B-instruct-exl2 model. huggingface.co supports a free trial of the Mistral-7B-instruct-exl2 model, and also provides paid use of the Mistral-7B-instruct-exl2. Support call Mistral-7B-instruct-exl2 model through api, including Node.js, Python, http.

Mistral-7B-instruct-exl2 huggingface.co Url

https://huggingface.co/turboderp/Mistral-7B-instruct-exl2

turboderp Mistral-7B-instruct-exl2 online free

Mistral-7B-instruct-exl2 huggingface.co is an online trial and call api platform, which integrates Mistral-7B-instruct-exl2's modeling effects, including api services, and provides a free online trial of Mistral-7B-instruct-exl2, you can try Mistral-7B-instruct-exl2 online for free by clicking the link below.

turboderp Mistral-7B-instruct-exl2 online free url in huggingface.co:

https://huggingface.co/turboderp/Mistral-7B-instruct-exl2

Mistral-7B-instruct-exl2 install

Mistral-7B-instruct-exl2 is an open source model from GitHub that offers a free installation service, and any user can find Mistral-7B-instruct-exl2 on GitHub to install. At the same time, huggingface.co provides the effect of Mistral-7B-instruct-exl2 install, users can directly use Mistral-7B-instruct-exl2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Mistral-7B-instruct-exl2 install url in huggingface.co:

https://huggingface.co/turboderp/Mistral-7B-instruct-exl2

Url of Mistral-7B-instruct-exl2

Mistral-7B-instruct-exl2 huggingface.co Url

Provider of Mistral-7B-instruct-exl2 huggingface.co

turboderp
ORGANIZATIONS

Other API from turboderp

huggingface.co

Total runs: 18
Run Growth: 16
Growth Rate: 88.89%
Updated:July 19 2026