This is a bare model without any output layer or classification head. It has been quantized to be used for feature extraction tasks.
Usage
This model is intended to be used as a base for training on downstream tasks. In order to use it for predictions and inference, it should be fine-tuned on a specific task with an appropriate output layer or classification head added.
Quantization
The model has been quantized using the following parameters:
Lora alpha: 16
Lora rank: 32
Lora target modules: all-linear
bits: 4
LoftQ iterations: 5
Runs of smallsuper Mistral-7B-v0.1-4bit-32rank on huggingface.co
1
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About Mistral-7B-v0.1-4bit-32rank huggingface.co Model
Mistral-7B-v0.1-4bit-32rank huggingface.co
Mistral-7B-v0.1-4bit-32rank huggingface.co is an AI model on huggingface.co that provides Mistral-7B-v0.1-4bit-32rank's model effect (), which can be used instantly with this smallsuper Mistral-7B-v0.1-4bit-32rank model. huggingface.co supports a free trial of the Mistral-7B-v0.1-4bit-32rank model, and also provides paid use of the Mistral-7B-v0.1-4bit-32rank. Support call Mistral-7B-v0.1-4bit-32rank model through api, including Node.js, Python, http.
Mistral-7B-v0.1-4bit-32rank huggingface.co is an online trial and call api platform, which integrates Mistral-7B-v0.1-4bit-32rank's modeling effects, including api services, and provides a free online trial of Mistral-7B-v0.1-4bit-32rank, you can try Mistral-7B-v0.1-4bit-32rank online for free by clicking the link below.
smallsuper Mistral-7B-v0.1-4bit-32rank online free url in huggingface.co:
Mistral-7B-v0.1-4bit-32rank is an open source model from GitHub that offers a free installation service, and any user can find Mistral-7B-v0.1-4bit-32rank on GitHub to install. At the same time, huggingface.co provides the effect of Mistral-7B-v0.1-4bit-32rank install, users can directly use Mistral-7B-v0.1-4bit-32rank installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Mistral-7B-v0.1-4bit-32rank install url in huggingface.co: