Total runs:
812
Run Growth:
393
Growth Rate:
48.40%
Sponsored by
APIMart
TigerResearch / tigerbot-7b-sft-v2-4bit
Model's Last Updated: July 12 2023
text-generation
Introduction of tigerbot-7b-sft-v2-4bit
Model Details of tigerbot-7b-sft-v2-4bit
🌐 TigerBot • 🤗 Hugging Face
This is a 4-bit GPTQ version of the Tigerbot 7B sft v2 .
It was quantized to 4bit using: https://github.com/TigerResearch/TigerBot/tree/main/gptq
How to download and use this model in github: https://github.com/TigerResearch/TigerBot
Here are commands to clone the TigerBot and install.
conda create --name tigerbot python=3.8
conda activate tigerbot
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
git clone https://github.com/TigerResearch/TigerBot
cd TigerBot
pip install -r requirements.txt
Inference with command line interface
cd TigerBot/gptq
CUDA_VISIBLE_DEVICES=0 python tigerbot_infer.py TigerResearch/tigerbot-7b-sft-4bit-128g --wbits 4 --groupsize 128 --load TigerResearch/tigerbot-7b-sft-4bit-128g/tigerbot-7b-4bit-128g.pt
Runs of TigerResearch tigerbot-7b-sft-v2-4bit on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-5
30-day runs
More Information About tigerbot-7b-sft-v2-4bit huggingface.co Model
Url of tigerbot-7b-sft-v2-4bit
tigerbot-7b-sft-v2-4bit huggingface.co Url
Provider of tigerbot-7b-sft-v2-4bit huggingface.co
Other API from TigerResearch
Updated:September 20 2023
Total runs:
811
Run Growth:
407
Growth Rate:
50.18%
Total runs:
803
Run Growth:
407
Growth Rate:
50.68%
Total runs:
111
Run Growth:
93
Growth Rate:
83.78%
Total runs:
39
Run Growth:
36
Growth Rate:
92.31%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
19
Run Growth:
3
Growth Rate:
15.79%
Total runs:
19
Run Growth:
19
Growth Rate:
100.00%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
16
Run Growth:
2
Growth Rate:
12.50%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
13
Run Growth:
1
Growth Rate:
7.69%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-43
Growth Rate:
-2150.00%
Total runs:
2
Run Growth:
-20
Growth Rate:
-1000.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-6
Growth Rate:
-600.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%