Total runs:
812
Run Growth:
393
Growth Rate:
48.40%
Sponsored by
APIMaster
TigerResearch / tigerbot-70b-chat-v6-4bit-exl2
Model's Last Updated: April 15 2024
text-generation
Introduction of tigerbot-70b-chat-v6-4bit-exl2
Model Details of tigerbot-70b-chat-v6-4bit-exl2
🌐 TigerBot • 🤗 Hugging Face
This is a 4-bit EXL2 version of the tigerbot-70b-chat-v6 .
It was quantized to 4bit using: https://github.com/turboderp/exllamav2
How to download and use this model in github: https://github.com/TigerResearch/TigerBot
Here are commands to clone the TigerBot and install.
conda create --name tigerbot python=3.8
conda activate tigerbot
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
git clone https://github.com/TigerResearch/TigerBot
cd TigerBot
pip install -r requirements.txt
Inference with command line interface
infer with exllamav2
# install exllamav2
git clone https://github.com/turboderp/exllamav2
cd exllamav2
pip install -r requirements.txt
# infer command
CUDA_VISIBLE_DEVICES=0 python other_infer/exllamav2_hf_infer.py --model_path TigerResearch/tigerbot-70b-chat-v6-4bit-exl2
Runs of TigerResearch tigerbot-70b-chat-v6-4bit-exl2 on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
1
30-day runs
More Information About tigerbot-70b-chat-v6-4bit-exl2 huggingface.co Model
Url of tigerbot-70b-chat-v6-4bit-exl2
tigerbot-70b-chat-v6-4bit-exl2 huggingface.co Url
Provider of tigerbot-70b-chat-v6-4bit-exl2 huggingface.co
Other API from TigerResearch
Updated:September 20 2023
Total runs:
811
Run Growth:
407
Growth Rate:
50.18%
Total runs:
803
Run Growth:
407
Growth Rate:
50.68%
Total runs:
111
Run Growth:
93
Growth Rate:
83.78%
Total runs:
39
Run Growth:
36
Growth Rate:
92.31%
Total runs:
19
Run Growth:
19
Growth Rate:
100.00%
Total runs:
18
Run Growth:
-1
Growth Rate:
-5.56%
Total runs:
16
Run Growth:
10
Growth Rate:
58.82%
Total runs:
16
Run Growth:
10
Growth Rate:
55.56%
Total runs:
15
Run Growth:
3
Growth Rate:
20.00%
Total runs:
14
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
13
Run Growth:
4
Growth Rate:
28.57%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-43
Growth Rate:
-2150.00%
Total runs:
2
Run Growth:
-20
Growth Rate:
-1000.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-6
Growth Rate:
-600.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-5
Growth Rate:
0.00%