Total runs:
812
Run Growth:
393
Growth Rate:
48.40%
Sponsored by
iMean AI Trip Planner
TigerResearch / tigerbot-7b-chat-4bit
Model's Last Updated: August 31 2023
text-generation
Introduction of tigerbot-7b-chat-4bit
Model Details of tigerbot-7b-chat-4bit
🌐 TigerBot • 🤗 Hugging Face
This is a 4-bit GPTQ version of the Tigerbot 7b chat .
It was quantized to 4bit using: https://github.com/PanQiWei/AutoGPTQ
How to download and use this model in github: https://github.com/TigerResearch/TigerBot
Here are commands to clone the TigerBot and install.
conda create --name tigerbot python=3.8
conda activate tigerbot
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
git clone https://github.com/TigerResearch/TigerBot
cd TigerBot
pip install -r requirements.txt
Inference with command line interface
infer with auto-gptq
# 安装auto-gptq
pip install auto-gptq
# 启动推理
CUDA_VISIBLE_DEVICES=0 python other_infer/gptq_infer.py --model_path TigerResearch/tigerbot-7b-chat-4bit
infer with exllama
# 安装exllama_lib
pip install exllama_lib@git+https://github.com/taprosoft/exllama.git
# 启动推理
CUDA_VISIBLE_DEVICES=0 python other_infer/exllama_infer.py --model_path TigerResearch/tigerbot-7b-chat-4bit
Runs of TigerResearch tigerbot-7b-chat-4bit on huggingface.co
1
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
1
30-day runs
More Information About tigerbot-7b-chat-4bit huggingface.co Model
Url of tigerbot-7b-chat-4bit
tigerbot-7b-chat-4bit huggingface.co Url
Provider of tigerbot-7b-chat-4bit huggingface.co
Other API from TigerResearch
Updated:September 20 2023
Total runs:
811
Run Growth:
407
Growth Rate:
50.18%
Total runs:
803
Run Growth:
407
Growth Rate:
50.68%
Total runs:
111
Run Growth:
93
Growth Rate:
83.78%
Total runs:
39
Run Growth:
36
Growth Rate:
92.31%
Total runs:
19
Run Growth:
19
Growth Rate:
100.00%
Total runs:
16
Run Growth:
2
Growth Rate:
12.50%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
13
Run Growth:
4
Growth Rate:
30.77%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
10
Run Growth:
1
Growth Rate:
8.33%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-43
Growth Rate:
-2150.00%
Total runs:
2
Run Growth:
-20
Growth Rate:
-1000.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-6
Growth Rate:
-600.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-5
Growth Rate:
0.00%