Total runs:
58.5M
Run Growth:
-6.0M
Growth Rate:
-10.28%
Sponsored by
Vmake Labs Video Enhancer
BAAI / AquilaChat2-7B-16K
Model's Last Updated: July 13 2026
text-generation
Introduction of AquilaChat2-7B-16K
Model Details of AquilaChat2-7B-16K
English | 简体中文
We opensource our Aquila2 series, now including Aquila2 , the base language models, namely Aquila2-7B and Aquila2-34B , as well as AquilaChat2 , the chat models, namely AquilaChat2-7B and AquilaChat2-34B , as well as the long-text chat models, namely AquilaChat2-7B-16k and AquilaChat2-34B-16k
The additional details of the Aquila model will be presented in the official technical report. Please stay tuned for updates on official channels.
Quick Start AquilaChat2-7B-16K（Chat model）
1. Inference
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from transformers import BitsAndBytesConfig
device = torch.device("cuda:0")
model_info = "BAAI/AquilaChat2-7B-16K"
tokenizer = AutoTokenizer.from_pretrained(model_info, trust_remote_code=True)
quantization_config=BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16,
)
model = AutoModelForCausalLM.from_pretrained(model_info, trust_remote_code=True, torch_dtype=torch.float16,
# quantization_config=quantization_config, # Uncomment this line for 4bit quantization
)
model.eval()
model.to(device)
text = "请给出10个要到北京旅游的理由。"
from predict import predict
out = predict(model, text, tokenizer=tokenizer, max_gen_len=200, top_p=0.95,
seed=1234, topk=100, temperature=0.9, sft=True, device=device,
model_name="AquilaChat2-7B-16K")
print(out)
License
Aquila2 series open-source model is licensed under BAAI Aquila Model Licence Agreement
Runs of BAAI AquilaChat2-7B-16K on huggingface.co
249
Total runs
2
24-hour runs
-7
3-day runs
0
7-day runs
79
30-day runs
More Information About AquilaChat2-7B-16K huggingface.co Model
Url of AquilaChat2-7B-16K
AquilaChat2-7B-16K huggingface.co Url
Provider of AquilaChat2-7B-16K huggingface.co
Other API from BAAI
Updated:February 22 2024
Total runs:
15.7M
Run Growth:
-2.1M
Growth Rate:
-13.39%
Total runs:
10.1M
Run Growth:
-1.8M
Growth Rate:
-17.69%
Total runs:
9.0M
Run Growth:
-1.5M
Growth Rate:
-16.50%
Total runs:
3.9M
Run Growth:
-1.3M
Growth Rate:
-32.64%
Total runs:
3.5M
Run Growth:
-486.3K
Growth Rate:
-13.85%
Total runs:
2.1M
Run Growth:
-685.4K
Growth Rate:
-32.34%
Total runs:
401.4K
Run Growth:
-404.7K
Growth Rate:
-100.82%
Total runs:
345.7K
Run Growth:
-792.7K
Growth Rate:
-229.31%
Total runs:
193.7K
Run Growth:
-28.3K
Growth Rate:
-14.61%
Total runs:
172.2K
Run Growth:
-100.7K
Growth Rate:
-58.48%
Total runs:
149.5K
Run Growth:
-15.1K
Growth Rate:
-10.07%
Total runs:
39.4K
Run Growth:
-26.5K
Growth Rate:
-67.26%
Total runs:
17.2K
Run Growth:
-185.6K
Growth Rate:
-1080.31%
Total runs:
16.5K
Run Growth:
-318
Growth Rate:
-1.93%
Total runs:
8.8K
Run Growth:
98
Growth Rate:
1.12%
Total runs:
8.7K
Run Growth:
-3
Growth Rate:
-0.03%
Total runs:
3.0K
Run Growth:
-900
Growth Rate:
-30.16%
Total runs:
2.0K
Run Growth:
-797
Growth Rate:
-38.97%
Total runs:
1.4K
Run Growth:
-2.2K
Growth Rate:
-152.77%
Total runs:
1.3K
Run Growth:
386
Growth Rate:
30.83%
Total runs:
1.2K
Run Growth:
10.3K
Growth Rate:
100.00%
Total runs:
740
Run Growth:
-2.5K
Growth Rate:
-367.78%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
602
Run Growth:
-66
Growth Rate:
-10.59%
Total runs:
521
Run Growth:
-690
Growth Rate:
-130.43%
Total runs:
428
Run Growth:
-118
Growth Rate:
-28.03%
Total runs:
242
Run Growth:
43
Growth Rate:
17.77%
Total runs:
203
Run Growth:
50
Growth Rate:
24.63%
Total runs:
200
Run Growth:
42
Growth Rate:
21.00%
Total runs:
199
Run Growth:
22
Growth Rate:
11.06%
Total runs:
190
Run Growth:
-3
Growth Rate:
-1.58%