Total runs:
812
Run Growth:
393
Growth Rate:
48.40%
Sponsored by
APIMaster
TigerResearch / tigerbot-7b-sft-v2
Model's Last Updated: July 11 2023
text-generation
Introduction of tigerbot-7b-sft-v2
Model Details of tigerbot-7b-sft-v2
🌐 TigerBot • 🤗 Hugging Face
Github
https://github.com/TigerResearch/TigerBot
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
from accelerate import infer_auto_device_map, dispatch_model
from accelerate.utils import get_balanced_memory
tokenizer = AutoTokenizer.from_pretrained("TigerResearch/tigerbot-7b-sft-v2")
model = AutoModelForCausalLM.from_pretrained("TigerResearch/tigerbot-7b-sft-v2")
max_memory = get_balanced_memory(model)
device_map = infer_auto_device_map(model, max_memory=max_memory, no_split_module_classes=["BloomBlock"])
model = dispatch_model(model, device_map=device_map, offload_buffers=True)
device = torch.cuda.current_device()
tok_ins = "\n\n### Instruction:\n"
tok_res = "\n\n### Response:\n"
prompt_input = tok_ins + "{instruction}" + tok_res
input_text = "What is the next number after this list: [1, 2, 3, 5, 8, 13, 21]"
input_text = prompt_input.format_map({'instruction': input_text})
max_input_length = 512
max_generate_length = 1024
generation_kwargs = {
"top_p": 0.95,
"temperature": 0.8,
"max_length": max_generate_length,
"eos_token_id": tokenizer.eos_token_id,
"pad_token_id": tokenizer.pad_token_id,
"early_stopping": True,
"no_repeat_ngram_size": 4,
}
inputs = tokenizer(input_text, return_tensors='pt', truncation=True, max_length=max_input_length)
inputs = {k: v.to(device) for k, v in inputs.items()}
output = model.generate(**inputs, **generation_kwargs)
answer = ''
for tok_id in output[0][inputs['input_ids'].shape[1]:]:
if tok_id != tokenizer.eos_token_id:
answer += tokenizer.decode(tok_id)
print(answer)
Runs of TigerResearch tigerbot-7b-sft-v2 on huggingface.co
2
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-20
30-day runs
More Information About tigerbot-7b-sft-v2 huggingface.co Model
Url of tigerbot-7b-sft-v2
tigerbot-7b-sft-v2 huggingface.co Url
Provider of tigerbot-7b-sft-v2 huggingface.co
Other API from TigerResearch
Updated:September 20 2023
Total runs:
811
Run Growth:
407
Growth Rate:
50.18%
Total runs:
803
Run Growth:
407
Growth Rate:
50.68%
Total runs:
111
Run Growth:
93
Growth Rate:
83.78%
Total runs:
39
Run Growth:
36
Growth Rate:
92.31%
Total runs:
19
Run Growth:
4
Growth Rate:
20.00%
Total runs:
19
Run Growth:
19
Growth Rate:
100.00%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
11
Growth Rate:
57.89%
Total runs:
15
Run Growth:
6
Growth Rate:
40.00%
Total runs:
15
Run Growth:
7
Growth Rate:
43.75%
Total runs:
14
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
14
Growth Rate:
100.00%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-43
Growth Rate:
-2150.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-6
Growth Rate:
-600.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-5
Growth Rate:
0.00%