This is a merge of pre-trained language models created using
mergekit
.
Usage
import vllm
from transformers import AutoTokenizer
from vllm import LLM, SamplingParams
model_name = "voidful/Llama-3.1-TAIDE-R1-8B-Chat"
llm = vllm.LLM(model=model_name,max_model_len=4096)
tokenizer = AutoTokenizer.from_pretrained(model_name)
messages = [
{"role": "system",
"content": "You first thinks about the reasoning process in the mind and then provides the user with the answer while reasoning step by step, and putting the final answer within \\boxed{}.The reasoning process and answer are enclosed within <think> </think> and <answer> </answer> tags, respectively, i.e., <think> reasoning process here </think><answer> answer here </answer>."},
{"role": "user", "content": f"早餐喝早餐店的奶茶會導致烙賽為什麼?"},
]
prompts = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=False
)
sampling_params = SamplingParams(temperature=0.6, max_tokens=512, top_p=0.9)
outputs = llm.generate(prompts, sampling_params)
print(f"{prompts}")
print(f"{outputs[0].outputs[0].text}\n")
sampling_params = SamplingParams(temperature=0.6, max_tokens=512, top_p=0.9)
outputs = llm.generate(prompts, sampling_params)
print(f"{prompts}")
print(f"{outputs[0].outputs[0].text}\n")
Runs of voidful Llama-3.1-TAIDE-R1-8B-Chat on huggingface.co
311
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About Llama-3.1-TAIDE-R1-8B-Chat huggingface.co Model
Llama-3.1-TAIDE-R1-8B-Chat huggingface.co
Llama-3.1-TAIDE-R1-8B-Chat huggingface.co is an AI model on huggingface.co that provides Llama-3.1-TAIDE-R1-8B-Chat's model effect (), which can be used instantly with this voidful Llama-3.1-TAIDE-R1-8B-Chat model. huggingface.co supports a free trial of the Llama-3.1-TAIDE-R1-8B-Chat model, and also provides paid use of the Llama-3.1-TAIDE-R1-8B-Chat. Support call Llama-3.1-TAIDE-R1-8B-Chat model through api, including Node.js, Python, http.
Llama-3.1-TAIDE-R1-8B-Chat huggingface.co is an online trial and call api platform, which integrates Llama-3.1-TAIDE-R1-8B-Chat's modeling effects, including api services, and provides a free online trial of Llama-3.1-TAIDE-R1-8B-Chat, you can try Llama-3.1-TAIDE-R1-8B-Chat online for free by clicking the link below.
voidful Llama-3.1-TAIDE-R1-8B-Chat online free url in huggingface.co:
Llama-3.1-TAIDE-R1-8B-Chat is an open source model from GitHub that offers a free installation service, and any user can find Llama-3.1-TAIDE-R1-8B-Chat on GitHub to install. At the same time, huggingface.co provides the effect of Llama-3.1-TAIDE-R1-8B-Chat install, users can directly use Llama-3.1-TAIDE-R1-8B-Chat installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Llama-3.1-TAIDE-R1-8B-Chat install url in huggingface.co: