import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "DeepMount00/Lexora-Lite-3B_v2"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype=torch.bfloat16,
device_map="auto",
)
prompt = [{'role': 'user', 'content': """Marco ha comprato 5 scatole di cioccolatini. Ogni scatola contiene 12 cioccolatini. Ha deciso di dare 3 cioccolatini a ciascuno dei suoi 7 amici. Quanti cioccolatini gli rimarranno dopo averli distribuiti ai suoi amici?"""}]
inputs = tokenizer.apply_chat_template(
prompt,
add_generation_prompt=True,
return_tensors='pt'
)
tokens = model.generate(
inputs.to(model.device),
max_new_tokens=1024,
temperature=0.001,
do_sample=True
)
print(tokenizer.decode(tokens[0], skip_special_tokens=False))
Runs of DeepMount00 Lexora-Lite-3B_v2 on huggingface.co
1.6K
Total runs
0
24-hour runs
0
3-day runs
213
7-day runs
-618
30-day runs
More Information About Lexora-Lite-3B_v2 huggingface.co Model
Lexora-Lite-3B_v2 huggingface.co
Lexora-Lite-3B_v2 huggingface.co is an AI model on huggingface.co that provides Lexora-Lite-3B_v2's model effect (), which can be used instantly with this DeepMount00 Lexora-Lite-3B_v2 model. huggingface.co supports a free trial of the Lexora-Lite-3B_v2 model, and also provides paid use of the Lexora-Lite-3B_v2. Support call Lexora-Lite-3B_v2 model through api, including Node.js, Python, http.
Lexora-Lite-3B_v2 huggingface.co is an online trial and call api platform, which integrates Lexora-Lite-3B_v2's modeling effects, including api services, and provides a free online trial of Lexora-Lite-3B_v2, you can try Lexora-Lite-3B_v2 online for free by clicking the link below.
DeepMount00 Lexora-Lite-3B_v2 online free url in huggingface.co:
Lexora-Lite-3B_v2 is an open source model from GitHub that offers a free installation service, and any user can find Lexora-Lite-3B_v2 on GitHub to install. At the same time, huggingface.co provides the effect of Lexora-Lite-3B_v2 install, users can directly use Lexora-Lite-3B_v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.