The instruction finetuned model with 4K input length. The model is finetuned on top of pretrained LLaMa2
Inference
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("budecosystem/genz-13b", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("budecosystem/genz-13b", torch_dtype=torch.bfloat16)
inputs = tokenizer("The world is", return_tensors="pt")
sample = model.generate(**inputs, max_length=128)
print(tokenizer.decode(sample[0]))
Use following prompt template
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: Hi, how are you? ASSISTANT:
More Information About genz-13b huggingface.co Model
genz-13b huggingface.co
genz-13b huggingface.co is an AI model on huggingface.co that provides genz-13b's model effect (), which can be used instantly with this budecosystem genz-13b model. huggingface.co supports a free trial of the genz-13b model, and also provides paid use of the genz-13b. Support call genz-13b model through api, including Node.js, Python, http.
genz-13b huggingface.co is an online trial and call api platform, which integrates genz-13b's modeling effects, including api services, and provides a free online trial of genz-13b, you can try genz-13b online for free by clicking the link below.
budecosystem genz-13b online free url in huggingface.co:
genz-13b is an open source model from GitHub that offers a free installation service, and any user can find genz-13b on GitHub to install. At the same time, huggingface.co provides the effect of genz-13b install, users can directly use genz-13b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.