Model Details of tiny-random-LlamaForCausalLM-ONNX
Model Card for Model ID
Model Details
Code to generate
import torch
from transformers import LlamaForCausalLM, LlamaConfig, AutoTokenizer
# Set seed for reproducibility
torch.manual_seed(0)
# Initializing the configuration
configuration = LlamaConfig(
head_dim=16,
hidden_size=32,
intermediate_size=64,
max_position_embeddings=131072,
model_type="llama",
num_attention_heads=2,
num_hidden_layers=1,
num_key_value_heads=2,
rms_norm_eps=1e-05,
rope_scaling={
"factor": 32.0,
"high_freq_factor": 4.0,
"low_freq_factor": 1.0,
"original_max_position_embeddings": 8192,
"rope_type": "llama3"
},
rope_theta=500000.0,
tie_word_embeddings=True,
vocab_size=128256,
)
# Initializing a model from the configuration
model = LlamaForCausalLM(configuration)
# Re-use tokenizer
tokenizer = AutoTokenizer.from_pretrained("Xenova/Llama-3.2-Tokenizer")
# Upload to the HF Hub
model_id = 'onnx-community/tiny-random-LlamaForCausalLM-ONNX'
model.push_to_hub(model_id)
tokenizer.push_to_hub(model_id)
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Developed by:
[More Information Needed]
Funded by [optional]:
[More Information Needed]
Shared by [optional]:
[More Information Needed]
Model type:
[More Information Needed]
Language(s) (NLP):
[More Information Needed]
License:
[More Information Needed]
Finetuned from model [optional]:
[More Information Needed]
Model Sources [optional]
Repository:
[More Information Needed]
Paper [optional]:
[More Information Needed]
Demo [optional]:
[More Information Needed]
Uses
Direct Use
[More Information Needed]
Downstream Use [optional]
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
Runs of onnx-community tiny-random-LlamaForCausalLM-ONNX on huggingface.co
954
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
694
30-day runs
More Information About tiny-random-LlamaForCausalLM-ONNX huggingface.co Model
tiny-random-LlamaForCausalLM-ONNX huggingface.co
tiny-random-LlamaForCausalLM-ONNX huggingface.co is an AI model on huggingface.co that provides tiny-random-LlamaForCausalLM-ONNX's model effect (), which can be used instantly with this onnx-community tiny-random-LlamaForCausalLM-ONNX model. huggingface.co supports a free trial of the tiny-random-LlamaForCausalLM-ONNX model, and also provides paid use of the tiny-random-LlamaForCausalLM-ONNX. Support call tiny-random-LlamaForCausalLM-ONNX model through api, including Node.js, Python, http.
tiny-random-LlamaForCausalLM-ONNX huggingface.co is an online trial and call api platform, which integrates tiny-random-LlamaForCausalLM-ONNX's modeling effects, including api services, and provides a free online trial of tiny-random-LlamaForCausalLM-ONNX, you can try tiny-random-LlamaForCausalLM-ONNX online for free by clicking the link below.
onnx-community tiny-random-LlamaForCausalLM-ONNX online free url in huggingface.co:
tiny-random-LlamaForCausalLM-ONNX is an open source model from GitHub that offers a free installation service, and any user can find tiny-random-LlamaForCausalLM-ONNX on GitHub to install. At the same time, huggingface.co provides the effect of tiny-random-LlamaForCausalLM-ONNX install, users can directly use tiny-random-LlamaForCausalLM-ONNX installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
tiny-random-LlamaForCausalLM-ONNX install url in huggingface.co: