yujiepan / opt-tiny-random

huggingface.co
Total runs: 4.7K
24-hour runs: 0
7-day runs: 0
30-day runs: 1.4K
Model's Last Updated: January 20 2025
text-generation

Introduction of opt-tiny-random

Model Details of opt-tiny-random

This model is randomly initialized, using the config from facebook/opt-30b but with smaller size. Note the model is in float16.

Codes:

import torch
import transformers
import os
from optimum.intel.openvino import OVModelForCausalLM

save_path = '/tmp/yujiepan/opt-tiny-random'
repo_id = 'yujiepan/opt-tiny-random'

config = transformers.AutoConfig.from_pretrained('facebook/opt-30b')
config.ffn_dim = 32
config.hidden_size = 8
config.num_attention_heads = 2
config.num_hidden_layers = 2
config.word_embed_proj_dim = 8

model = transformers.AutoModelForCausalLM.from_config(config, torch_dtype=torch.float16)
model = model.half()
model.save_pretrained(save_path)

tokenizer = transformers.AutoTokenizer.from_pretrained('facebook/opt-30b')
tokenizer.save_pretrained(save_path)

ovmodel = OVModelForCausalLM.from_pretrained(save_path, export=True)
ovmodel = ovmodel.half()
ovmodel.save_pretrained(save_path)

os.system(f'ls -alh {save_path}')

from huggingface_hub import create_repo, upload_folder
create_repo(repo_id, exist_ok=True)
upload_folder(repo_id=repo_id, folder_path=save_path)

Runs of yujiepan opt-tiny-random on huggingface.co

4.7K
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
1.4K
30-day runs

More Information About opt-tiny-random huggingface.co Model

opt-tiny-random huggingface.co

opt-tiny-random huggingface.co is an AI model on huggingface.co that provides opt-tiny-random's model effect (), which can be used instantly with this yujiepan opt-tiny-random model. huggingface.co supports a free trial of the opt-tiny-random model, and also provides paid use of the opt-tiny-random. Support call opt-tiny-random model through api, including Node.js, Python, http.

opt-tiny-random huggingface.co Url

https://huggingface.co/yujiepan/opt-tiny-random

yujiepan opt-tiny-random online free

opt-tiny-random huggingface.co is an online trial and call api platform, which integrates opt-tiny-random's modeling effects, including api services, and provides a free online trial of opt-tiny-random, you can try opt-tiny-random online for free by clicking the link below.

yujiepan opt-tiny-random online free url in huggingface.co:

https://huggingface.co/yujiepan/opt-tiny-random

opt-tiny-random install

opt-tiny-random is an open source model from GitHub that offers a free installation service, and any user can find opt-tiny-random on GitHub to install. At the same time, huggingface.co provides the effect of opt-tiny-random install, users can directly use opt-tiny-random installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

opt-tiny-random install url in huggingface.co:

https://huggingface.co/yujiepan/opt-tiny-random

Url of opt-tiny-random

opt-tiny-random huggingface.co Url

Provider of opt-tiny-random huggingface.co

yujiepan
ORGANIZATIONS

Other API from yujiepan