izumi-lab / stormy-7b-10ep

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: June 26 2023

Introduction of stormy-7b-10ep

Model Details of stormy-7b-10ep

This repo contains a low-rank adapter for CALM fit on the dataset specially extracted from llm-japanese-dataset .

You can test this at https://huggingface.co/spaces/izumi-lab/stormy-7b-10ep

This version of the weights was trained with the following hyperparameters:

  • Epochs: 10
  • Batch size: 128
  • Cutoff length: 300
  • Learning rate: 3e-4
  • Lora r : 4
  • Lora target modules: query_key_value
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = "cyberagent/open-calm-7b"
model = AutoModelForCausalLM.from_pretrained(base_model, torch_dtype=torch.float16)
tokenizer = AutoTokenizer.from_pretrained(base_model)
model = PeftModel.from_pretrained(
    model,
    "izumi-lab/stormy-7b-10ep",
    torch_dtype=torch.float16,
)

To see more latest information, please go to llm.msuzuki.me .

Details

Citation: TBD

If you have any inquiries, such as joint research, data provision, various types of support, please email [email protected] .

Runs of izumi-lab stormy-7b-10ep on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About stormy-7b-10ep huggingface.co Model

More stormy-7b-10ep license Visit here:

https://choosealicense.com/licenses/cc-by-sa-4.0

stormy-7b-10ep huggingface.co

stormy-7b-10ep huggingface.co is an AI model on huggingface.co that provides stormy-7b-10ep's model effect (), which can be used instantly with this izumi-lab stormy-7b-10ep model. huggingface.co supports a free trial of the stormy-7b-10ep model, and also provides paid use of the stormy-7b-10ep. Support call stormy-7b-10ep model through api, including Node.js, Python, http.

stormy-7b-10ep huggingface.co Url

https://huggingface.co/izumi-lab/stormy-7b-10ep

izumi-lab stormy-7b-10ep online free

stormy-7b-10ep huggingface.co is an online trial and call api platform, which integrates stormy-7b-10ep's modeling effects, including api services, and provides a free online trial of stormy-7b-10ep, you can try stormy-7b-10ep online for free by clicking the link below.

izumi-lab stormy-7b-10ep online free url in huggingface.co:

https://huggingface.co/izumi-lab/stormy-7b-10ep

stormy-7b-10ep install

stormy-7b-10ep is an open source model from GitHub that offers a free installation service, and any user can find stormy-7b-10ep on GitHub to install. At the same time, huggingface.co provides the effect of stormy-7b-10ep install, users can directly use stormy-7b-10ep installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

stormy-7b-10ep install url in huggingface.co:

https://huggingface.co/izumi-lab/stormy-7b-10ep

Url of stormy-7b-10ep

stormy-7b-10ep huggingface.co Url

Provider of stormy-7b-10ep huggingface.co

izumi-lab
ORGANIZATIONS

Other API from izumi-lab