mlabonne / dummy-llama-2

huggingface.co
Total runs: 42
24-hour runs: 0
7-day runs: -3
30-day runs: 22
Model's Last Updated: November 17 2024
text-generation

Introduction of dummy-llama-2

Model Details of dummy-llama-2

dummy-llama-2

This is a dummy version of the model based on meta-llama/Llama-2-7b-hf .

🧩 Dummy

dummy-llama-2 has a size of 929.07 MB instead of the original 13476.98 MB (compression factor of 14.51) but keeps the base model's functionality.

The purpose of this dummy version is to be used for debugging , so you don't have to download the entire original model. Do not use it for inference.

💻 Usage
# pip install transformers accelerate

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model = "dummy-llama-2"

tokenizer = AutoTokenizer.from_pretrained(model)
model = AutoModelForCausalLM.from_pretrained(
    model,
    low_cpu_mem_usage=True,
    return_dict=True,
    torch_dtype=torch.float16,
    device_map={"": 0},
)

Runs of mlabonne dummy-llama-2 on huggingface.co

42
Total runs
0
24-hour runs
-6
3-day runs
-3
7-day runs
22
30-day runs

More Information About dummy-llama-2 huggingface.co Model

dummy-llama-2 huggingface.co

dummy-llama-2 huggingface.co is an AI model on huggingface.co that provides dummy-llama-2's model effect (), which can be used instantly with this mlabonne dummy-llama-2 model. huggingface.co supports a free trial of the dummy-llama-2 model, and also provides paid use of the dummy-llama-2. Support call dummy-llama-2 model through api, including Node.js, Python, http.

dummy-llama-2 huggingface.co Url

https://huggingface.co/mlabonne/dummy-llama-2

mlabonne dummy-llama-2 online free

dummy-llama-2 huggingface.co is an online trial and call api platform, which integrates dummy-llama-2's modeling effects, including api services, and provides a free online trial of dummy-llama-2, you can try dummy-llama-2 online for free by clicking the link below.

mlabonne dummy-llama-2 online free url in huggingface.co:

https://huggingface.co/mlabonne/dummy-llama-2

dummy-llama-2 install

dummy-llama-2 is an open source model from GitHub that offers a free installation service, and any user can find dummy-llama-2 on GitHub to install. At the same time, huggingface.co provides the effect of dummy-llama-2 install, users can directly use dummy-llama-2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

dummy-llama-2 install url in huggingface.co:

https://huggingface.co/mlabonne/dummy-llama-2

Url of dummy-llama-2

dummy-llama-2 huggingface.co Url

Provider of dummy-llama-2 huggingface.co

mlabonne
ORGANIZATIONS

Other API from mlabonne

huggingface.co

Total runs: 156
Run Growth: -18
Growth Rate: -11.54%
Updated:March 04 2024
huggingface.co

Total runs: 142
Run Growth: -21
Growth Rate: -14.79%
Updated:March 04 2024
huggingface.co

Total runs: 67
Run Growth: -6
Growth Rate: -8.96%
Updated:March 04 2024