mgoin / zephyr-7b-alpha-ds

huggingface.co
Total runs: 9
24-hour runs: 1
7-day runs: 2
30-day runs: 1
Model's Last Updated: October 17 2023
text-generation

Introduction of zephyr-7b-alpha-ds

Model Details of zephyr-7b-alpha-ds

zephyr-7b-alpha for DeepSparse

Usage

pip install deepsparse-nightly[llm]

from deepsparse import TextGeneration
model = TextGeneration(model="hf:mgoin/zephyr-7b-alpha-ds")
out = model("Once upon a time,", max_new_tokens=100)
print(out.generations[0].text)
### there was a young woman named Lily. She was a kind and gentle soul, with a heart full of love and compassion. Lily had always been fascinated by the natural world, and she spent most of her free time exploring the forests and fields around her home.\n\nOne day, as she was wandering through the woods, Lily stumbled upon a small clearing. In the center of the clearing, she saw a beautiful butterfly fluttering its wings. The butterfly was unlike any she had
How to export from zephyr-7b-alpha

Install SparseML with this PR

git clone https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha
sparseml.transformers.export_onnx --model_path ./zephyr-7b-alpha --task text-generation --sequence_length 512 --trust_remote_code
cp deployment/model.onnx deployment/model-orig.onnx
python ~/onnx_kv_inject.py --input-file deployment/model-orig.onnx --output-file deployment/model.onnx

Runs of mgoin zephyr-7b-alpha-ds on huggingface.co

9
Total runs
1
24-hour runs
2
3-day runs
2
7-day runs
1
30-day runs

More Information About zephyr-7b-alpha-ds huggingface.co Model

zephyr-7b-alpha-ds huggingface.co

zephyr-7b-alpha-ds huggingface.co is an AI model on huggingface.co that provides zephyr-7b-alpha-ds's model effect (), which can be used instantly with this mgoin zephyr-7b-alpha-ds model. huggingface.co supports a free trial of the zephyr-7b-alpha-ds model, and also provides paid use of the zephyr-7b-alpha-ds. Support call zephyr-7b-alpha-ds model through api, including Node.js, Python, http.

zephyr-7b-alpha-ds huggingface.co Url

https://huggingface.co/mgoin/zephyr-7b-alpha-ds

mgoin zephyr-7b-alpha-ds online free

zephyr-7b-alpha-ds huggingface.co is an online trial and call api platform, which integrates zephyr-7b-alpha-ds's modeling effects, including api services, and provides a free online trial of zephyr-7b-alpha-ds, you can try zephyr-7b-alpha-ds online for free by clicking the link below.

mgoin zephyr-7b-alpha-ds online free url in huggingface.co:

https://huggingface.co/mgoin/zephyr-7b-alpha-ds

zephyr-7b-alpha-ds install

zephyr-7b-alpha-ds is an open source model from GitHub that offers a free installation service, and any user can find zephyr-7b-alpha-ds on GitHub to install. At the same time, huggingface.co provides the effect of zephyr-7b-alpha-ds install, users can directly use zephyr-7b-alpha-ds installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

zephyr-7b-alpha-ds install url in huggingface.co:

https://huggingface.co/mgoin/zephyr-7b-alpha-ds

Url of zephyr-7b-alpha-ds

zephyr-7b-alpha-ds huggingface.co Url

Provider of zephyr-7b-alpha-ds huggingface.co

mgoin
ORGANIZATIONS

Other API from mgoin

huggingface.co

Total runs: 351
Run Growth: 67
Growth Rate: 19.09%
Updated:February 07 2025
huggingface.co

Total runs: 12
Run Growth: 5
Growth Rate: 38.46%
Updated:September 30 2023