Sponsored by APIMart
Toolify Toolify logo
AI Models
WizardLM2-2bit

KingNish / WizardLM2-2bit

Run on huggingface.co
huggingface.co
Total runs: 151
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: April 28 2024
text-generation

Introduction of WizardLM2-2bit

Model Details of WizardLM2-2bit

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Description

MaziyarPanahi/WizardLM-2-8x22B-GGUF contains GGUF format model files for mistral-community/Mixtral-8x22B-v0.1 .

How to download

You can download only the quants you need instead of cloning the entire repository as follows: 

huggingface-cli download MaziyarPanahi/WizardLM-2-8x22B-GGUF --local-dir . --include '*Q2_K*gguf'

On Windows: 

huggingface-cli download MaziyarPanahi/WizardLM-2-8x22B-GGUF --local-dir . --include *Q4_K_S*gguf
Load sharded model

llama_load_model_from_file will detect the number of files and will load additional tensors from the rest of files. 

llama.cpp/main -m WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 1024 -e
Prompt template 
{system_prompt}
USER: {prompt}
ASSISTANT: </s>

or 

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, 
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
USER: {prompt} ASSISTANT: </s>......

Runs of KingNish WizardLM2-2bit on huggingface.co

151
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About WizardLM2-2bit huggingface.co Model

More WizardLM2-2bit license Visit here:

https://choosealicense.com/licenses/apache-2.0

WizardLM2-2bit huggingface.co

WizardLM2-2bit huggingface.co is an AI model on huggingface.co that provides WizardLM2-2bit's model effect (), which can be used instantly with this KingNish WizardLM2-2bit model. huggingface.co supports a free trial of the WizardLM2-2bit model, and also provides paid use of the WizardLM2-2bit. Support call WizardLM2-2bit model through api, including Node.js, Python, http.

WizardLM2-2bit huggingface.co Url

https://huggingface.co/KingNish/WizardLM2-2bit

KingNish WizardLM2-2bit online free

WizardLM2-2bit huggingface.co is an online trial and call api platform, which integrates WizardLM2-2bit's modeling effects, including api services, and provides a free online trial of WizardLM2-2bit, you can try WizardLM2-2bit online for free by clicking the link below.

KingNish WizardLM2-2bit online free url in huggingface.co:

https://huggingface.co/KingNish/WizardLM2-2bit

WizardLM2-2bit install

WizardLM2-2bit is an open source model from GitHub that offers a free installation service, and any user can find WizardLM2-2bit on GitHub to install. At the same time, huggingface.co provides the effect of WizardLM2-2bit install, users can directly use WizardLM2-2bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

WizardLM2-2bit install url in huggingface.co:

https://huggingface.co/KingNish/WizardLM2-2bit

Url of WizardLM2-2bit

WizardLM2-2bit huggingface.co Url

Provider of WizardLM2-2bit huggingface.co

KingNish
ORGANIZATIONS
huggingface.co

Other API from KingNish

 huggingface.co
KingNish/flux-me

Total runs: 349
Run Growth: 0
Growth Rate: 0.00%
Updated:September 10 2024
huggingface.co
KingNish/Fineweb

Total runs: 19
Run Growth: 0
Growth Rate: 0.00%
Updated:July 17 2024
huggingface.co
KingNish/Miro-test

Total runs: 14
Run Growth: 12
Growth Rate: 85.71%
Updated:November 25 2025
huggingface.co
KingNish/tinyllama

Total runs: 10
Run Growth: 0
Growth Rate: 0.00%
Updated:May 05 2024
huggingface.co
KingNish/exp-22

Total runs: 3
Run Growth: 0
Growth Rate: 0.00%
Updated:August 19 2024
huggingface.co
KingNish/exp-21

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:August 19 2024