cmarkea / CodeLlama-34b-Instruct-hf-4bit

huggingface.co
Total runs: 15
24-hour runs: -4
7-day runs: -2
30-day runs: 0
Model's Last Updated: November 14 2024
text-generation

Introduction of CodeLlama-34b-Instruct-hf-4bit

Model Details of CodeLlama-34b-Instruct-hf-4bit

Converted version of CodeLlama-34b-Instruct-hf to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.

Impact on performance

We evaluated the models using a panel of giga-models (GPT-4o, Gemini Pro 1.5, and Claude-Sonnet 3.5). The scoring ranged from 0, indicating a model unsuitable for the task, to 5, representing a model that fully met expectations. The evaluation was based on 67 instructions across four programming languages: Python, Java, JavaScript, and Pseudo-code. All tests were conducted in a French-language context, and models were heavily penalized if they responded in another language, even if the response was technically correct.

model score # params (Billion) size (GB)
gemini-1.5-pro 4.51 NA NA
gpt-4o 4.51 NA NA
claude3.5-sonnet 4.49 NA NA
deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct 4.24 15.7 31.4
meta-llama/Meta-Llama-3.1-70B-Instruct 4.23 70.06 140.12
cmarkea/Meta-Llama-3.1-70B-Instruct-4bit 4.14 70.06 35.3
cmarkea/Mixtral-8x7B-Instruct-v0.1-4bit 3.8 46.7 23.35
meta-llama/Meta-Llama-3.1-8B-Instruct 3.73 8.03 16.06
mistralai/Mixtral-8x7B-Instruct-v0.1 3.33 46.7 93.4
codellama/CodeLlama-13b-Instruct-hf 3.33 13 26
codellama/CodeLlama-34b-Instruct-hf 3.27 33.7 67.4
codellama/CodeLlama-7b-Instruct-hf 3.19 6.74 13.48
cmarkea/CodeLlama-34b-Instruct-hf-4bit 3.12 33.7 16.85
codellama/CodeLlama-70b-Instruct-hf 1.82 69 138
cmarkea/CodeLlama-70b-Instruct-hf-4bit 1.64 69 34.5

Runs of cmarkea CodeLlama-34b-Instruct-hf-4bit on huggingface.co

15
Total runs
-4
24-hour runs
-3
3-day runs
-2
7-day runs
0
30-day runs

More Information About CodeLlama-34b-Instruct-hf-4bit huggingface.co Model

More CodeLlama-34b-Instruct-hf-4bit license Visit here:

https://choosealicense.com/licenses/llama2

CodeLlama-34b-Instruct-hf-4bit huggingface.co

CodeLlama-34b-Instruct-hf-4bit huggingface.co is an AI model on huggingface.co that provides CodeLlama-34b-Instruct-hf-4bit's model effect (), which can be used instantly with this cmarkea CodeLlama-34b-Instruct-hf-4bit model. huggingface.co supports a free trial of the CodeLlama-34b-Instruct-hf-4bit model, and also provides paid use of the CodeLlama-34b-Instruct-hf-4bit. Support call CodeLlama-34b-Instruct-hf-4bit model through api, including Node.js, Python, http.

CodeLlama-34b-Instruct-hf-4bit huggingface.co Url

https://huggingface.co/cmarkea/CodeLlama-34b-Instruct-hf-4bit

cmarkea CodeLlama-34b-Instruct-hf-4bit online free

CodeLlama-34b-Instruct-hf-4bit huggingface.co is an online trial and call api platform, which integrates CodeLlama-34b-Instruct-hf-4bit's modeling effects, including api services, and provides a free online trial of CodeLlama-34b-Instruct-hf-4bit, you can try CodeLlama-34b-Instruct-hf-4bit online for free by clicking the link below.

cmarkea CodeLlama-34b-Instruct-hf-4bit online free url in huggingface.co:

https://huggingface.co/cmarkea/CodeLlama-34b-Instruct-hf-4bit

CodeLlama-34b-Instruct-hf-4bit install

CodeLlama-34b-Instruct-hf-4bit is an open source model from GitHub that offers a free installation service, and any user can find CodeLlama-34b-Instruct-hf-4bit on GitHub to install. At the same time, huggingface.co provides the effect of CodeLlama-34b-Instruct-hf-4bit install, users can directly use CodeLlama-34b-Instruct-hf-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

CodeLlama-34b-Instruct-hf-4bit install url in huggingface.co:

https://huggingface.co/cmarkea/CodeLlama-34b-Instruct-hf-4bit

Url of CodeLlama-34b-Instruct-hf-4bit

CodeLlama-34b-Instruct-hf-4bit huggingface.co Url

Provider of CodeLlama-34b-Instruct-hf-4bit huggingface.co

cmarkea
ORGANIZATIONS

Other API from cmarkea