cmarkea / CodeLlama-70b-Instruct-hf-4bit

huggingface.co
Total runs: 31
24-hour runs: 3
7-day runs: 4
30-day runs: 2
Model's Last Updated: November 14 2024
text-generation

Introduction of CodeLlama-70b-Instruct-hf-4bit

Model Details of CodeLlama-70b-Instruct-hf-4bit

Converted version of CodeLlama-70b-Instruct-hf to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.

Impact on performance

We evaluated the models using a panel of giga-models (GPT-4o, Gemini Pro 1.5, and Claude-Sonnet 3.5). The scoring ranged from 0, indicating a model unsuitable for the task, to 5, representing a model that fully met expectations. The evaluation was based on 67 instructions across four programming languages: Python, Java, JavaScript, and Pseudo-code. All tests were conducted in a French-language context, and models were heavily penalized if they responded in another language, even if the response was technically correct.

model score # params (Billion) size (GB)
gemini-1.5-pro 4.51 NA NA
gpt-4o 4.51 NA NA
claude3.5-sonnet 4.49 NA NA
deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct 4.24 15.7 31.4
meta-llama/Meta-Llama-3.1-70B-Instruct 4.23 70.06 140.12
cmarkea/Meta-Llama-3.1-70B-Instruct-4bit 4.14 70.06 35.3
cmarkea/Mixtral-8x7B-Instruct-v0.1-4bit 3.8 46.7 23.35
meta-llama/Meta-Llama-3.1-8B-Instruct 3.73 8.03 16.06
mistralai/Mixtral-8x7B-Instruct-v0.1 3.33 46.7 93.4
codellama/CodeLlama-13b-Instruct-hf 3.33 13 26
codellama/CodeLlama-34b-Instruct-hf 3.27 33.7 67.4
codellama/CodeLlama-7b-Instruct-hf 3.19 6.74 13.48
cmarkea/CodeLlama-34b-Instruct-hf-4bit 3.12 33.7 16.85
codellama/CodeLlama-70b-Instruct-hf 1.82 69 138
cmarkea/CodeLlama-70b-Instruct-hf-4bit 1.64 69 34.5

Runs of cmarkea CodeLlama-70b-Instruct-hf-4bit on huggingface.co

31
Total runs
3
24-hour runs
2
3-day runs
4
7-day runs
2
30-day runs

More Information About CodeLlama-70b-Instruct-hf-4bit huggingface.co Model

More CodeLlama-70b-Instruct-hf-4bit license Visit here:

https://choosealicense.com/licenses/llama2

CodeLlama-70b-Instruct-hf-4bit huggingface.co

CodeLlama-70b-Instruct-hf-4bit huggingface.co is an AI model on huggingface.co that provides CodeLlama-70b-Instruct-hf-4bit's model effect (), which can be used instantly with this cmarkea CodeLlama-70b-Instruct-hf-4bit model. huggingface.co supports a free trial of the CodeLlama-70b-Instruct-hf-4bit model, and also provides paid use of the CodeLlama-70b-Instruct-hf-4bit. Support call CodeLlama-70b-Instruct-hf-4bit model through api, including Node.js, Python, http.

CodeLlama-70b-Instruct-hf-4bit huggingface.co Url

https://huggingface.co/cmarkea/CodeLlama-70b-Instruct-hf-4bit

cmarkea CodeLlama-70b-Instruct-hf-4bit online free

CodeLlama-70b-Instruct-hf-4bit huggingface.co is an online trial and call api platform, which integrates CodeLlama-70b-Instruct-hf-4bit's modeling effects, including api services, and provides a free online trial of CodeLlama-70b-Instruct-hf-4bit, you can try CodeLlama-70b-Instruct-hf-4bit online for free by clicking the link below.

cmarkea CodeLlama-70b-Instruct-hf-4bit online free url in huggingface.co:

https://huggingface.co/cmarkea/CodeLlama-70b-Instruct-hf-4bit

CodeLlama-70b-Instruct-hf-4bit install

CodeLlama-70b-Instruct-hf-4bit is an open source model from GitHub that offers a free installation service, and any user can find CodeLlama-70b-Instruct-hf-4bit on GitHub to install. At the same time, huggingface.co provides the effect of CodeLlama-70b-Instruct-hf-4bit install, users can directly use CodeLlama-70b-Instruct-hf-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

CodeLlama-70b-Instruct-hf-4bit install url in huggingface.co:

https://huggingface.co/cmarkea/CodeLlama-70b-Instruct-hf-4bit

Url of CodeLlama-70b-Instruct-hf-4bit

CodeLlama-70b-Instruct-hf-4bit huggingface.co Url

Provider of CodeLlama-70b-Instruct-hf-4bit huggingface.co

cmarkea
ORGANIZATIONS

Other API from cmarkea