akashmaggon / llama-7b-int4-dolly

huggingface.co
Total runs: 8
24-hour runs: 0
7-day runs: 1
30-day runs: 6
Model's Last Updated: September 06 2023

Introduction of llama-7b-int4-dolly

Model Details of llama-7b-int4-dolly

Training procedure

The following bitsandbytes quantization config was used during training:

  • load_in_8bit: False
  • load_in_4bit: True
  • llm_int8_threshold: 6.0
  • llm_int8_skip_modules: None
  • llm_int8_enable_fp32_cpu_offload: False
  • llm_int8_has_fp16_weight: False
  • bnb_4bit_quant_type: nf4
  • bnb_4bit_use_double_quant: True
  • bnb_4bit_compute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • load_in_8bit: False
  • load_in_4bit: True
  • llm_int8_threshold: 6.0
  • llm_int8_skip_modules: None
  • llm_int8_enable_fp32_cpu_offload: False
  • llm_int8_has_fp16_weight: False
  • bnb_4bit_quant_type: nf4
  • bnb_4bit_use_double_quant: True
  • bnb_4bit_compute_dtype: bfloat16
Framework versions
  • PEFT 0.4.0

  • PEFT 0.4.0

Runs of akashmaggon llama-7b-int4-dolly on huggingface.co

8
Total runs
0
24-hour runs
-2
3-day runs
1
7-day runs
6
30-day runs

More Information About llama-7b-int4-dolly huggingface.co Model

llama-7b-int4-dolly huggingface.co

llama-7b-int4-dolly huggingface.co is an AI model on huggingface.co that provides llama-7b-int4-dolly's model effect (), which can be used instantly with this akashmaggon llama-7b-int4-dolly model. huggingface.co supports a free trial of the llama-7b-int4-dolly model, and also provides paid use of the llama-7b-int4-dolly. Support call llama-7b-int4-dolly model through api, including Node.js, Python, http.

llama-7b-int4-dolly huggingface.co Url

https://huggingface.co/akashmaggon/llama-7b-int4-dolly

akashmaggon llama-7b-int4-dolly online free

llama-7b-int4-dolly huggingface.co is an online trial and call api platform, which integrates llama-7b-int4-dolly's modeling effects, including api services, and provides a free online trial of llama-7b-int4-dolly, you can try llama-7b-int4-dolly online for free by clicking the link below.

akashmaggon llama-7b-int4-dolly online free url in huggingface.co:

https://huggingface.co/akashmaggon/llama-7b-int4-dolly

llama-7b-int4-dolly install

llama-7b-int4-dolly is an open source model from GitHub that offers a free installation service, and any user can find llama-7b-int4-dolly on GitHub to install. At the same time, huggingface.co provides the effect of llama-7b-int4-dolly install, users can directly use llama-7b-int4-dolly installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

llama-7b-int4-dolly install url in huggingface.co:

https://huggingface.co/akashmaggon/llama-7b-int4-dolly

Url of llama-7b-int4-dolly

llama-7b-int4-dolly huggingface.co Url

Provider of llama-7b-int4-dolly huggingface.co

akashmaggon
ORGANIZATIONS

Other API from akashmaggon

huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:April 05 2025
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:August 23 2023