The following
bitsandbytes
quantization config was used during training:
load_in_8bit: False
load_in_4bit: True
llm_int8_threshold: 6.0
llm_int8_skip_modules: None
llm_int8_enable_fp32_cpu_offload: False
llm_int8_has_fp16_weight: False
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: False
bnb_4bit_compute_dtype: bfloat16
The following
bitsandbytes
quantization config was used during training:
load_in_8bit: False
load_in_4bit: True
llm_int8_threshold: 6.0
llm_int8_skip_modules: None
llm_int8_enable_fp32_cpu_offload: False
llm_int8_has_fp16_weight: False
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: False
bnb_4bit_compute_dtype: bfloat16
The following
bitsandbytes
quantization config was used during training:
load_in_8bit: False
load_in_4bit: True
llm_int8_threshold: 6.0
llm_int8_skip_modules: None
llm_int8_enable_fp32_cpu_offload: False
llm_int8_has_fp16_weight: False
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: False
bnb_4bit_compute_dtype: bfloat16
The following
bitsandbytes
quantization config was used during training:
load_in_8bit: False
load_in_4bit: True
llm_int8_threshold: 6.0
llm_int8_skip_modules: None
llm_int8_enable_fp32_cpu_offload: False
llm_int8_has_fp16_weight: False
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: False
bnb_4bit_compute_dtype: bfloat16
Framework versions
PEFT 0.5.0.dev0
PEFT 0.5.0.dev0
PEFT 0.5.0.dev0
PEFT 0.5.0.dev0
Runs of nisten 13b8bitresults on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About 13b8bitresults huggingface.co Model
13b8bitresults huggingface.co
13b8bitresults huggingface.co is an AI model on huggingface.co that provides 13b8bitresults's model effect (), which can be used instantly with this nisten 13b8bitresults model. huggingface.co supports a free trial of the 13b8bitresults model, and also provides paid use of the 13b8bitresults. Support call 13b8bitresults model through api, including Node.js, Python, http.
13b8bitresults huggingface.co is an online trial and call api platform, which integrates 13b8bitresults's modeling effects, including api services, and provides a free online trial of 13b8bitresults, you can try 13b8bitresults online for free by clicking the link below.
nisten 13b8bitresults online free url in huggingface.co:
13b8bitresults is an open source model from GitHub that offers a free installation service, and any user can find 13b8bitresults on GitHub to install. At the same time, huggingface.co provides the effect of 13b8bitresults install, users can directly use 13b8bitresults installed effect in huggingface.co for debugging and trial. It also supports api for free installation.