athirdpath / BigMistral-13b-GLUE_LORA

huggingface.co
Total runs: 14
24-hour runs: 0
7-day runs: 0
30-day runs: 10
Model's Last Updated: December 03 2023

Introduction of BigMistral-13b-GLUE_LORA

Model Details of BigMistral-13b-GLUE_LORA

base_model: athirdpath/BigMistral-13b

model_type: MistralForCausalLM

tokenizer_type: LlamaTokenizer

is_mistral_derived_model: true

load_in_4bit: true

datasets:

  • path: glueLORA2.jsonl
  • type: alpaca

val_set_size: 0.07

adapter: qlora

sequence_len: 4096

sample_packing: true

pad_to_sequence_len: true

lora_r: 512

lora_alpha: 32

lora_dropout: 0.04

lora_target_linear: true

gradient_accumulation_steps: 6

micro_batch_size: 3

eval_batch_size: 3

num_epochs: 4

optimizer: adamw_bnb_8bit

lr_scheduler: cosine

learning_rate: 0.00005

bf16: true

gradient_checkpointing: true

flash_attention: true

warmup_steps: 10

weight_decay: 0.00001

Runs of athirdpath BigMistral-13b-GLUE_LORA on huggingface.co

14
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
10
30-day runs

More Information About BigMistral-13b-GLUE_LORA huggingface.co Model

BigMistral-13b-GLUE_LORA huggingface.co

BigMistral-13b-GLUE_LORA huggingface.co is an AI model on huggingface.co that provides BigMistral-13b-GLUE_LORA's model effect (), which can be used instantly with this athirdpath BigMistral-13b-GLUE_LORA model. huggingface.co supports a free trial of the BigMistral-13b-GLUE_LORA model, and also provides paid use of the BigMistral-13b-GLUE_LORA. Support call BigMistral-13b-GLUE_LORA model through api, including Node.js, Python, http.

BigMistral-13b-GLUE_LORA huggingface.co Url

https://huggingface.co/athirdpath/BigMistral-13b-GLUE_LORA

athirdpath BigMistral-13b-GLUE_LORA online free

BigMistral-13b-GLUE_LORA huggingface.co is an online trial and call api platform, which integrates BigMistral-13b-GLUE_LORA's modeling effects, including api services, and provides a free online trial of BigMistral-13b-GLUE_LORA, you can try BigMistral-13b-GLUE_LORA online for free by clicking the link below.

athirdpath BigMistral-13b-GLUE_LORA online free url in huggingface.co:

https://huggingface.co/athirdpath/BigMistral-13b-GLUE_LORA

BigMistral-13b-GLUE_LORA install

BigMistral-13b-GLUE_LORA is an open source model from GitHub that offers a free installation service, and any user can find BigMistral-13b-GLUE_LORA on GitHub to install. At the same time, huggingface.co provides the effect of BigMistral-13b-GLUE_LORA install, users can directly use BigMistral-13b-GLUE_LORA installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

BigMistral-13b-GLUE_LORA install url in huggingface.co:

https://huggingface.co/athirdpath/BigMistral-13b-GLUE_LORA

Url of BigMistral-13b-GLUE_LORA

BigMistral-13b-GLUE_LORA huggingface.co Url

Provider of BigMistral-13b-GLUE_LORA huggingface.co

athirdpath
ORGANIZATIONS

Other API from athirdpath

huggingface.co

Total runs: 67
Run Growth: -45
Growth Rate: -69.23%
Updated:November 28 2023
huggingface.co

Total runs: 18
Run Growth: 0
Growth Rate: 0.00%
Updated:August 16 2024
huggingface.co

Total runs: 16
Run Growth: 0
Growth Rate: 0.00%
Updated:September 28 2024
huggingface.co

Total runs: 11
Run Growth: 2
Growth Rate: 18.18%
Updated:December 13 2023
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:August 17 2024