ethanpai / peft

huggingface.co
Total runs: 16
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: December 17 2024

Introduction of peft

Model Details of peft

ruGPT-3.5 13B LoRA: Adapter-Only Version

Welcome to the adapter-only version of ruGPT-3.5 13B LoRA. This model is built upon the foundation of ruGPT-3.5-13B .

📌 Important: This model was trained using settings identical to GigaSaiga , but incorporates additional dataset.

🔗 Training code is here .

Note: If you prefer, you can opt to use the ruGPT-3.5 13B fp16 base model.

Code sample
from peft import AutoPeftModelForCausalLM

model = AutoPeftModelForCausalLM.from_pretrained("zpbrent/peft-ruGPT-3.5-13B-lora")
Examples
User: Привет! Почему трава зелёная?
ruGPT-3.5: Трава зелёная благодаря хлорофиллу - пигменту растений, который поглощает световые волны определенной длины и преобразует их в энергию химических связей. Хлорофилл также обеспечивает растения питательными веществами из почвы через фотосинтез.
User: Придумай стишок про нейросети.
ruGPT-3.5: Нейросеть – это чудо науки,
Она способна решать любые задачи.
И если ты хочешь стать программистом,
То лучше всего изучать нейронные сети.
User: Высота самой высокой горы на Земле?
ruGPT-3.5: Самая высокая гора на Земле находится в Гималаях и называется Эверест (8848 метров).
User: Сколько максимум лет может прожить галопогосская черепаха?
ruGPT-3.5: Галопогосские черепахи могут жить до 100 лет и более. Они являются одними из самых долгоживущих животных на планете.
📚 Training Datasets

The datasets utilized for training this model are consistent with those used for Saiga-2 .

Here's the comprehensive list:

🛠 Training Procedure

The following bitsandbytes quantization config was used during training:

  • quant_method: bitsandbytes
  • load_in_8bit: True
  • load_in_4bit: False
  • llm_int8_threshold: 6.0
  • llm_int8_skip_modules: None
  • llm_int8_enable_fp32_cpu_offload: False
  • llm_int8_has_fp16_weight: False
  • bnb_4bit_quant_type: fp4
  • bnb_4bit_use_double_quant: False
  • bnb_4bit_compute_dtype: float32
⚙️ Framework Versions

Ensure you have the following framework versions for compatibility:

  • PyTorch 2.1.0
  • PEFT 0.5.0
  • bitsandbytes 0.41.1
  • transformers 4.34.0
Links

Runs of ethanpai peft on huggingface.co

16
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About peft huggingface.co Model

More peft license Visit here:

https://choosealicense.com/licenses/mit

peft huggingface.co

peft huggingface.co is an AI model on huggingface.co that provides peft's model effect (), which can be used instantly with this ethanpai peft model. huggingface.co supports a free trial of the peft model, and also provides paid use of the peft. Support call peft model through api, including Node.js, Python, http.

ethanpai peft online free

peft huggingface.co is an online trial and call api platform, which integrates peft's modeling effects, including api services, and provides a free online trial of peft, you can try peft online for free by clicking the link below.

ethanpai peft online free url in huggingface.co:

https://huggingface.co/ethanpai/peft

peft install

peft is an open source model from GitHub that offers a free installation service, and any user can find peft on GitHub to install. At the same time, huggingface.co provides the effect of peft install, users can directly use peft installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

peft install url in huggingface.co:

https://huggingface.co/ethanpai/peft

Url of peft

Provider of peft huggingface.co

ethanpai
ORGANIZATIONS

Other API from ethanpai

huggingface.co

Total runs: 36
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 18
Run Growth: 0
Growth Rate: 0.00%
Updated:January 04 2025
huggingface.co

Total runs: 10
Run Growth: 0
Growth Rate: 0.00%
Updated:December 07 2024
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 8
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 7
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 5
Run Growth: 0
Growth Rate: 0.00%
Updated:December 06 2024
huggingface.co

Total runs: 4
Run Growth: 0
Growth Rate: 0.00%
Updated:December 15 2024
huggingface.co

Total runs: 2
Run Growth: 0
Growth Rate: 0.00%
Updated:December 10 2024
huggingface.co

Total runs: 1
Run Growth: 0
Growth Rate: 0.00%
Updated:December 10 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:December 18 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:December 14 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:December 14 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:December 17 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:December 14 2024