payelb / HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: April 14 2026

Introduction of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Model Details of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

payelb/HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Base model: TinyLlama/TinyLlama-1.1B-Chat-v1.0

Alignment dataset: Anthropic/hh-rlhf

Reward model: payelb/HHRLHF_reward-model-deberta-v3-base_1k_fixed_MARS

Method: PPO alignment with LoRA adapters.

Notes:

  • Reward normalization and clipping enabled
  • KL control enabled
  • pad_token_id/eos_token_id explicitly set
  • DeBERTa RM loaded on a single device (no device_map='auto')

Runs of payelb HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co Model

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co is an AI model on huggingface.co that provides HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM's model effect (), which can be used instantly with this payelb HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM model. huggingface.co supports a free trial of the HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM model, and also provides paid use of the HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM. Support call HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM model through api, including Node.js, Python, http.

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co Url

https://huggingface.co/payelb/HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

payelb HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM online free

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co is an online trial and call api platform, which integrates HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM's modeling effects, including api services, and provides a free online trial of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM, you can try HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM online for free by clicking the link below.

payelb HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM online free url in huggingface.co:

https://huggingface.co/payelb/HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM install

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM is an open source model from GitHub that offers a free installation service, and any user can find HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM on GitHub to install. At the same time, huggingface.co provides the effect of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM install, users can directly use HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM install url in huggingface.co:

https://huggingface.co/payelb/HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

Url of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM

HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co Url

Provider of HHRLHF_TinyLlama-1.1B_aligned_with_MARS_deberta_RM huggingface.co

payelb
ORGANIZATIONS

Other API from payelb

huggingface.co

Total runs: 24
Run Growth: 0
Growth Rate: 0.00%
Updated:February 18 2025
huggingface.co

Total runs: 10
Run Growth: 5
Growth Rate: 50.00%
Updated:July 11 2025
huggingface.co

Total runs: 7
Run Growth: 6
Growth Rate: 85.71%
Updated:March 14 2025
huggingface.co

Total runs: 7
Run Growth: 4
Growth Rate: 50.00%
Updated:March 14 2025
huggingface.co

Total runs: 2
Run Growth: -5
Growth Rate: -250.00%
Updated:April 12 2025