ostris / accuracy_recovery_adapters

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: January 02 2026

Introduction of accuracy_recovery_adapters

Model Details of accuracy_recovery_adapters

Accuracy Recovery Adapters

This repo contains various accuracy recovery adapters (ARAs) that I have trained, primarialy for use with AI Toolkit . An ARA is a LoRA that is trained via student teacher training with the student being quantized down to a low precision and the teacher having a high precision. The goal is to have a side chain LoRA, at bfloat16, that runs parallel to highly quantized layers in a network to compensate for the loss in precision that happens when weights are quantized. The training is done on a per layer basis in order to match the parent output as much as possible.

While this can be used on inference, my primary goal is to make large models finetunable on consumer grade hardware. With the 3bit Qwen Image adapter, it is now possible to train a LoRA on top of it, with 1 MP images, on a 24 GB GPU, such as a 3090/4090.

I have found the sweet spot, at least for Qwen-Image , is 3 bit quantization with a rank 16 adapter.

More info, examples, links, training scripts, AI Toolkit example configs, and adapters to some soon.

License

All adapters inherit the parent model license. Apache 2.0 for Apache 2.0, BFL License for BFL License, etc.

Qwen-Image 3 bit quantization

image/jpeg

Runs of ostris accuracy_recovery_adapters on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About accuracy_recovery_adapters huggingface.co Model

accuracy_recovery_adapters huggingface.co

accuracy_recovery_adapters huggingface.co is an AI model on huggingface.co that provides accuracy_recovery_adapters's model effect (), which can be used instantly with this ostris accuracy_recovery_adapters model. huggingface.co supports a free trial of the accuracy_recovery_adapters model, and also provides paid use of the accuracy_recovery_adapters. Support call accuracy_recovery_adapters model through api, including Node.js, Python, http.

accuracy_recovery_adapters huggingface.co Url

https://huggingface.co/ostris/accuracy_recovery_adapters

ostris accuracy_recovery_adapters online free

accuracy_recovery_adapters huggingface.co is an online trial and call api platform, which integrates accuracy_recovery_adapters's modeling effects, including api services, and provides a free online trial of accuracy_recovery_adapters, you can try accuracy_recovery_adapters online for free by clicking the link below.

ostris accuracy_recovery_adapters online free url in huggingface.co:

https://huggingface.co/ostris/accuracy_recovery_adapters

accuracy_recovery_adapters install

accuracy_recovery_adapters is an open source model from GitHub that offers a free installation service, and any user can find accuracy_recovery_adapters on GitHub to install. At the same time, huggingface.co provides the effect of accuracy_recovery_adapters install, users can directly use accuracy_recovery_adapters installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

accuracy_recovery_adapters install url in huggingface.co:

https://huggingface.co/ostris/accuracy_recovery_adapters

Url of accuracy_recovery_adapters

accuracy_recovery_adapters huggingface.co Url

Provider of accuracy_recovery_adapters huggingface.co

ostris
ORGANIZATIONS

Other API from ostris

huggingface.co

Total runs: 861
Run Growth: 18
Growth Rate: 2.09%
Updated:January 19 2025
huggingface.co

Total runs: 428
Run Growth: -128
Growth Rate: -29.91%
Updated:October 04 2024
huggingface.co

Total runs: 185
Run Growth: 132
Growth Rate: 71.35%
Updated:July 22 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:July 18 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:February 12 2024