This repo contains various accuracy recovery adapters (ARAs) that I have trained, primarialy for use with
AI Toolkit
.
An ARA is a LoRA that is trained via student teacher training with the student being quantized down to a low precision and the teacher having a high precision.
The goal is to have a side chain LoRA, at bfloat16, that runs parallel to highly quantized layers in a network to compensate for the loss in precision that happens
when weights are quantized. The training is done on a per layer basis in order to match the parent output as much as possible.
While this can be used on inference, my primary goal is to make large models finetunable on consumer grade hardware. With the 3bit Qwen Image adapter, it
is now possible to train a LoRA on top of it, with 1 MP images, on a 24 GB GPU, such as a 3090/4090.
I have found the sweet spot, at least for
Qwen-Image
, is 3 bit quantization with a rank 16 adapter.
More info, examples, links, training scripts, AI Toolkit example configs, and adapters to some soon.
License
All adapters inherit the parent model license. Apache 2.0 for Apache 2.0, BFL License for BFL License, etc.
Qwen-Image 3 bit quantization
Runs of ostris accuracy_recovery_adapters on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About accuracy_recovery_adapters huggingface.co Model
accuracy_recovery_adapters huggingface.co
accuracy_recovery_adapters huggingface.co is an AI model on huggingface.co that provides accuracy_recovery_adapters's model effect (), which can be used instantly with this ostris accuracy_recovery_adapters model. huggingface.co supports a free trial of the accuracy_recovery_adapters model, and also provides paid use of the accuracy_recovery_adapters. Support call accuracy_recovery_adapters model through api, including Node.js, Python, http.
accuracy_recovery_adapters huggingface.co is an online trial and call api platform, which integrates accuracy_recovery_adapters's modeling effects, including api services, and provides a free online trial of accuracy_recovery_adapters, you can try accuracy_recovery_adapters online for free by clicking the link below.
ostris accuracy_recovery_adapters online free url in huggingface.co:
accuracy_recovery_adapters is an open source model from GitHub that offers a free installation service, and any user can find accuracy_recovery_adapters on GitHub to install. At the same time, huggingface.co provides the effect of accuracy_recovery_adapters install, users can directly use accuracy_recovery_adapters installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
accuracy_recovery_adapters install url in huggingface.co: