This 4bit W4A16 model has been quantized by
@Qubitum
at ModelCloud using
GPT-QModel
.
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
| Metric | EVAL |
|--------------------------------|----------|
| arc_challenge :: acc,none | 0.3046 |
| arc_challenge :: acc_norm,none | 0.3157 |
| mmlu_stem :: acc,none | 0.2915 |