Not sure of the best way to even run the base model yet, Should work where you offload the dense layers into ram and only leave the active layers in vram.
UNTESTED
I cant test this model myself as its too big.
Nucleus-Image_noreshape2Dweightonly.safetensors
This model has only the 2D non-MoE expert layers quantized to nvfp4 which should give speed to the active layers in vram without loss of the dense layers.
I will try testing this model once more support comes out for the loading methods of the model.
Nucleus-Image_transformer_aggressive_nvfp4.safetensors
This model is every layer quanted just for context reasons of what is possblie. The dense layers might be sensitive to the quant.
Runs of ApacheOne Nucleus-Image-NVFP4_mixed on huggingface.co
12
Total runs
3
24-hour runs
3
3-day runs
3
7-day runs
8
30-day runs
More Information About Nucleus-Image-NVFP4_mixed huggingface.co Model
More Nucleus-Image-NVFP4_mixed license Visit here:
Nucleus-Image-NVFP4_mixed huggingface.co is an AI model on huggingface.co that provides Nucleus-Image-NVFP4_mixed's model effect (), which can be used instantly with this ApacheOne Nucleus-Image-NVFP4_mixed model. huggingface.co supports a free trial of the Nucleus-Image-NVFP4_mixed model, and also provides paid use of the Nucleus-Image-NVFP4_mixed. Support call Nucleus-Image-NVFP4_mixed model through api, including Node.js, Python, http.
Nucleus-Image-NVFP4_mixed huggingface.co is an online trial and call api platform, which integrates Nucleus-Image-NVFP4_mixed's modeling effects, including api services, and provides a free online trial of Nucleus-Image-NVFP4_mixed, you can try Nucleus-Image-NVFP4_mixed online for free by clicking the link below.
ApacheOne Nucleus-Image-NVFP4_mixed online free url in huggingface.co:
Nucleus-Image-NVFP4_mixed is an open source model from GitHub that offers a free installation service, and any user can find Nucleus-Image-NVFP4_mixed on GitHub to install. At the same time, huggingface.co provides the effect of Nucleus-Image-NVFP4_mixed install, users can directly use Nucleus-Image-NVFP4_mixed installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Nucleus-Image-NVFP4_mixed install url in huggingface.co: