will get error : RuntimeError: mat1 and mat2 shapes cannot be multiplied (601x3072 and 1536x9216)
BROKEN
for now
ministral-3-3b.safetensors
only the text tensors are quanted the vision tesnors are kept at BF16
text_encoder folder
only the quanted text layer part of the model
text_encoder_full folder
same as ministral-3-3b.safetensors just with configs
Runs of ApacheOne ministral-3-3b-nvfp4_mixed on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About ministral-3-3b-nvfp4_mixed huggingface.co Model
ministral-3-3b-nvfp4_mixed huggingface.co
ministral-3-3b-nvfp4_mixed huggingface.co is an AI model on huggingface.co that provides ministral-3-3b-nvfp4_mixed's model effect (), which can be used instantly with this ApacheOne ministral-3-3b-nvfp4_mixed model. huggingface.co supports a free trial of the ministral-3-3b-nvfp4_mixed model, and also provides paid use of the ministral-3-3b-nvfp4_mixed. Support call ministral-3-3b-nvfp4_mixed model through api, including Node.js, Python, http.
ministral-3-3b-nvfp4_mixed huggingface.co is an online trial and call api platform, which integrates ministral-3-3b-nvfp4_mixed's modeling effects, including api services, and provides a free online trial of ministral-3-3b-nvfp4_mixed, you can try ministral-3-3b-nvfp4_mixed online for free by clicking the link below.
ApacheOne ministral-3-3b-nvfp4_mixed online free url in huggingface.co:
ministral-3-3b-nvfp4_mixed is an open source model from GitHub that offers a free installation service, and any user can find ministral-3-3b-nvfp4_mixed on GitHub to install. At the same time, huggingface.co provides the effect of ministral-3-3b-nvfp4_mixed install, users can directly use ministral-3-3b-nvfp4_mixed installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ministral-3-3b-nvfp4_mixed install url in huggingface.co: