This is a text-and-image-only GGUF quantization of moonshotai/Kimi-K2.7-Code. This means that video input is not present in this GGUF, and will not be available until support is added upstream in llama.cpp. MMPROJ files for image vision input have been provided.
This Q4_X quant is the "full quality" equivalent since the conditional experts are natively INT4 quantized directly from the original model, and the rest of the model is Q8_0.
Quant
Size
Mixture
PPL
1-(Mean PPL(Q)/PPL(base))
KLD
Q4_X
543.62 GiB (4.55 BPW)
Q8_0 / Q4_0 / Q4_0 / Q4_0
2.009155 ± 0.008931
+0%
0
Q3_K_L
459.94 GiB (3.85 BPW)
Q8_0 / Q3_K / Q3_K / Q4_0
2.118293 ± 0.009633
+5.5655%
0.072403 ± 0.000616
Runs of AesSedai Kimi-K2.7-Code-GGUF on huggingface.co
1.7K
Total runs
163
24-hour runs
29
3-day runs
134
7-day runs
-788
30-day runs
More Information About Kimi-K2.7-Code-GGUF huggingface.co Model
Kimi-K2.7-Code-GGUF huggingface.co
Kimi-K2.7-Code-GGUF huggingface.co is an AI model on huggingface.co that provides Kimi-K2.7-Code-GGUF's model effect (), which can be used instantly with this AesSedai Kimi-K2.7-Code-GGUF model. huggingface.co supports a free trial of the Kimi-K2.7-Code-GGUF model, and also provides paid use of the Kimi-K2.7-Code-GGUF. Support call Kimi-K2.7-Code-GGUF model through api, including Node.js, Python, http.
Kimi-K2.7-Code-GGUF huggingface.co is an online trial and call api platform, which integrates Kimi-K2.7-Code-GGUF's modeling effects, including api services, and provides a free online trial of Kimi-K2.7-Code-GGUF, you can try Kimi-K2.7-Code-GGUF online for free by clicking the link below.
AesSedai Kimi-K2.7-Code-GGUF online free url in huggingface.co:
Kimi-K2.7-Code-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Kimi-K2.7-Code-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Kimi-K2.7-Code-GGUF install, users can directly use Kimi-K2.7-Code-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Kimi-K2.7-Code-GGUF install url in huggingface.co: