This repository hosts quantized versions of the Phi-3-Medium-4K-Instruct model.
Format:
GGUF
Converter:
llama.cpp afbb4c1322a747d2a7b4bf67c868148f8afcc6c8
Quantizer:
LM-Kit.NET 2024.7.10
For more detailed information on the base model, please visit the following links:
Need other versions? Please reach out to us at
https://lm-kit.com/contact/
or submit a request in the Community tab.