calcuis / phi4

GGUF quantized and bug fixed version of phi4

review

• bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
• define the architecture (from none) to llama; all works right away

run the model

use any gguf connector to interact with gguf file(s), i.e., connector

reference

• base model: microsoft/ phi-4
• bug fixed following the guide written by unsloth
• tool used for quantization: cutter

citation

Phi-4 Technical Report

appendices: model summary and quality (written by microsoft)

model summary

model quality

to understand the capabilities, we (here refer to microsoft side) compare phi-4 with a set of models over OpenAI’s SimpleEval benchmark; at the high-level overview of the model quality on representative benchmarks; for the table below, higher numbers indicate better performance:

* these scores are lower than those reported by Meta, perhaps because simple-evals has a strict formatting requirement that Llama models have particular trouble following.