EpistemeAI / OpenMedResearch-Gemma-4E4N-8bit

OpenMedResearch-Gemma-4E4N-8bit : GGUF

This model was finetuned and converted to GGUF format using Unsloth .

Example usage :

• For text only LLMs: llama-cli -hf EpistemeAI/OpenMedResearch-Gemma-4E4N-8bit --jinja
• For multimodal models: llama-mtmd-cli -hf EpistemeAI/OpenMedResearch-Gemma-4E4N-8bit --jinja

Available Model files:

• gemma-4-E4B-it.Q8_0.gguf
• gemma-4-E4B-it.BF16-mmproj.gguf

⚠️ Ollama Note for Vision Models

Important: Ollama currently does not support separate mmproj files for vision models.

To create an Ollama model from this vision model:

1. Place the Modelfile in the same directory as the finetuned bf16 merged model
2. Run: ollama create model_name -f ./Modelfile (Replace model_name with your desired name)

This will create a unified bf16 model that Ollama can use. This was trained 2x faster with Unsloth

Reference

@misc{burgess2026papersearchqalearningsearchreason,
      title={PaperSearchQA: Learning to Search and Reason over Scientific Papers with RLVR},
      author={James Burgess and Jan N. Hansen and Duo Peng and Yuhui Zhang and Alejandro Lozano and Min Woo Sun and Emma Lundberg and Serena Yeung-Levy},
      year={2026},
      eprint={2601.18207},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2601.18207},
}