FreedomIntelligence / HuatuoGPT-Vision-34B

huggingface.co
Total runs: 122
24-hour runs: 0
7-day runs: 15
30-day runs: -5
Model's Last Updated: Juillet 03 2024
image-text-to-text

Introduction of HuatuoGPT-Vision-34B

Model Details of HuatuoGPT-Vision-34B

HuatuoGPT-Vision-34B

Introduction

HuatuoGPT-Vision is a multimodal LLM for medical applications, built with the PubMedVision dataset . HuatuoGPT-Vision-34B is trained based on Yi-1.5-34B using the LLaVA-v1.5 architecture.

Quick Start

  1. Get the model inference code from Github .
git clone https://github.com/FreedomIntelligence/HuatuoGPT-Vision.git
  1. Model inference
query = 'What does the picture show?'
image_paths = ['image_path1']

from cli import HuatuoChatbot
bot = HuatuoChatbot(huatuogpt_vision_model_path) # loads the model 
output = bot.inference(query, image_paths) # generates
print(output)  # Prints the model output

Citation

@misc{chen2024huatuogptvisioninjectingmedicalvisual,
      title={HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale}, 
      author={Junying Chen and Ruyi Ouyang and Anningzhe Gao and Shunian Chen and Guiming Hardy Chen and Xidong Wang and Ruifei Zhang and Zhenyang Cai and Ke Ji and Guangjun Yu and Xiang Wan and Benyou Wang},
      year={2024},
      eprint={2406.19280},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2406.19280}, 
}

Runs of FreedomIntelligence HuatuoGPT-Vision-34B on huggingface.co

122
Total runs
0
24-hour runs
6
3-day runs
15
7-day runs
-5
30-day runs

More Information About HuatuoGPT-Vision-34B huggingface.co Model

More HuatuoGPT-Vision-34B license Visit here:

https://choosealicense.com/licenses/apache-2.0

HuatuoGPT-Vision-34B huggingface.co

HuatuoGPT-Vision-34B huggingface.co is an AI model on huggingface.co that provides HuatuoGPT-Vision-34B's model effect (), which can be used instantly with this FreedomIntelligence HuatuoGPT-Vision-34B model. huggingface.co supports a free trial of the HuatuoGPT-Vision-34B model, and also provides paid use of the HuatuoGPT-Vision-34B. Support call HuatuoGPT-Vision-34B model through api, including Node.js, Python, http.

FreedomIntelligence HuatuoGPT-Vision-34B online free

HuatuoGPT-Vision-34B huggingface.co is an online trial and call api platform, which integrates HuatuoGPT-Vision-34B's modeling effects, including api services, and provides a free online trial of HuatuoGPT-Vision-34B, you can try HuatuoGPT-Vision-34B online for free by clicking the link below.

FreedomIntelligence HuatuoGPT-Vision-34B online free url in huggingface.co:

https://huggingface.co/FreedomIntelligence/HuatuoGPT-Vision-34B

HuatuoGPT-Vision-34B install

HuatuoGPT-Vision-34B is an open source model from GitHub that offers a free installation service, and any user can find HuatuoGPT-Vision-34B on GitHub to install. At the same time, huggingface.co provides the effect of HuatuoGPT-Vision-34B install, users can directly use HuatuoGPT-Vision-34B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

HuatuoGPT-Vision-34B install url in huggingface.co:

https://huggingface.co/FreedomIntelligence/HuatuoGPT-Vision-34B

Url of HuatuoGPT-Vision-34B

Provider of HuatuoGPT-Vision-34B huggingface.co

FreedomIntelligence
ORGANIZATIONS

Other API from FreedomIntelligence