FreedomIntelligence / LongLLaVAMed-9B

huggingface.co
Total runs: 601
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: November 08 2024
image-text-to-text

Introduction of LongLLaVAMed-9B

Model Details of LongLLaVAMed-9B

header

📃 Paper • 🌐 Demo • 📃 Github • 🤗 LongLLaVA-53B-A13B

efficiency

🌈 Update
Architecture
Click to view the architecture image

Architecture Image

Results
Click to view the Results
  • Main Results Main Results
  • Diagnostic Results Diagnostic Results
  • Video-NIAH Video-NIAH
Results reproduction
Evaluation
  • Preparation

Get the model inference code from Github .

git clone https://github.com/FreedomIntelligence/LongLLaVA.git
  • Environment Setup
pip install -r requirements.txt
  • Command Line Interface
python cli.py --model_dir path-to-longllava
  • Model Inference
query = 'What does the picture show?'
image_paths = ['image_path1'] # image or video path

from cli import Chatbot
bot = Chatbot(path-to-longllava)
output = bot.chat(query, image_paths)
print(output) # Prints the output of the model
Acknowledgement
  • LLaVA : Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Citation
@misc{wang2024longllavascalingmultimodalllms,
      title={LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture}, 
      author={Xidong Wang and Dingjie Song and Shunian Chen and Chen Zhang and Benyou Wang},
      year={2024},
      eprint={2409.02889},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2409.02889}, 
}

Runs of FreedomIntelligence LongLLaVAMed-9B on huggingface.co

601
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About LongLLaVAMed-9B huggingface.co Model

More LongLLaVAMed-9B license Visit here:

https://choosealicense.com/licenses/mit

LongLLaVAMed-9B huggingface.co

LongLLaVAMed-9B huggingface.co is an AI model on huggingface.co that provides LongLLaVAMed-9B's model effect (), which can be used instantly with this FreedomIntelligence LongLLaVAMed-9B model. huggingface.co supports a free trial of the LongLLaVAMed-9B model, and also provides paid use of the LongLLaVAMed-9B. Support call LongLLaVAMed-9B model through api, including Node.js, Python, http.

FreedomIntelligence LongLLaVAMed-9B online free

LongLLaVAMed-9B huggingface.co is an online trial and call api platform, which integrates LongLLaVAMed-9B's modeling effects, including api services, and provides a free online trial of LongLLaVAMed-9B, you can try LongLLaVAMed-9B online for free by clicking the link below.

FreedomIntelligence LongLLaVAMed-9B online free url in huggingface.co:

https://huggingface.co/FreedomIntelligence/LongLLaVAMed-9B

LongLLaVAMed-9B install

LongLLaVAMed-9B is an open source model from GitHub that offers a free installation service, and any user can find LongLLaVAMed-9B on GitHub to install. At the same time, huggingface.co provides the effect of LongLLaVAMed-9B install, users can directly use LongLLaVAMed-9B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LongLLaVAMed-9B install url in huggingface.co:

https://huggingface.co/FreedomIntelligence/LongLLaVAMed-9B

Url of LongLLaVAMed-9B

Provider of LongLLaVAMed-9B huggingface.co

FreedomIntelligence
ORGANIZATIONS

Other API from FreedomIntelligence