FreedomIntelligence / LongLLaVA-53B-A13B

huggingface.co
Total runs: 74
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: November 28 2024
image-text-to-text

Introduction of LongLLaVA-53B-A13B

Model Details of LongLLaVA-53B-A13B

header

📃 Paper • 🌐 Demo • 📃 Github • 🤗 LongLLaVA-9B

efficiency

🌈 Update
Architecture
Click to view the architecture image

Architecture Image

Results
Click to view the Results
  • Main Results Main Results
  • Diagnostic Results Diagnostic Results
  • Video-NIAH Video-NIAH
Results reproduction
Evaluation
  • Preparation

Get the model inference code from Github .

git clone https://github.com/FreedomIntelligence/LongLLaVA.git
  • Environment Setup
pip install -r requirements.txt
  • Command Line Interface
python cli.py --model_dir path-to-longllava
  • Model Inference
query = 'What does the picture show?'
image_paths = ['image_path1'] # image or video path

from cli import Chatbot
bot = Chatbot(path-to-longllava)
output = bot.chat(query, image_paths)
print(output) # Prints the output of the model
Acknowledgement
  • LLaVA : Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Citation
@misc{wang2024longllavascalingmultimodalllms,
      title={LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture}, 
      author={Xidong Wang and Dingjie Song and Shunian Chen and Chen Zhang and Benyou Wang},
      year={2024},
      eprint={2409.02889},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2409.02889}, 
}

Runs of FreedomIntelligence LongLLaVA-53B-A13B on huggingface.co

74
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About LongLLaVA-53B-A13B huggingface.co Model

More LongLLaVA-53B-A13B license Visit here:

https://choosealicense.com/licenses/mit

LongLLaVA-53B-A13B huggingface.co

LongLLaVA-53B-A13B huggingface.co is an AI model on huggingface.co that provides LongLLaVA-53B-A13B's model effect (), which can be used instantly with this FreedomIntelligence LongLLaVA-53B-A13B model. huggingface.co supports a free trial of the LongLLaVA-53B-A13B model, and also provides paid use of the LongLLaVA-53B-A13B. Support call LongLLaVA-53B-A13B model through api, including Node.js, Python, http.

FreedomIntelligence LongLLaVA-53B-A13B online free

LongLLaVA-53B-A13B huggingface.co is an online trial and call api platform, which integrates LongLLaVA-53B-A13B's modeling effects, including api services, and provides a free online trial of LongLLaVA-53B-A13B, you can try LongLLaVA-53B-A13B online for free by clicking the link below.

FreedomIntelligence LongLLaVA-53B-A13B online free url in huggingface.co:

https://huggingface.co/FreedomIntelligence/LongLLaVA-53B-A13B

LongLLaVA-53B-A13B install

LongLLaVA-53B-A13B is an open source model from GitHub that offers a free installation service, and any user can find LongLLaVA-53B-A13B on GitHub to install. At the same time, huggingface.co provides the effect of LongLLaVA-53B-A13B install, users can directly use LongLLaVA-53B-A13B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LongLLaVA-53B-A13B install url in huggingface.co:

https://huggingface.co/FreedomIntelligence/LongLLaVA-53B-A13B

Url of LongLLaVA-53B-A13B

Provider of LongLLaVA-53B-A13B huggingface.co

FreedomIntelligence
ORGANIZATIONS

Other API from FreedomIntelligence