Total runs:
31.5K
Run Growth:
-8.5K
Growth Rate:
-26.87%
Sponsored by
iMean AI Trip Planner
FreedomIntelligence / LongLLaVA-9B
Model's Last Updated: October 12 2024
image-text-to-text
Introduction of LongLLaVA-9B
Model Details of LongLLaVA-9B
📃 Paper • 🌐 Demo • 📃 Github • 🤗 LongLLaVA-53B-A13B
🌈 Update
- [2024.09.05] LongLLaVA repo is published！🎉
- [2024.10.12] LongLLaVA-53B-A13B , LongLLaVA-9b and Jamba-9B-Instruct are repleased！🎉
Architecture
Click to view the architecture image
Results
Click to view the Results
-
Main Results
-
Diagnostic Results
-
Video-NIAH
Results reproduction
Evaluation
- Preparation
Get the model inference code from Github .
git clone https://github.com/FreedomIntelligence/LongLLaVA.git
- Environment Setup
pip install -r requirements.txt
- Command Line Interface
python cli.py --model_dir path-to-longllava
- Model Inference
query = 'What does the picture show?'
image_paths = ['image_path1'] # image or video path
from cli import Chatbot
bot = Chatbot(path-to-longllava)
output = bot.chat(query, image_paths)
print(output) # Prints the output of the model
Acknowledgement
- LLaVA : Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Citation
@misc{wang2024longllavascalingmultimodalllms,
title={LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture},
author={Xidong Wang and Dingjie Song and Shunian Chen and Chen Zhang and Benyou Wang},
year={2024},
eprint={2409.02889},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2409.02889},
}
Runs of FreedomIntelligence LongLLaVA-9B on huggingface.co
111
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About LongLLaVA-9B huggingface.co Model
Url of LongLLaVA-9B
LongLLaVA-9B huggingface.co Url
Provider of LongLLaVA-9B huggingface.co
Other API from FreedomIntelligence
Updated:January 17 2026
Total runs:
2.1K
Run Growth:
660
Growth Rate:
31.43%
Total runs:
1.4K
Run Growth:
777
Growth Rate:
55.90%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
-186
Growth Rate:
-14.21%
Total runs:
857
Run Growth:
109
Growth Rate:
12.54%
Total runs:
833
Run Growth:
76
Growth Rate:
9.12%
Total runs:
655
Run Growth:
449
Growth Rate:
69.18%
Total runs:
643
Run Growth:
410
Growth Rate:
63.76%
Total runs:
601
Run Growth:
0
Growth Rate:
0.00%
Total runs:
545
Run Growth:
-377
Growth Rate:
-69.17%
Total runs:
497
Run Growth:
-183
Growth Rate:
-36.82%
Total runs:
486
Run Growth:
148
Growth Rate:
30.45%
Total runs:
375
Run Growth:
4
Growth Rate:
1.07%
Total runs:
328
Run Growth:
-3
Growth Rate:
-0.91%
Total runs:
307
Run Growth:
195
Growth Rate:
63.52%
Total runs:
304
Run Growth:
-105
Growth Rate:
-30.70%
Total runs:
286
Run Growth:
257
Growth Rate:
93.12%
Total runs:
274
Run Growth:
126
Growth Rate:
45.99%
Total runs:
271
Run Growth:
19
Growth Rate:
7.01%
Total runs:
260
Run Growth:
-77
Growth Rate:
-29.62%
Total runs:
240
Run Growth:
-67
Growth Rate:
-27.92%
Total runs:
206
Run Growth:
171
Growth Rate:
83.01%
Total runs:
202
Run Growth:
161
Growth Rate:
79.70%
Total runs:
165
Run Growth:
24
Growth Rate:
14.55%
Total runs:
163
Run Growth:
82
Growth Rate:
50.31%
Total runs:
161
Run Growth:
114
Growth Rate:
70.81%
Total runs:
155
Run Growth:
34
Growth Rate:
21.94%
Total runs:
155
Run Growth:
-187
Growth Rate:
-120.65%
Total runs:
148
Run Growth:
93
Growth Rate:
62.84%
Total runs:
140
Run Growth:
-6
Growth Rate:
-4.29%
Total runs:
139
Run Growth:
107
Growth Rate:
76.98%
Total runs:
135
Run Growth:
47
Growth Rate:
34.81%
Total runs:
126
Run Growth:
6
Growth Rate:
4.76%
Total runs:
120
Run Growth:
114
Growth Rate:
95.00%
Total runs:
118
Run Growth:
-77
Growth Rate:
-65.25%
Total runs:
115
Run Growth:
0
Growth Rate:
0.00%
Total runs:
113
Run Growth:
-10
Growth Rate:
-8.85%
Total runs:
106
Run Growth:
77
Growth Rate:
88.51%
Total runs:
103
Run Growth:
1
Growth Rate:
0.97%
Total runs:
102
Run Growth:
-129
Growth Rate:
-126.47%
Total runs:
100
Run Growth:
-186
Growth Rate:
-186.00%
Total runs:
98
Run Growth:
-68
Growth Rate:
-69.39%
Total runs:
97
Run Growth:
-226
Growth Rate:
-232.99%
Total runs:
96
Run Growth:
46
Growth Rate:
47.92%
Total runs:
88
Run Growth:
29
Growth Rate:
32.95%
Total runs:
87
Run Growth:
71
Growth Rate:
81.61%
Total runs:
76
Run Growth:
68
Growth Rate:
89.47%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
73
Run Growth:
-26
Growth Rate:
-35.62%
Total runs:
69
Run Growth:
11
Growth Rate:
15.94%
Total runs:
69
Run Growth:
52
Growth Rate:
75.36%
Total runs:
68
Run Growth:
-14
Growth Rate:
-20.59%
Total runs:
66
Run Growth:
0
Growth Rate:
0.00%
Total runs:
65
Run Growth:
-107
Growth Rate:
-164.62%
Total runs:
64
Run Growth:
22
Growth Rate:
34.38%
Total runs:
64
Run Growth:
7
Growth Rate:
10.94%
Total runs:
62
Run Growth:
-70
Growth Rate:
-112.90%
Total runs:
57
Run Growth:
25
Growth Rate:
43.86%
Total runs:
56
Run Growth:
43
Growth Rate:
76.79%
Total runs:
55
Run Growth:
19
Growth Rate:
34.55%
Total runs:
53
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
-858
Growth Rate:
-1716.00%
Total runs:
49
Run Growth:
1
Growth Rate:
2.04%
Total runs:
46
Run Growth:
-86
Growth Rate:
-186.96%
Total runs:
44
Run Growth:
44
Growth Rate:
100.00%
Total runs:
43
Run Growth:
16
Growth Rate:
37.21%
Total runs:
42
Run Growth:
22
Growth Rate:
52.38%
Total runs:
42
Run Growth:
14
Growth Rate:
33.33%
Total runs:
41
Run Growth:
8
Growth Rate:
19.51%
Total runs:
40
Run Growth:
-37
Growth Rate:
-92.50%
Total runs:
38
Run Growth:
11
Growth Rate:
32.35%
Total runs:
35
Run Growth:
8
Growth Rate:
22.86%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
-3
Growth Rate:
-8.57%
Total runs:
33
Run Growth:
16
Growth Rate:
53.33%
Total runs:
33
Run Growth:
17
Growth Rate:
51.52%
Total runs:
31
Run Growth:
5
Growth Rate:
16.13%
Total runs:
30
Run Growth:
25
Growth Rate:
83.33%
Total runs:
30
Run Growth:
12
Growth Rate:
40.00%
Total runs:
29
Run Growth:
-23
Growth Rate:
-79.31%
Total runs:
28
Run Growth:
9
Growth Rate:
32.14%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
7
Growth Rate:
28.00%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
24
Run Growth:
13
Growth Rate:
54.17%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
22
Run Growth:
10
Growth Rate:
45.45%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
9
Growth Rate:
42.86%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
3
Growth Rate:
18.75%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%