Total runs:
1.8M
Run Growth:
-325.6K
Growth Rate:
-18.15%
Sponsored by
YouArt
Salesforce / instructblip-flan-t5-xxl
Model's Last Updated: February 03 2025
image-text-to-text
Introduction of instructblip-flan-t5-xxl
Model Details of instructblip-flan-t5-xxl
InstructBLIP model
InstructBLIP model using Flan-T5-xxl as language model. InstructBLIP was introduced in the paper InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning by Dai et al.
Disclaimer: The team releasing InstructBLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
InstructBLIP is a visual instruction tuned version of BLIP-2 . Refer to the paper for details.
Intended uses & limitations
Usage is as follows:
from transformers import InstructBlipProcessor, InstructBlipForConditionalGeneration
import torch
from PIL import Image
import requests
model = InstructBlipForConditionalGeneration.from_pretrained("Salesforce/instructblip-flan-t5-xxl")
processor = InstructBlipProcessor.from_pretrained("Salesforce/instructblip-flan-t5-xxl")
device = "cuda" if torch.cuda.is_available() else "cpu"
model.to(device)
url = "https://raw.githubusercontent.com/salesforce/LAVIS/main/docs/_static/Confusing-Pictures.jpg"
image = Image.open(requests.get(url, stream=True).raw).convert("RGB")
prompt = "What is unusual about this image?"
inputs = processor(images=image, text=prompt, return_tensors="pt").to(device)
outputs = model.generate(
**inputs,
do_sample=False,
num_beams=5,
max_length=256,
min_length=1,
top_p=0.9,
repetition_penalty=1.5,
length_penalty=1.0,
temperature=1,
)
generated_text = processor.batch_decode(outputs, skip_special_tokens=True)[0].strip()
print(generated_text)
How to use
For code examples, we refer to the documentation .
Runs of Salesforce instructblip-flan-t5-xxl on huggingface.co
295
Total runs
0
24-hour runs
39
3-day runs
105
7-day runs
38
30-day runs
More Information About instructblip-flan-t5-xxl huggingface.co Model
Url of instructblip-flan-t5-xxl
instructblip-flan-t5-xxl huggingface.co Url
Provider of instructblip-flan-t5-xxl huggingface.co
Other API from Salesforce
Updated:February 03 2025
Total runs:
932.1K
Run Growth:
-220.3K
Growth Rate:
-23.63%
Total runs:
664.5K
Run Growth:
118.4K
Growth Rate:
17.83%
Total runs:
598.8K
Run Growth:
101.4K
Growth Rate:
16.93%
Total runs:
539.0K
Run Growth:
8.2K
Growth Rate:
1.52%
Total runs:
514.6K
Run Growth:
33.8K
Growth Rate:
6.57%
Total runs:
221.3K
Run Growth:
17.1K
Growth Rate:
7.71%
Total runs:
180.0K
Run Growth:
35.3K
Growth Rate:
19.62%
Total runs:
144.0K
Run Growth:
-99.5K
Growth Rate:
-69.08%
Total runs:
130.6K
Run Growth:
-236
Growth Rate:
-0.18%
Total runs:
122.7K
Run Growth:
42.9K
Growth Rate:
33.83%
Total runs:
97.1K
Run Growth:
37.6K
Growth Rate:
38.70%
Total runs:
93.6K
Run Growth:
48.3K
Growth Rate:
51.57%
Total runs:
48.0K
Run Growth:
4.1K
Growth Rate:
8.46%
Total runs:
37.0K
Run Growth:
37.0K
Growth Rate:
99.94%
Total runs:
33.9K
Run Growth:
8.4K
Growth Rate:
24.56%
Total runs:
33.1K
Run Growth:
15.5K
Growth Rate:
46.97%
Total runs:
32.8K
Run Growth:
28.0K
Growth Rate:
85.48%
Total runs:
23.1K
Run Growth:
-2.0K
Growth Rate:
-8.72%
Total runs:
18.8K
Run Growth:
2.2K
Growth Rate:
11.61%
Total runs:
18.2K
Run Growth:
4.1K
Growth Rate:
22.55%
Total runs:
17.9K
Run Growth:
-53.1K
Growth Rate:
-296.70%
Total runs:
17.5K
Run Growth:
515
Growth Rate:
2.95%
Total runs:
17.4K
Run Growth:
-27.2K
Growth Rate:
-156.30%
Total runs:
15.5K
Run Growth:
-15.4K
Growth Rate:
-99.01%
Total runs:
13.4K
Run Growth:
-8.5K
Growth Rate:
-63.96%
Total runs:
12.4K
Run Growth:
9.4K
Growth Rate:
75.93%
Total runs:
12.3K
Run Growth:
5.7K
Growth Rate:
46.13%
Total runs:
11.8K
Run Growth:
-2.2K
Growth Rate:
-18.70%
Total runs:
11.1K
Run Growth:
-71.6K
Growth Rate:
-645.75%
Total runs:
9.9K
Run Growth:
-1.3K
Growth Rate:
-12.87%
Total runs:
7.2K
Run Growth:
4.3K
Growth Rate:
60.37%
Total runs:
6.2K
Run Growth:
4.7K
Growth Rate:
75.74%
Total runs:
3.5K
Run Growth:
-170
Growth Rate:
-4.84%
Total runs:
3.5K
Run Growth:
2.1K
Growth Rate:
60.11%
Total runs:
3.2K
Run Growth:
-2.2K
Growth Rate:
-70.52%
Total runs:
2.3K
Run Growth:
365
Growth Rate:
15.93%
Total runs:
2.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.1K
Run Growth:
1.3K
Growth Rate:
60.34%
Total runs:
1.5K
Run Growth:
183
Growth Rate:
11.88%
Total runs:
1.2K
Run Growth:
-4.8K
Growth Rate:
-416.31%
Total runs:
1.2K
Run Growth:
551
Growth Rate:
47.54%
Total runs:
1.0K
Run Growth:
-290
Growth Rate:
-28.32%
Total runs:
946
Run Growth:
312
Growth Rate:
30.32%
Total runs:
899
Run Growth:
-328
Growth Rate:
-36.48%
Total runs:
832
Run Growth:
663
Growth Rate:
79.21%
Total runs:
772
Run Growth:
-429
Growth Rate:
-55.57%
Total runs:
748
Run Growth:
-58
Growth Rate:
-7.75%
Total runs:
741
Run Growth:
-80
Growth Rate:
-10.80%
Total runs:
670
Run Growth:
106
Growth Rate:
15.82%
Total runs:
611
Run Growth:
-63
Growth Rate:
-10.31%
Total runs:
594
Run Growth:
89
Growth Rate:
14.98%
Total runs:
550
Run Growth:
38
Growth Rate:
6.75%
Total runs:
540
Run Growth:
433
Growth Rate:
80.19%
Total runs:
540
Run Growth:
-1.3K
Growth Rate:
-230.22%
Total runs:
532
Run Growth:
92
Growth Rate:
17.29%
Total runs:
414
Run Growth:
146
Growth Rate:
35.27%
Total runs:
409
Run Growth:
-221
Growth Rate:
-54.03%
Total runs:
392
Run Growth:
-18
Growth Rate:
-4.59%
Total runs:
355
Run Growth:
89
Growth Rate:
25.07%
Total runs:
354
Run Growth:
107
Growth Rate:
30.23%
Total runs:
352
Run Growth:
-857
Growth Rate:
-243.47%
Total runs:
343
Run Growth:
-26
Growth Rate:
-7.58%
Total runs:
313
Run Growth:
-711
Growth Rate:
-227.16%
Total runs:
313
Run Growth:
28
Growth Rate:
8.95%
Total runs:
309
Run Growth:
168
Growth Rate:
54.37%
Total runs:
293
Run Growth:
-19
Growth Rate:
-6.48%
Total runs:
281
Run Growth:
-7
Growth Rate:
-2.49%
Total runs:
269
Run Growth:
-328
Growth Rate:
-121.93%
Total runs:
250
Run Growth:
238
Growth Rate:
95.20%
Total runs:
248
Run Growth:
-510
Growth Rate:
-205.65%
Total runs:
243
Run Growth:
20
Growth Rate:
8.23%
Total runs:
185
Run Growth:
-28
Growth Rate:
-15.14%
Total runs:
173
Run Growth:
42
Growth Rate:
24.28%
Total runs:
161
Run Growth:
-129
Growth Rate:
-80.12%
Total runs:
159
Run Growth:
43
Growth Rate:
27.04%
Total runs:
155
Run Growth:
40
Growth Rate:
25.81%
Total runs:
150
Run Growth:
-7
Growth Rate:
-4.67%
Total runs:
149
Run Growth:
-39
Growth Rate:
-26.17%
Total runs:
143
Run Growth:
23
Growth Rate:
16.08%
Total runs:
130
Run Growth:
67
Growth Rate:
51.54%
Total runs:
102
Run Growth:
-638
Growth Rate:
-625.49%
Total runs:
89
Run Growth:
28
Growth Rate:
31.46%