Sponsored by
iMean AI Trip Planner
internlm / internlm-xcomposer2-vl-1_8b
Model's Last Updated: April 09 2024
visual-question-answering
Introduction of internlm-xcomposer2-vl-1_8b
Model Details of internlm-xcomposer2-vl-1_8b
InternLM-XComposer2
InternLM-XComposer2 is a vision-language large model (VLLM) based on InternLM2 for advanced text-image comprehension and composition.
We release InternLM-XComposer2 series in two versions:
- InternLM-XComposer2-VL: The pretrained VLLM model with InternLM2 as the initialization of the LLM, achieving strong performance on various multimodal benchmarks.
- InternLM-XComposer2: The finetuned VLLM for Free-from Interleaved Text-Image Composition .
Import from Transformers
To load the InternLM-XComposer2-VL-1.8B model using Transformers, use the following code:
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
ckpt_path = "internlm/internlm-xcomposer2-vl-1_8b"
tokenizer = AutoTokenizer.from_pretrained(ckpt_path, trust_remote_code=True).cuda()
# Set `torch_dtype=torch.float16` to load model in float16, otherwise it will be loaded as float32 and might cause OOM Error.
model = AutoModelForCausalLM.from_pretrained(ckpt_path, torch_dtype=torch.float16, trust_remote_code=True).cuda()
model = model.eval()
Quickstart
We provide a simple example to show how to use InternLM-XComposer with 🤗 Transformers.
import torch
from transformers import AutoModel, AutoTokenizer
torch.set_grad_enabled(False)
# init model and tokenizer
model = AutoModel.from_pretrained('internlm/internlm-xcomposer2-vl-1_8b', trust_remote_code=True).cuda().eval()
tokenizer = AutoTokenizer.from_pretrained('internlm/internlm-xcomposer2-vl-1_8b', trust_remote_code=True)
query = '<ImageHere>Please describe this image in detail.'
image = './image1.webp'
with torch.cuda.amp.autocast():
response, _ = model.chat(tokenizer, query=query, image=image, history=[], do_sample=False)
print(response)
# The image is a captivating photograph of a sunset over a mountainous landscape. The sky, painted in hues of orange and pink,
# serves as a backdrop for two silhouetted figures standing on the mountain. The text on the image, written in white, is a quote
# from Oscar Wilde, which reads, "Live life with no excuses, travel with no regret." This quote, combined with the serene setting,
# serves as a powerful reminder to embrace life's journey without hesitation or regret.
Open Source License
The code is licensed under Apache-2.0, while model weights are fully open for academic research and also allow free commercial usage. To apply for a commercial license, please fill in the application form (English)/申请表（中文）. For other questions or collaborations, please contact [email protected] .
Runs of internlm internlm-xcomposer2-vl-1_8b on huggingface.co
215
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
102
30-day runs
More Information About internlm-xcomposer2-vl-1_8b huggingface.co Model
Url of internlm-xcomposer2-vl-1_8b
internlm-xcomposer2-vl-1_8b huggingface.co Url
Provider of internlm-xcomposer2-vl-1_8b huggingface.co
Other API from internlm
Total runs:
92.9K
Run Growth:
21.3K
Growth Rate:
22.87%
Total runs:
74.4K
Run Growth:
-3.0K
Growth Rate:
-4.07%
Total runs:
56.2K
Run Growth:
22.0K
Growth Rate:
39.72%
Total runs:
47.0K
Run Growth:
1.3K
Growth Rate:
2.75%
Total runs:
32.7K
Run Growth:
3.4K
Growth Rate:
10.30%
Total runs:
21.2K
Run Growth:
1.4K
Growth Rate:
6.68%
Total runs:
21.1K
Run Growth:
1.1K
Growth Rate:
5.37%
Total runs:
17.3K
Run Growth:
325
Growth Rate:
1.88%
Total runs:
8.2K
Run Growth:
550
Growth Rate:
6.70%
Total runs:
7.8K
Run Growth:
1.4K
Growth Rate:
17.77%
Total runs:
7.6K
Run Growth:
2.2K
Growth Rate:
29.81%
Total runs:
5.6K
Run Growth:
-6
Growth Rate:
-0.11%
Total runs:
5.1K
Run Growth:
988
Growth Rate:
19.19%
Total runs:
4.3K
Run Growth:
1.3K
Growth Rate:
31.87%
Total runs:
4.2K
Run Growth:
-191
Growth Rate:
-4.51%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
-534
Growth Rate:
-18.05%
Total runs:
1.6K
Run Growth:
-134.7K
Growth Rate:
-8320.57%
Total runs:
1.6K
Run Growth:
421
Growth Rate:
26.80%
Total runs:
1.4K
Run Growth:
1.4K
Growth Rate:
100.00%
Total runs:
1.3K
Run Growth:
53
Growth Rate:
3.99%
Total runs:
1.1K
Run Growth:
584
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
-501
Growth Rate:
-49.65%
Total runs:
1.0K
Run Growth:
778
Growth Rate:
75.90%
Total runs:
894
Run Growth:
-2
Growth Rate:
-0.22%
Total runs:
855
Run Growth:
-3.0K
Growth Rate:
-356.02%
Total runs:
779
Run Growth:
469
Growth Rate:
100.00%
Total runs:
757
Run Growth:
516
Growth Rate:
68.16%
Total runs:
731
Run Growth:
731
Growth Rate:
100.00%
Total runs:
636
Run Growth:
622
Growth Rate:
100.00%
Total runs:
548
Run Growth:
-833
Growth Rate:
-148.75%
Total runs:
471
Run Growth:
-305
Growth Rate:
-64.76%
Total runs:
454
Run Growth:
0
Growth Rate:
0.00%
Total runs:
443
Run Growth:
-944
Growth Rate:
-206.56%
Total runs:
423
Run Growth:
133
Growth Rate:
31.44%
Total runs:
404
Run Growth:
257
Growth Rate:
100.00%
Total runs:
382
Run Growth:
34
Growth Rate:
8.90%
Total runs:
363
Run Growth:
69
Growth Rate:
19.01%
Total runs:
358
Run Growth:
128
Growth Rate:
35.75%
Total runs:
326
Run Growth:
0
Growth Rate:
0.00%
Total runs:
320
Run Growth:
286
Growth Rate:
89.38%
Total runs:
304
Run Growth:
5
Growth Rate:
1.64%
Total runs:
297
Run Growth:
123
Growth Rate:
41.41%
Total runs:
294
Run Growth:
59
Growth Rate:
20.07%
Total runs:
294
Run Growth:
-30
Growth Rate:
-10.20%
Total runs:
293
Run Growth:
2
Growth Rate:
0.68%
Total runs:
289
Run Growth:
113
Growth Rate:
38.05%
Total runs:
281
Run Growth:
107
Growth Rate:
39.78%
Total runs:
248
Run Growth:
0
Growth Rate:
0.00%
Total runs:
231
Run Growth:
156
Growth Rate:
67.53%
Total runs:
224
Run Growth:
-44
Growth Rate:
-20.09%
Total runs:
214
Run Growth:
73
Growth Rate:
34.11%
Total runs:
211
Run Growth:
-50
Growth Rate:
-23.70%
Total runs:
211
Run Growth:
0
Growth Rate:
0.00%
Total runs:
193
Run Growth:
89
Growth Rate:
44.72%
Total runs:
191
Run Growth:
62
Growth Rate:
31.63%
Total runs:
190
Run Growth:
25
Growth Rate:
13.16%
Total runs:
190
Run Growth:
51
Growth Rate:
26.84%
Total runs:
186
Run Growth:
31
Growth Rate:
16.67%
Total runs:
179
Run Growth:
-169
Growth Rate:
-94.41%
Total runs:
178
Run Growth:
110
Growth Rate:
61.80%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
140
Run Growth:
57
Growth Rate:
40.71%
Total runs:
136
Run Growth:
75
Growth Rate:
55.15%
Total runs:
132
Run Growth:
-35
Growth Rate:
-26.52%
Total runs:
132
Run Growth:
132
Growth Rate:
100.00%
Total runs:
124
Run Growth:
0
Growth Rate:
0.00%
Total runs:
120
Run Growth:
96
Growth Rate:
80.00%
Total runs:
109
Run Growth:
22
Growth Rate:
20.18%
Total runs:
102
Run Growth:
43
Growth Rate:
43.00%
Total runs:
102
Run Growth:
2
Growth Rate:
1.96%
Total runs:
101
Run Growth:
0
Growth Rate:
0.00%
Total runs:
92
Run Growth:
42
Growth Rate:
45.65%
Total runs:
92
Run Growth:
54
Growth Rate:
58.70%
Total runs:
91
Run Growth:
25
Growth Rate:
27.17%
Total runs:
86
Run Growth:
1
Growth Rate:
1.16%
Total runs:
86
Run Growth:
15
Growth Rate:
17.44%
Total runs:
80
Run Growth:
-63
Growth Rate:
-78.75%