Total runs:
413
Run Growth:
88
Growth Rate:
21.31%
Sponsored by
Vmake Labs Video Enhancer
merve / kosmos-2.5-ft
Model's Last Updated: September 11 2025
image-text-to-text
Introduction of kosmos-2.5-ft
Model Details of kosmos-2.5-ft
Kosmos-2.5 Fine-tuned on DocLayNet
Kosmos-2.5 fine-tuned on grounded OCR (OCR with bounding boxes), find the script here: ( GH , HF )
Try the (base model) Kosmos-2.5 demo here .
Here's the inference code:
from transformers import AutoProcessor, Kosmos2_5ForConditionalGeneration
import torch
model = Kosmos2_5ForConditionalGeneration.from_pretrained("merve/kosmos-2.5-ft", device_map="cuda", dtype=torch.bfloat16)
processor = AutoProcessor.from_pretrained("microsoft/kosmos-2.5")
import requests
from PIL import Image
url = "https://huggingface.co/datasets/merve/vlm_test_images/resolve/main/ufo-sighting.jpg"
image = Image.open(requests.get(url, stream=True).raw)
import re
prompt = "<ocr>"
inputs = processor(text=prompt, images=image, return_tensors="pt")
height, width = inputs.pop("height"), inputs.pop("width")
raw_width, raw_height = image.size
scale_height = raw_height / height
scale_width = raw_width / width
inputs = {k: v.to("cuda") if v is not None else None for k, v in inputs.items()}
inputs["flattened_patches"] = inputs["flattened_patches"].to(torch.bfloat16)
generated_ids = model.generate(
**inputs,
max_new_tokens=2000,
)
generated_text = processor.batch_decode(generated_ids, skip_special_tokens=True)
import re
from PIL import ImageDraw
def post_process(y, scale_height, scale_width):
pattern = r"<bbox><x_\d+><y_\d+><x_\d+><y_\d+></bbox>"
bboxes_raw = re.findall(pattern, y)
lines = re.split(pattern, y)[1:]
bboxes = [list(map(int, re.findall(r"\d+", bb))) for bb in bboxes_raw]
out_lines = []
for i, box in enumerate(bboxes):
if len(box) != 4:
continue
x0, y0, x1, y1 = box
if x0 >= x1 or y0 >= y1:
continue
sx0 = int(x0 * scale_width)
sy0 = int(y0 * scale_height)
sx1 = int(x1 * scale_width)
sy1 = int(y1 * scale_height)
label = lines[i] if i < len(lines) else ""
label = label.lstrip(", ").strip()
out_lines.append(f"{sx0},{sy0},{sx1},{sy0},{sx1},{sy1},{sx0},{sy1},{label}")
return "\n".join(out_lines)
output_text = post_process(generated_text[0], scale_height, scale_width)
print(output_text)
draw = ImageDraw.Draw(image)
for line in output_text.strip().splitlines():
coords = re.findall(r"-?\d+", line)[:8]
if len(coords) < 8:
continue
xy = list(map(int, coords))
draw.polygon(xy, outline="red")
image.save("output.png")
The image and the text (shortened here) output:
338,17,673,17,673,82,338,82,CONFIDENTIAL
445,68,478,68,478,97,445,97,-2-
169,129,193,129,193,157,169,157,6.
334,129,910,129,910,157,334,157,A suggestion that the light could have been produced by
169,150,900,150,900,177,169,177,a photo-flash from a high-flying aircraft was discounted. No aircraft
166,171,856,171,856,198,166,198,was heard at the time and, in any case, no known photo-flash has a
...
Runs of merve kosmos-2.5-ft on huggingface.co
11
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
-2
30-day runs
More Information About kosmos-2.5-ft huggingface.co Model
Url of kosmos-2.5-ft
kosmos-2.5-ft huggingface.co Url
Provider of kosmos-2.5-ft huggingface.co
Other API from merve
Updated:May 26 2026
Total runs:
168
Run Growth:
94
Growth Rate:
55.95%
Total runs:
121
Run Growth:
48
Growth Rate:
39.67%
Total runs:
120
Run Growth:
55
Growth Rate:
45.83%
Total runs:
107
Run Growth:
5
Growth Rate:
4.67%
Total runs:
100
Run Growth:
51
Growth Rate:
51.00%
Total runs:
96
Run Growth:
0
Growth Rate:
0.00%
Total runs:
56
Run Growth:
47
Growth Rate:
83.93%
Total runs:
48
Run Growth:
48
Growth Rate:
100.00%
Total runs:
47
Run Growth:
-12
Growth Rate:
-25.53%
Total runs:
38
Run Growth:
-4
Growth Rate:
-10.53%
Total runs:
37
Run Growth:
0
Growth Rate:
0.00%
Total runs:
37
Run Growth:
22
Growth Rate:
59.46%
Total runs:
33
Run Growth:
-3
Growth Rate:
-9.09%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
13
Growth Rate:
68.42%
Total runs:
17
Run Growth:
-3
Growth Rate:
-17.65%
Total runs:
16
Run Growth:
13
Growth Rate:
72.22%
Total runs:
15
Run Growth:
-311
Growth Rate:
-2073.33%
Total runs:
15
Run Growth:
-13
Growth Rate:
-76.47%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%
Total runs:
15
Run Growth:
7
Growth Rate:
43.75%
Total runs:
13
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
13
Run Growth:
9
Growth Rate:
69.23%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
13
Run Growth:
9
Growth Rate:
64.29%
Total runs:
11
Run Growth:
-3
Growth Rate:
-27.27%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-15
Growth Rate:
-136.36%
Total runs:
9
Run Growth:
-8
Growth Rate:
-88.89%
Total runs:
9
Run Growth:
8
Growth Rate:
80.00%
Total runs:
7
Run Growth:
-12
Growth Rate:
-171.43%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
1
Growth Rate:
12.50%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%