OneFormer trains one model on semantic, instance, and panoptic segmentation jointly, conditioned on a text token that names the task. At inference you pass
task="semantic"
,
"instance"
, or
"panoptic"
to the same weights. The processor combines an image processor and a tokenizer for that task token.
For more details on the model, please go to SHI Labs' original
model card
.
This is a
universal segmentation
checkpoint (
OneFormerUniversalSegment
) trained on
Cityscapes
(19 classes, Swin-Large). All three tasks share these weights.
✨ Quick start
import os
os.environ["KERAS_BACKEND"] = "torch"# or "jax" / "tensorflow"from PIL import Image
from zeromodels.models.oneformer import (
OneFormerUniversalSegment,
OneFormerProcessor,
)
model = OneFormerUniversalSegment.from_weights("zeromodels/oneformer_cityscapes_swin_large")
processor = OneFormerProcessor.from_weights("zeromodels/oneformer_cityscapes_swin_large")
image = Image.open("your_image.jpg").convert("RGB")
# task is an argument: "semantic" | "instance" | "panoptic"
inputs = processor(images=image, task="panoptic")
output = model(inputs)
result = processor.post_process_panoptic_segmentation(
output, target_size=(image.height, image.width)
)
print(result["segmentation"].shape)
Load any OneFormer variant the same way with
from_weights("zeromodels/<variant>")
:
Community / upstream safetensors still work via the
hf:
prefix, e.g.
OneFormerUniversalSegment.from_weights("hf:shi-labs/oneformer_cityscapes_swin_large")
.
Special Thanks
A huge thank you to the SHI Labs OneFormer authors for creating and releasing these models.
License: MIT.
Runs of zeromodels oneformer_cityscapes_swin_large on huggingface.co
32
Total runs
-1
24-hour runs
-1
3-day runs
-10
7-day runs
-1
30-day runs
More Information About oneformer_cityscapes_swin_large huggingface.co Model
More oneformer_cityscapes_swin_large license Visit here:
oneformer_cityscapes_swin_large huggingface.co is an AI model on huggingface.co that provides oneformer_cityscapes_swin_large's model effect (), which can be used instantly with this zeromodels oneformer_cityscapes_swin_large model. huggingface.co supports a free trial of the oneformer_cityscapes_swin_large model, and also provides paid use of the oneformer_cityscapes_swin_large. Support call oneformer_cityscapes_swin_large model through api, including Node.js, Python, http.
oneformer_cityscapes_swin_large huggingface.co is an online trial and call api platform, which integrates oneformer_cityscapes_swin_large's modeling effects, including api services, and provides a free online trial of oneformer_cityscapes_swin_large, you can try oneformer_cityscapes_swin_large online for free by clicking the link below.
zeromodels oneformer_cityscapes_swin_large online free url in huggingface.co:
oneformer_cityscapes_swin_large is an open source model from GitHub that offers a free installation service, and any user can find oneformer_cityscapes_swin_large on GitHub to install. At the same time, huggingface.co provides the effect of oneformer_cityscapes_swin_large install, users can directly use oneformer_cityscapes_swin_large installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
oneformer_cityscapes_swin_large install url in huggingface.co: