OneFormer trains one model on semantic, instance, and panoptic segmentation jointly, conditioned on a text token that names the task. At inference you pass
task="semantic"
,
"instance"
, or
"panoptic"
to the same weights. The processor combines an image processor and a tokenizer for that task token.
For more details on the model, please go to SHI Labs' original
model card
.
This is a
universal segmentation
checkpoint (
OneFormerUniversalSegment
) trained on
ADE20K
(150 classes, Swin-Large). All three tasks share these weights.
✨ Quick start
import os
os.environ["KERAS_BACKEND"] = "torch"# or "jax" / "tensorflow"from PIL import Image
from kerasformers.models.oneformer import (
OneFormerUniversalSegment,
OneFormerProcessor,
)
model = OneFormerUniversalSegment.from_weights("kerasformers/oneformer_ade20k_swin_large")
processor = OneFormerProcessor.from_weights("kerasformers/oneformer_ade20k_swin_large")
image = Image.open("your_image.jpg").convert("RGB")
# task is an argument: "semantic" | "instance" | "panoptic"
inputs = processor(images=image, task="panoptic")
output = model(inputs)
result = processor.post_process_panoptic_segmentation(
output, target_size=(image.height, image.width)
)
print(result["segmentation"].shape)
Load any OneFormer variant the same way with
from_weights("kerasformers/<variant>")
:
Community / upstream safetensors still work via the
hf:
prefix, e.g.
OneFormerUniversalSegment.from_weights("hf:shi-labs/oneformer_ade20k_swin_large")
.
Special Thanks
A huge thank you to the SHI Labs OneFormer authors for creating and releasing these models.
License: MIT.
Runs of zeromodels oneformer_ade20k_swin_large on huggingface.co
22
Total runs
0
24-hour runs
4
3-day runs
-4
7-day runs
-8
30-day runs
More Information About oneformer_ade20k_swin_large huggingface.co Model
More oneformer_ade20k_swin_large license Visit here:
oneformer_ade20k_swin_large huggingface.co is an AI model on huggingface.co that provides oneformer_ade20k_swin_large's model effect (), which can be used instantly with this zeromodels oneformer_ade20k_swin_large model. huggingface.co supports a free trial of the oneformer_ade20k_swin_large model, and also provides paid use of the oneformer_ade20k_swin_large. Support call oneformer_ade20k_swin_large model through api, including Node.js, Python, http.
oneformer_ade20k_swin_large huggingface.co is an online trial and call api platform, which integrates oneformer_ade20k_swin_large's modeling effects, including api services, and provides a free online trial of oneformer_ade20k_swin_large, you can try oneformer_ade20k_swin_large online for free by clicking the link below.
zeromodels oneformer_ade20k_swin_large online free url in huggingface.co:
oneformer_ade20k_swin_large is an open source model from GitHub that offers a free installation service, and any user can find oneformer_ade20k_swin_large on GitHub to install. At the same time, huggingface.co provides the effect of oneformer_ade20k_swin_large install, users can directly use oneformer_ade20k_swin_large installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
oneformer_ade20k_swin_large install url in huggingface.co: