prs-eth / PaGeR-normals-Structured3D

📟 PaGeR(Panoramic Geometry Estimation) Surface Normals Estimation Model Card

This is a model card for the PaGeR-normals-Structured3D model for monocular normal estimation from a single panoramic ERP image. The model is fine-tuned from our original normals checkpoint on Structured3D dataset, as described in our paper:

• [Paper](paper link) titled "Panorama Geometry Estimation using Single-Step Diffusion Models"

You can also check out other depth and normals models in our collection , or test models in our demo .

Model Details

• Developed by: Vukasin Bozic , Isidora Slavkovic , Dominik Narnhofer , Nando Metzger , Denis Rozumny , Konrad Schindler , Nikolai Kalischek .
• Model type: Generative latent diffusion-based one-step monocular panoramic surface normal estimation from a single ERP image.
• License: CreativeML OpenRAIL License .
• Model Description: This model can be used to generate an estimated normals map of a panoramic input image.
  • Resolution : The model is designed to support large resolutions up to 3K.
  • Dataset : Structured3D
  • Steps and scheduler : This model works in a swift, one-step regime.
  • Outputs :
    • Surface Normals map : The predicted values represent a 3D normals map in range 0-1, representing the 3D surface normal vector at each pixel.
• Resources for more information: [Project Website](insert link), [Paper](insert link), Code .
• Cite as:

Add citation