Computer Vision and Geometry Group

OpenScene: 3D Scene Understanding with Open Vocabularies

Songyou Peng, Kyle Genova, Chiyu ''Max'' Jiang, Andrea Tagliasacchi, Marc Pollefeys, Thomas Funkhouser.

CVPR 2023

Project

Paper

Code

GlueStick: Robust Image Matching by Sticking Points and Lines Together

Rémi Pautrat* and Iago Suárez* and Yifan Yu and Marc Pollefeys and Viktor Larsson, 'Proc. ICCV', 2023.

Project

Paper

Code

Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction

Rémi Pautrat and Shaohui Liu and Petr Hruby and Marc Pollefeys and Daniel Barath, 'Proc. ICCV', 2023.

Project

Paper

Code

3D Line Mapping Revisited

Shaohui Liu and Yifan Yu and Rémi Pautrat and Marc Pollefeys and Viktor Larsson, 'Proc. CVPR', 2023.

Project

Paper

Code

DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients

Rémi Pautrat and Dániel Béla Baráth and Viktor Larsson and Martin R. Oswald and Marc Pollefeys, 'Proc. CVPR', 2023.

Project

Paper

Code

Four-view Geometry with Unknown Radial Distortion

Petr Hruby and Viktor Korotynskiy and Timothy Duff and Marc Pollefeys and Tomas Pajdla and Viktor Larsson, 'Proc. CVPR', 2023 .

Paper

Code

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

Yufan Ren and Fangjinhua Wang and Tong Zhang and Marc Pollefeys and Sabine Süsstrunk, 'Proc. CVPR', 2023 .

Project

Paper

Code

SGAligner: 3D Scene Alignment with Scene Graphs

S. D. Sarkar, O. Miksik, M. Pollefeys, D. Barath, I. Armeni, 'Proc. ICCV', 2023 .

Project

Paper

Code

Guiding Local Feature Matching with Surface Curvature

S. Wang, J. Kannala, M. Pollefeys, D. Barath, 'Proc. ICCV', 2023 .

Paper

Code

Adaptive Reordering Sampler with Neurally Guided MAGSAC

T. Wei, J. Matas, D. Barath, 'Proc. ICCV', 2023 .

Paper

Code

Fast Globally Optimal Surface Normal Estimation from an Affine Correspondence

L. Hajder, L. Lóczi, D. Barath, 'Proc. ICCV', 2023 .

Project

Generalized Differentiable RANSAC

T. Wei, Y. Patel, A. Shekhovtsov, J. Matas, D. Barath, 'Proc. ICCV', 2023 .

Paper

Code

P1AC: Revisiting absolute pose from a single affine correspondence

J. Ventura, Z. Kukelova, T. Sattler, D. Barath, 'Proc. ICCV' (oral), 2023 .

Paper

Code

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

Zihan Zhu*, Songyou Peng*, Viktor Larsson, Weiwei Xu, Hujun Bao, Zhaopeng Cui, Martin R. Oswald, Marc Pollefeys.

CVPR 2022

Project

Paper

Code

'Learning to Solve Hard Minimal Problems',

Petr Hruby and Timothy Duff and Anton Leykin and Tomas Pajdla, 'Proc. CVPR' (Best Paper Award) ,2022 .

Paper

Code

IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo

Fangjinhua Wang and Silvano Galliani and Christoph Vogel and Marc Pollefeys, 'Proc. CVPR', 2022 .

Paper

Code

Shape As Points: A Differentiable Poisson Solver

Songyou Peng, Chiyu ''Max'' Jiang, Yiyi Liao, Michael Niemeyer, Marc Pollefeys, Andreas Geiger.

NeurIPS 2021 (Oral, top 0.6%)

Project

Paper

Code

SOLD²: Self-supervised Occlusion-aware Line Description and Detection

Rémi Pautrat* and Juan-Ting Lin* and Viktor Larsson and Martin R. Oswald and Marc Pollefeys, 'Proc. CVPR', 2021.

Project

Paper

Code

PatchmatchNet: Learned Multi-View Patchmatch Stereo

Fangjinhua Wang and Silvano Galliani and Christoph Vogel and Pablo Speciale and Marc Pollefeys, 'Proc. CVPR', 2021 (Oral) .

Paper

Code

Convolutional Occupancy Networks

Songyou Peng, Michael Niemeyer, Lars Mescheder, Marc Pollefeys, Andreas Geiger.

ECCV 2020 (Spotlight, top 5%)

Project

Paper

Code

Online Invariance Selection for Local Feature Descriptors

Rémi Pautrat and Viktor Larsson and Martin R. Oswald and Marc Pollefeys, 'Proc. ECCV', 2020.

Project

Paper

Code

Conference and Workshop Papers [C242] 'Crowd-Guided Ensembles: How Can We Choreograph Crowd Workers for Video Segmentation?',

Alexandre Kaspar and Genevieve Patterson and Changil Kim and Yagiz Aksoy and Wojciech Matusik and Mohamed Elgharib, 'Proc. ACM CHI', Pages: ,2018 .

[C231] 'Designing Effective Inter-Pixel Information Flow for Natural Image Matting'

Aksoy, Yagiz and Aydin Tunc Ozan and Pollefeys, Marc, 'Proc. CVPR' , Pages: , 2017.

Project

Paper

Code

[C230] 'Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels'

Ali Osman Ulusoy and Michael Black and Andreas Geiger, ' Conference on Computer Vision and Pattern Recognition (CVPR) ' , Pages: ,2017.

Project

Paper

Code

[C229] 'Bounding Boxes, Segmentations and Object Coordinates: How Important is Recognition for 3D Scene Flow Estimation in Autonomous Driving Scenarios?'

Aseem Behl and Omid Hosseini Jafari and Siva Karthik Mustikovela and Hassan Abu Alhaija and Carsten Rother and Andreas Geiger, ' International Conference on Computer Vision (ICCV) ', Pages: , 2017.

Project

Paper

Code

[C228] 'An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation'

Christian F. Baumgartner and Lisa M. Koch and Marc Pollefeys and Ender Konukoglu, ' International Workshop on Statistical Atlases and Computational Modelling of the Heart ', Pages: , 2017.

Project

Paper

Code

[C227] 'Toroidal Constraints for Two Point Localization Under High Outlier Ratios'

Federico Camposeco and Torsten Sattler and Andrea Cohen and Andreas Geiger and Marc Pollefeys, ' Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

[C226] 'OctNet: Learning Deep 3D Representations at High Resolutions'

Gernot Riegler and Ali Osman Ulusoy and Andreas Geiger, ' Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

[C225] 'OctNetFusion: Learning Depth Fusion from Data'

Gernot Riegler and Ali Osman Ulusoy and Horst Bischof and Andreas Geiger, ' International Conference on 3D Vision (3DV) ', Pages: , 2017.

Project

Paper

Code

[C224] 'Augmented Reality Meets Deep Learning for Car Instance Segmentation in Urban Scenes'

Hassan Abu Alhaija and Siva Karthik Mustikovela and Lars Mescheder and Andreas Geiger and Carsten Rother, ' British Machine Vision Conference (BMVC) ', Pages: , 2017.

Project

Paper

Code

[C223] 'Mapping on the Fly: Real-time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles'

Hinzmann, Timo and Schonberger, Johannes Lutz and Pollefeys, Marc and Siegwart, Roland, ' Field and Service Robotics - Results of the 11th International Conference ', Pages: , 2017.

Project

Paper

Code

[C222] 'Slow Flow: Exploiting High-Speed Cameras for Accurate and Diverse Optical Flow Reference Data'

Joel Janai and Fatma Güney and Jonas Wulff and Michael Black and Andreas Geiger, ' Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

[C221] 'Sparsity Invariant CNNs'

Jonas Uhrig and Nick Schneider and Lukas Schneider and Uwe Franke and Thomas Brox and Andreas Geiger, ' International Conference on 3D Vision (3DV) ', Pages: , 2017.

Project

Paper

Code

[C220] 'Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks'

, Lars Mescheder and Sebastian Nowozin and Andreas Geiger, ' International Conference on Machine learning (ICML) ', Pages: , 2017.

Project

Paper

Code

[C219] 'The Numerics of GANs'

Lars Mescheder and Sebastian Nowozin and Andreas Geiger, ' Advances in Neural Information Processing Systems (NIPS) ', Pages: , 2017.

Project

Paper

Code

[C218] 'Semantically Informed Multiview Surface Refinement'

M. Blaha, M. Rothermel, M. R. Oswald, T. Sattler, A. Richard, J. D. Wegner, M. Pollefeys and K. Schindler, ' International Conference on Computer Vision (ICCV) ', Pages: , 2017.

Project

Paper

Code

[C217] 'AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring'

Mattia Ryffel and Fabio Zund and Yagiz Aksoy and Alessia Marra and Maurizio Nitti and Tunc Ozan Aydin and Bob Sumner, ' International Conference on Game and Entertainment Technologies ', Pages: , 2017.

Project

Paper

Code

[C216] 'Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection'

, N. Savinov, A. Seki, L. Ladicky, T. Sattler and M. Pollefeys, ' The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

[C215] 'Consensus Maximization with Linear Matrix Inequality Constraints'

, Pablo Speciale and Danda P. Paudel and Martin R. Oswald and Till Kroeger and Luc V. Gool, and Marc Pollefeys, ' Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

[C214] 'Direct Visual Odometry for a Fisheye-Stereo Camera'

, Peidong Liu and Lionel Heng and Torsten Sattler and Andreas Geiger and Marc Pollefeys, ' International Conference on Intelligent Robots and Systems (IROS) ', Pages: , 2017.

Project

Paper

Code

[C213] 'Comparative Evaluation of Hand-Crafted and Learned Local Features'

, Schonberger, Johannes Lutz and Hardmeier, Hans and Sattler, Torsten and Pollefeys, Marc, ' Conference on Computer Vision and Pattern Recognition (CVPR) ', Pages: , 2017.

Project

Paper

Code

Publication

2023

OpenScene: 3D Scene Understanding with Open Vocabularies

GlueStick: Robust Image Matching by Sticking Points and Lines Together

Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction

3D Line Mapping Revisited

DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients

Four-view Geometry with Unknown Radial Distortion

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

SGAligner: 3D Scene Alignment with Scene Graphs

Guiding Local Feature Matching with Surface Curvature

Adaptive Reordering Sampler with Neurally Guided MAGSAC

Fast Globally Optimal Surface Normal Estimation from an Affine Correspondence

Generalized Differentiable RANSAC

P1AC: Revisiting absolute pose from a single affine correspondence

2022

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

'Learning to Solve Hard Minimal Problems',

IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo

2021

Shape As Points: A Differentiable Poisson Solver

SOLD²: Self-supervised Occlusion-aware Line Description and Detection

PatchmatchNet: Learned Multi-View Patchmatch Stereo

2020

Convolutional Occupancy Networks

Online Invariance Selection for Local Feature Descriptors

2018

Conference and Workshop Papers [C242] 'Crowd-Guided Ensembles: How Can We Choreograph Crowd Workers for Video Segmentation?',

2017

[C231] 'Designing Effective Inter-Pixel Information Flow for Natural Image Matting'

[C230] 'Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels'

[C229] 'Bounding Boxes, Segmentations and Object Coordinates: How Important is Recognition for 3D Scene Flow Estimation in Autonomous Driving Scenarios?'

[C228] 'An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation'

[C227] 'Toroidal Constraints for Two Point Localization Under High Outlier Ratios'

[C226] 'OctNet: Learning Deep 3D Representations at High Resolutions'

[C225] 'OctNetFusion: Learning Depth Fusion from Data'

[C224] 'Augmented Reality Meets Deep Learning for Car Instance Segmentation in Urban Scenes'

[C223] 'Mapping on the Fly: Real-time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles'

[C222] 'Slow Flow: Exploiting High-Speed Cameras for Accurate and Diverse Optical Flow Reference Data'

[C221] 'Sparsity Invariant CNNs'

[C220] 'Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks'

[C219] 'The Numerics of GANs'

[C218] 'Semantically Informed Multiview Surface Refinement'

[C217] 'AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring'

[C216] 'Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection'

[C215] 'Consensus Maximization with Linear Matrix Inequality Constraints'

[C214] 'Direct Visual Odometry for a Fisheye-Stereo Camera'

[C213] 'Comparative Evaluation of Hand-Crafted and Learned Local Features'