Research And Projects

We develop computer vision methods, including 3D object detection, hand pose estimation, and geo-localization, with application to augmented reality and robotics.

Segmentation-Based 3D Tracking

Given a simple 3D model of the environment, we show how to exploit recent results in semantic segmentation to efficiently localize a camera in urban environments.

Project Info

3D Pose Estimation

BB8 is a novel method for 3D object detection and pose estimation from color images only. It predicts the 3D poses of the objects in the form of 2D projections of the 8 corners of their 3D bounding boxes.

Project Info

ALCN: Adaptive Local Contrast Normalization

We propose a novel illumination normalization method that lets us learn to detect objects and estimate their 3D poses under challenging illumination condition from very few training samples.

Project Info

Geo-localization from Images and 2.5D Maps

We propose methods for accurate camera pose estimation in urban environments from single images and 2.5D maps made of the surrounding buildings’ outlines and their heights.

Project Info

Accurate Geo-Localization from Images

We present a method for large-scale geo-localization and global tracking of mobile devices in urban outdoor environments.

Project Info

Hand Detection and 3D Pose Estimation

We introduce a prior model for predicting the 3D joint locations of a hand given a depth map using Convolutional Neural Networks (CNN).

Project Info

Object Detection and 3D Pose Estimation

We introduce a simple but powerful approach to computing descriptors for object views that efficiently capture both the object identity and 3D pose.

Project Info

3D Object Tracking

We present a method that estimates in real-time and under challenging conditions the 3D pose of a known object.

Project Info

Learning to Detect Keypoints (at CVLab, EPFL)

We introduce a learning-based approach to detect repeatable keypoints under drastic imaging changes of weather and lighting conditions to which state-of-the-art keypoint detectors are surprisingly sensitive.

Project Info

Flying Object Detection from a Single Moving Camera (at CVLab, EPFL)

We propose an approach to detect flying objects such as UAVs and aircrafts when they occupy a small portion of the field of view, possibly moving against complex backgrounds, and are filmed by a camera that itself moves.

Project Info

Realistic Synthetic Data Generation (at CVLab, EPFL)

We propose a novel approach to synthesizing images that are effective for training object detectors.

Project Info

Older Projects at CVLab


Team Lepetit