Yann Labbé

I am interested in multimodal foundation models, robotics and AI agents. I was one of the founding researcher of H Company, a research scientist at Meta Reality Labs and an intern in NVIDIA's Seattle Robotics Lab. I obtained a PhD from École Normale Supérieure where I was supervised by Josef Sivic.

Publications

Representative publications are highlighted. Also see Google Scholar for an up-to-date list of publications.

Surfer-H Meets Holo1: Cost-Efficient Web Agent Powered by Open Weights
Mathieu Andreux, Breno Baldas Skuk, Hamza Benchekroun, Emilien Biré, Antoine Bonnet, Riaz Bordie, Nathan Bout, Matthias Brunel, Pierre-Louis Cedoz, Antoine Chassang, Mickaël Chen, Alexandra D. Constantinou, Antoine d'Andigné, Hubert de La Jonquière, Aurélien Delfosse, Ludovic Denoyer, Alexis Deprez, Augustin Derupti, Michael Eickenberg, Mathïs Federico, Charles Kantor, Xavier Koegler, Yann Labbé, Matthew C. H. Lee, Erwan Le Jumeau de Kergaradec, Amir Mahla, Avshalom Manevich, Adrien Maret, Charles Masson, Rafaël Maurin, Arturo Mena, Philippe Modard, Axel Moyal, Axel Nguyen Kerbel, Julien Revelle, Mats L. Richter, María Santos, Laurent Sifre, Maxime Theillard, Marc Thibault, Louis Thiry, Léo Tronchon, Nicolas Usunier, Tony Wu
arXiv 2025

paper product agent Holo1 models (3B/7B) WebClick dataset

6D Object Pose Tracking in Internet Videos for Robotic Manipulation
Georgy Ponimatkin, Martin Cífka, Tomas Soucek, Médéric Fourmy, Yann Labbé, Vladimir Petrik, Josef Sivic
ICLR 2025

paper project page code

FoundPose: Unseen Object Pose Estimation with Foundation Features
Evin Pınar Örnek, Yann Labbé, Bugra Tekin, Lingni Ma, Cem Keskin, Christian Forster, Tomas Hodan
ECCV 2024

paper project page

BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects
Tomas Hodan, Martin Sundermeyer, Yann Labbé, Van Nguyen Nguyen, Gu Wang, Eric Brachmann, Bertram Drost, Vincent Lepetit, Carsten Rother, Jiri Matas
CVPR Workshops 2024

paper workshop

FocalPose++: Focal Length and Object Pose Estimation via Render and Compare
Martin Cífka, Georgy Ponimatkin, Yann Labbé, Bryan Russell, Mathieu Aubry, Vladimir Petrik, Josef Sivic
TPAMI 2024

paper

Pose estimation of rigid objects and robots
Yann Labbé
PhD Thesis, 2023

link

BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects
Martin Sundermeyer, Tomas Hodan, Yann Labbé, Gu Wang, Eric Brachmann, Bertram Drost, Carsten Rother, Jiri Matas
CVPR Workshops 2023

paper workshop

MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare
Yann Labbé, Lucas Manuelli, Arsalan Mousavian, Stephen Tyree, Stan Birchfield, Jonathan Tremblay, Justin Carpentier, Mathieu Aubry, Dieter Fox, Josef Sivic
CoRL 2022

paper project page code openreview

Focal Length and Object Pose Estimation via Render and Compare
Georgy Ponimatkin, Yann Labbé, Bryan Russel, Mathieu Aubry, Josef Sivic
CVPR 2022

paper project page code

CosySlam: investigating object-level SLAM for detecting locomotion surfaces
César Debeunne, Médéric Fourmy, Yann Labbé, Pierre-Alexandre Léziart, Guilhem Saurel, Joan Solà, Nicolas Mansard
arXiv 2022

paper

Single-view robot pose and joint angle estimation via render & compare
Yann Labbé, Justin Carpentier, Mathieu Aubry, Josef Sivic
CVPR 2021

Accepted as oral (top 4% submissions).

paper project page code

CosyPose: Consistent multi-view multi-object 6D pose estimation
Yann Labbé, Justin Carpentier, Mathieu Aubry, Josef Sivic
arXiv 2021
Extended version of the ECCV paper

paper

BOP Challenge 2020 on 6D Object Localization
Tomas Hodaň, Martin Sundermeyer, Bertram Drost, Yann Labbé, Eric Brachmann, Frank Michel, Carsten Rother, Jiri Matas
ECCV Workshops 2020

paper website workshop

CosyPose: Consistent multi-view multi-object 6D pose estimation
Yann Labbé, Justin Carpentier, Mathieu Aubry, Josef Sivic
ECCV 2020

Winner of the BOP Challenge at ECCV 2020 (5/6 awards).

paper project page code video BOP slides

Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning
Yann Labbé, Sergey Zagoruyko, Igor Kalevatykh, Ivan Laptev, Justin Carpentier, Mathieu Aubry, Josef Sivic
RAL 2020

paper project page code