Stanford University

Publications

2020 Publications

Learning Multi-Arm Manipulation Through Collaborative Teleoperation

Albert Tung*, Josiah Wong*, Ajay Mandlekar, Roberto Martín-Martín, Yuke Zhu, Li Fei-Fei, Silvio Savarese

Under Review. December 2020

Paper Project Video

Human-in-the-Loop Imitation Learning using Remote Teleoperation

Ajay Mandlekar, Danfei Xu*, Roberto Martin-Martin*, Yuke Zhu, Li Fei-Fei, Silvio Savarese

Under Review. December 2020

Paper Project Video

Multi-Layer Semantic and Geometric Modeling with Neural Message Passing in 3D Scene Graphs for Hierarchical Mechanical Search

Andrey Kurenkov, Roberto Martín-Martín, Jeff Ichnowski, Ken Goldberg, Silvio Savarese

Under Review. December 2020

Paper Project Video

Visuomotor Mechanical Search: Learning to Retrieve Target Objects in Clutter

Andrey Kurenkov*, Joseph Taglic*, Rohun Kulkarni, Marcus Dominguez-Kuhne, Animesh Garg, Roberto Martín-Martín, Silvio Savarese

IEEE/RSJ Int. Conference. on Intelligent Robots and Systems (IROS). October 2020

Paper Project Video

GTI: Learning to Generalize Across Long-Horizon Tasks from Human Demonstrations

Ajay Mandlekar*, Danfei Xu*, Roberto Martin-Martin, Silvio Savarese, Li Fei-Fei

Robotics: Science and Systems (RSS). July 2020

Paper Project Video

Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments

Fei Xia, William B. Shen, Chengshu Li, Priya Kasimbeg, Micael Tchapmi, Alexander Toshev, Li Fei-Fei, Roberto Martín-Martín, Silvio Savarese

IEEE International Conference on Robotics and Automation (ICRA). May 2020

Paper Project Video

6-PACK: Category-Level 6D Pose Tracker with Anchor-Based Keypoints

Chen Wang, Roberto Martín-Martín, Danfei Xu, Jun Lv, Cewu Lu, Li Fei-Fei, Silvio Savarese, Yuke Zhu

IEEE International Conference on Robotics and Automation (ICRA). May 2020

Paper Project Video Code

KETO: Learning Keypoint Representations for Tool Manipulation

Zengyi Qin, Kuan Fang, Yuke Zhu, Li Fei-Fei, Silvio Savarese

IEEE International Conference on Robotics and Automation (ICRA). May 2020

Paper Project

IRIS: Implicit Reinforcement without Interaction at Scale for Learning Control from Offline Robot Manipulation Data

Ajay Mandlekar, Fabio Ramos, Byron Boots, Silvio Savarese, Li Fei-Fei, Animesh Garg, Dieter Fox

IEEE International Conference on Robotics and Automation (ICRA). May 2020

Paper Project Video

Motion Reasoning for Goal-Based Imitation Learning

De-An Huang, Yu-Wei Chao*, Chris Paxton*, Xinke Deng, Li Fei-Fei, Juan Carlos Niebles, Animesh Garg, Dieter Fox

IEEE International Conference on Robotics and Automation (ICRA). May 2020

Paper

2019 Publications

Regression Planning Networks

Danfei Xu, Roberto Martín-Martín, De-An Huang, Yuke Zhu, Silvio Savarese, Li Fei-Fei

NeurIPS. December 2019

Paper Project

Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity

Ajay Mandlekar, Jonathan Booher, Max Spero, Albert Tung, Anchit Gupta, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) - Best Cognitive Robotics Paper Finalist. November 2019

Paper Project Blog

Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning

De-An Huang, Danfei Xu, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei, Juan Carlos Niebles

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). November 2019

Paper

Variable Impedance in End-Effector Space: An Action Space for Reinforcement Learning of Contact-Rich Tasks

Roberto Martín-Martín, Michelle A. Lee, Rachel Gardner, Jeannette Bohg, Silvio Savarese, Animesh Garg

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). November 2019

Paper Project Code

AC-Teach: A Bayesian Actor-Critic Method for Policy Learning with an Ensemble of Suboptimal Teachers

Andrey Kurenkov*, Ajay Mandlekar*, Roberto Martin-Martin, Silvio Savarese, Animesh Garg

Conference on Robot Learning (CoRL). October 2019

Paper Project Blog

Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation

Kuan Fang, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei

Conference on Robot Learning (CoRL). October 2019

Situational Fusion of Visual Representation for Visual Navigation

William B. Shen, Danfei Xu, Yuke Zhu, Leo Guibas, Li Fei-Fei, Silvio Savarese

International Conference on Computer Vision (ICCV). October 2019

Paper Project

Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision

Kuan Fang, Yuke Zhu, Animesh Garg, Andrey Kurenkov, Viraj Mehta, Li Fei-Fei, Silvio Savarese

The International Journal of Robotics Research (IJRR). August 2019

Paper Project Video

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

Chen Wang, Danfei Xu, Yuke Zhu, Roberto Martín-Martín, Cewu Lu, Li Fei-Fei, Silvio Savarese

IEEE Conference on Computer Vision and Pattern Recognition (CVPR). June 2019

Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks

Michelle A. Lee*, Yuke Zhu*, Krishnan Srinivasan, Parth Shah, Silvio Savarese, Li Fei-Fei, Animesh Garg, Jeannette Bohg

IEEE International Conference on Robotics and Automation (ICRA) - Best Paper Award. May 2019

Paper Project Video

Mechanical Search: Multi-Step Retrieval of a Target Object Occluded by Clutter

Michael Danielczuk, Andrey Kurenkov, Ashwin Balakrishna, Matthew Matl, David Wang, Roberto Martin-Martin, Animesh Garg, Silvio Savarese, Ken Goldberg

IEEE International Conference on Robotics and Automation (ICRA). May 2019

Paper Project Video

2018 Publications

RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation

Ajay Mandlekar, Yuke Zhu, Animesh Garg, Jonathan Booher, Max Spero, Albert Tung, Julian Gao, John Emmons, Anchit Gupta, Emre Orbay, Silvio Savarese, Li Fei-Fei

Conference on Robot Learning (CoRL). October 2018

Paper Project Code

SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark

Linxi Fan*, Yuke Zhu*, Jiren Zhu, Zihua Liu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

Conference on Robot Learning (CoRL). October 2018

Paper Project Video Code

Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration

De-an Huang*, Suraj Nair*, Danfei Xu*, Yuke Zhu, Animesh Garg, Li Fei-Fei, Silvio Savarese, Juan Carlos Niebles

arXiv preprint. August 2018

Paper Project

Learning Task-Oriented Grasping for Tool Manipulation with Simulated Self-Supervision

Kuan Fang, Yuke Zhu, Animesh Garg, Viraj Mehta, Andrey Kurenkov, Li Fei-Fei, Silvio Savarese

Robotics: Science and Systems (RSS). June 2018

Paper Project Video

Finding “It”: Weakly-Supervised Reference-Aware Visual Grounding in Instructional Video

De-An Huang, Shyamal Buch, Lucio Dery, Animesh Garg, Li Fei-Fei, Juan Carlos Niebles

IEEE Conference on Computer Vision & Pattern Recognition (CVPR). June 2018

Paper Video

Neural Task Programming: Learning to Generalize Across Hierarchical Tasks

Danfei Xu*, Suraj Nair*, Yuke Zhu, Julian Gao, Animesh Garg, Li Fei-Fei, Silvio Savarese

IEEE International Conference on Robotics and Automation (ICRA). May 2018

Paper Project Video Code

DeformNet: Free-Form Deformation Network for 3d Shape Reconstruction From a Single Image

Andrey Kurenkov, Jingwei Ji, Animesh Garg, Viraj Mehta, JunYoung Gwak, Chris Choy, Silvio Savarese

IEEE Winter Conference on Applications of Computer Vision (WACV). March 2018

Paper Project

2017 Publications

AdaPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical Systems

James Harrison*, Animesh Garg*, Boris Ivanovic, Yuke Zhu, Silvio Savarese, Li Fei-Fei, Marco Pavone

International Symposium on Robotics Research (ISRR). December 2017

Paper

Visual Semantic Planning using Deep Successor Representations

Yuke Zhu*, Daniel Gordon*, Eric Kolve, Dieter Fox, Li Fei-Fei, Abhinav Gupta, Roozbeh Mottaghi, Ali Farhadi

International Conference on Computer Vision (ICCV). October 2017

Paper Video Code

Adversarially Robust Policy Learning through Active Construction of Physically-Plausible Perturbations

Ajay Mandlekar*, Yuke Zhu*, Animesh Garg*, Li Fei-Fei, Silvio Savarese

International Conference on Intelligent Robots and Systems (IROS). September 2017

Paper Project Video

Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning

Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi

International Conference on Robotics and Automation (ICRA). May 2017

Paper Project Video