perception

Cross-platform, customizable ML solutions for live and streaming media.

Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments

Perception toolkit for sim2real training and validation in Unity

Platform for Situated Intelligence

Visual odometry package based on hardware-accelerated NVIDIA Elbrus library with world class quality and performance.

An OpenAI gym wrapper for CARLA simulator

[CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

Modular autonomous driving platform running on the CARLA simulator and real-world vehicles.

Unity's privacy-preserving human-centric synthetic data generator

Object detection / tracking / fusion based on Apollo r3.0.0 perception module in ROS

Simulations for TurtleBot3

[ICRA 2022] CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation

A complete end-to-end demonstration in which we collect training data in Unity and use that data to train a deep neural network to predict the pose of a cube. This model is then deployed in a simulated robotic pick-and-place task.

Research platform for 3D object detection in PyTorch.

Artificial Intelligence for Kinematics, Dynamics, and Optimization

A metric for Perceptual Image-Error Assessment through Pairwise Preference (PieAPP at CVPR 2018).

[CVPR 2017] Generation and reconstruction of 3D shapes via modeling multi-view depth maps or silhouettes

CVPR 2020, "MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Maps"

Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson