ABOUT ME!
I have been fortunate to spend time at Toyota Research Institute (ML-R) working on compositionality of neural-radiance based representations (NeRF) and implicit models for 3D shape, appearance and pose optimization. I also spent the wonderful summers before at Toyota Research Institute (Robotics) (Summer’21) and SRI International (Summer’20) working on 3D perception, scene understanding and semantic and spatial reasoning for embodied agents.
Feel free to contact me to talk anything related to 3D Vision, Robotics, NeRFs, Deep Learning or related to some of my projects. Below you will find my projects portfolio. You can find my resume here.
PhD, Robotics and Mechanical Engineering, 2019- 2023
M.S., Robotics and Mechanical Engineering, 2017- 2019
Fulbright Scholar,
2017- 2019
Deep Learning Research Intern,
Jan-Aug 2022
Robotics & Deep Learning Research Intern, May-Aug 2021
Computer Vision Research Intern,
May-Aug 2020
NEWS
[Jul 2023]
Our Paper, NeO 360, accepted to ICCV’23! Grateful to have trio of papers accepted to ECCV, CVPR and now ICCV
[Jul 2023]
Served as a reviewer and reviewed 19 papers this year, so far for NeurIPS’23, CVPR’23, ICCV’23 and ICRA’23
[Jun 2023]
Gave invited talks on Neural Fields in Robotics (Part 1 and 2) at 3D Deep Learning Reading Group
[Apr 2023]
Passed my PhD proposal defense titled ‘Inductive biases for object and agent-centric neural 3D scene representations’
[Apr 2023]
Guest lecture at Georgia Tech’s Deep learning Class on ‘Learning Object-centric Centric Neural 3D Scene Representations’
[Jan 2022]
Started my second internship at Toyota Research Institute, with Machine Learning team in Bay Area, California
[Jul 2021]
Started my first internship at Toyota Research Institute, with Robotics perception team in Bay Area, California.
[Aug 2019]
The beginning of my PhD program
FEATURED PUBLICATIONS
FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects
Mayank Lunayach, Sergey Zakharov, Dian Chen, Rares Ambrus, Zsolt Kira, Muhammad Zubair Irshad
Preprint
NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes
Muhammad Zubair Irshad, Sergey Zakharov, Katherine Liu, Vitor Guizilini, Thomas Kollar, Adrien Gaidon, Zsolt Kira*, Rares Ambrus*
International Conference on Computer Vision, ICCV 2023
CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects
Nick Heppert, Muhammad Zubair Irshad, Sergey Zakharov, Katherine Liu, Rares Ambrus, Jeannette Bohg, Abhinav Valada, Thomas Kollar
Conference on Computer Vision and Pattern Recognition, CVPR 2023
ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization
Muhammad Zubair Irshad*, Sergey Zakharov*, Rares Ambrus, Thomas Kollar, Zsolt Kira, Adrien Gaidon
European Conference on Computer Vision, ECCV 2022
CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation
Muhammad Zubair Irshad, Thomas Kollar, Michael Laskey, Kevin Stone, Zsolt Kira
IEEE International Conference on Robotics and Automation, ICRA 2022
Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation
Muhammad Zubair Irshad, Chih-Yao Ma, Zsolt Kira
IEEE International Conference on Robotics and Automation, ICRA 2021
SASRA: Semantically-aware Spatio-Temporal Reasoning Agent for Vision-and-Language Navigation
Muhammad Zubair Irshad, Niluthpol Mithun, Zachary Seymour, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar
International Conference on Pattern Recognition, ICPR 2022
MACHINE LEARNING SOFTWARE & REPO
Deep Reinforcement Learning based control of complex robotic agents
Details
Embodied Visual Navigation in Habitat
Details
Learning inverse dynamics of 7-DOF Robot Arm
Details
Complex robot maze navigation using image classification and ROS
Details
Vehicle Control for Autonomous Driving
Details
Environment perception stack for Self Driving Cars
Details
Visual Odometry for Autonomous Driving
Details