ZUBAIR IRSHAD

PhD Candidate at Georgia Tech Researcher at Institute of Robotics & Intelligent Machines, Georgia Tech

ABOUT ME !

I am a PhD Candidate at Georgia Institute of Technology. I’m working with Dr. Zsolt Kira at the Institute of Robotics & Intelligent Machines. My current research focuses on Visual Embodied Navigation, 3D perception, Semantic & Spatial Reasoning and Imitation Learning. My other interests include autonomous driving, perception & control for robots.

This Summer, I am working at Toyota Research Institute (TRI) as a Research Intern. I am exploring Generalized Behaviors for Robotics Mobile-Manipulation. Last Summer I Interned at SRI International in the Vision and Learning Lab on multi-modal semantic and spatial reasoning for embodied agents.

I was fortunate enough to be awarded a Fulbright Scholarship & ASME Rice Cullimore Scholarship for my Masters’ at Georgia Tech. These awards allowed me to find my passion in Robotics & Machine Learning and develop a great network of fellow Fulbrighters around the world. Feel free to contact me to talk anything related to Robotics, Deep Learning, Finance or related to some of my projects. Below you will find my projects portfolio. You can find my resume here

EDUCATION

EXPERIENCE

RESEARCH

Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation

Muhammad Zubair Irshad, Chih-Yao Ma, Zsolt Kira

IEEE International Conference on Robotics and Automation, ICRA 2021
Project Page arXiv Code

Semantically-aware Spatio-Temporal Reasoning Agent for Vision-and-Language Navigation

Muhammad Zubair Irshad, Niluthpol Mithun, Zachary Seymour, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar In Submission to WACV 2022

arXiv Project Page/Code (Coming Soon)

Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation

Muhammad Zubair Irshad, Thomas Kollar, Michael Laskey, Kevin Stone, Zsolt Kira
In Submission
Project Page/arXiv (Coming Soon)

  <img width="500" height="500"   alt="Deep Reinforcement Learning Agents" data-src="https://zubairirshad.com/wp-content/uploads/2020/06/Deep-Reinforcement-Learning-Agents-e1591680477758.jpg" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="500" height="500" src="https://zubairirshad.com/wp-content/uploads/2020/06/Deep-Reinforcement-Learning-Agents-e1591680477758.jpg" class="attachment-full size-full" alt="Deep Reinforcement Learning Agents" /> Deep Reinforcement Learning based control of complex robotic agents Details
  <img width="768" height="768"   alt="Habitat Point Goal Navigation" data-srcset="https://zubairirshad.com/wp-content/uploads/2020/05/habitat.png 768w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-150x150.png 150w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-300x300.png 300w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-370x370.png 370w" sizes="(max-width: 768px) 100vw, 768px" data-src="https://zubairirshad.com/wp-content/uploads/2020/05/habitat.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="768" height="768" src="https://zubairirshad.com/wp-content/uploads/2020/05/habitat.png" class="attachment-full size-full" alt="Habitat Point Goal Navigation" srcset="https://zubairirshad.com/wp-content/uploads/2020/05/habitat.png 768w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-150x150.png 150w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-300x300.png 300w, https://zubairirshad.com/wp-content/uploads/2020/05/habitat-370x370.png 370w" sizes="(max-width: 768px) 100vw, 768px" /> Embodied Visual Navigation in Habitat Details
  <img width="1872" height="1164"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2018/07/arm-5.png 1872w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-300x187.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-768x478.png 768w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-1024x637.png 1024w" sizes="(max-width: 1872px) 100vw, 1872px" data-src="https://zubairirshad.com/wp-content/uploads/2018/07/arm-5.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1872" height="1164" src="https://zubairirshad.com/wp-content/uploads/2018/07/arm-5.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2018/07/arm-5.png 1872w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-300x187.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-768x478.png 768w, https://zubairirshad.com/wp-content/uploads/2018/07/arm-5-1024x637.png 1024w" sizes="(max-width: 1872px) 100vw, 1872px" /> Learning inverse dynamics of 7-DOF Robot Arm Details
  <img width="1006" height="635"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53.png 1006w, https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53-300x189.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53-768x485.png 768w" sizes="(max-width: 1006px) 100vw, 1006px" data-src="https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1006" height="635" src="https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53.png 1006w, https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53-300x189.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/Screenshot-from-2019-08-06-16-07-53-768x485.png 768w" sizes="(max-width: 1006px) 100vw, 1006px" /> Complex robot maze navigation using image classification and ROS Details
  <img width="1557" height="853"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2019/08/car.png 1557w, https://zubairirshad.com/wp-content/uploads/2019/08/car-300x164.png 300w, https://zubairirshad.com/wp-content/uploads/2019/08/car-768x421.png 768w, https://zubairirshad.com/wp-content/uploads/2019/08/car-1024x561.png 1024w" sizes="(max-width: 1557px) 100vw, 1557px" data-src="https://zubairirshad.com/wp-content/uploads/2019/08/car.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1557" height="853" src="https://zubairirshad.com/wp-content/uploads/2019/08/car.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2019/08/car.png 1557w, https://zubairirshad.com/wp-content/uploads/2019/08/car-300x164.png 300w, https://zubairirshad.com/wp-content/uploads/2019/08/car-768x421.png 768w, https://zubairirshad.com/wp-content/uploads/2019/08/car-1024x561.png 1024w" sizes="(max-width: 1557px) 100vw, 1557px" /> Vehicle Control for Autonomous Driving Details
  <img width="1119" height="833"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2.png 1119w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-300x223.png 300w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-768x572.png 768w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-1024x762.png 1024w" sizes="(max-width: 1119px) 100vw, 1119px" data-src="https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1119" height="833" src="https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2.png 1119w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-300x223.png 300w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-768x572.png 768w, https://zubairirshad.com/wp-content/uploads/2019/08/env_percep-2-1024x762.png 1024w" sizes="(max-width: 1119px) 100vw, 1119px" /> Environment perception stack for Self Driving Cars Details
  <img width="733" height="714"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1.png 733w, https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1-300x292.png 300w" sizes="(max-width: 733px) 100vw, 733px" data-src="https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="733" height="714" src="https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1.png 733w, https://zubairirshad.com/wp-content/uploads/2018/07/network_diagram-1-300x292.png 300w" sizes="(max-width: 733px) 100vw, 733px" /> Sentiment prediction using Reccurent Neural Networks Details
  <img width="1204" height="898"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2018/07/vo_3.png 1204w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-300x224.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-768x573.png 768w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-1024x764.png 1024w" sizes="(max-width: 1204px) 100vw, 1204px" data-src="https://zubairirshad.com/wp-content/uploads/2018/07/vo_3.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1204" height="898" src="https://zubairirshad.com/wp-content/uploads/2018/07/vo_3.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2018/07/vo_3.png 1204w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-300x224.png 300w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-768x573.png 768w, https://zubairirshad.com/wp-content/uploads/2018/07/vo_3-1024x764.png 1024w" sizes="(max-width: 1204px) 100vw, 1204px" /> Visual Odometry for Autonomous Driving Details
  <img width="1411" height="715"   alt="Image: University of Toronto (Self Driving Cars Specialization)" data-srcset="https://zubairirshad.com/wp-content/uploads/2019/09/Planning.png 1411w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-300x152.png 300w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-768x389.png 768w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-1024x519.png 1024w" sizes="(max-width: 1411px) 100vw, 1411px" data-src="https://zubairirshad.com/wp-content/uploads/2019/09/Planning.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="1411" height="715" src="https://zubairirshad.com/wp-content/uploads/2019/09/Planning.png" class="attachment-full size-full" alt="Image: University of Toronto (Self Driving Cars Specialization)" srcset="https://zubairirshad.com/wp-content/uploads/2019/09/Planning.png 1411w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-300x152.png 300w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-768x389.png 768w, https://zubairirshad.com/wp-content/uploads/2019/09/Planning-1024x519.png 1024w" sizes="(max-width: 1411px) 100vw, 1411px" /> Motion planning stack for Self Driving Cars Details
  <img width="517" height="512"   alt="" data-srcset="https://zubairirshad.com/wp-content/uploads/2018/07/krang-1.png 517w, https://zubairirshad.com/wp-content/uploads/2018/07/krang-1-150x150.png 150w, https://zubairirshad.com/wp-content/uploads/2018/07/krang-1-300x297.png 300w" sizes="(max-width: 517px) 100vw, 517px" data-src="https://zubairirshad.com/wp-content/uploads/2018/07/krang-1.png" class="attachment-full size-full lazyload" src="data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==" /><noscript><img width="517" height="512" src="https://zubairirshad.com/wp-content/uploads/2018/07/krang-1.png" class="attachment-full size-full" alt="" srcset="https://zubairirshad.com/wp-content/uploads/2018/07/krang-1.png 517w, https://zubairirshad.com/wp-content/uploads/2018/07/krang-1-150x150.png 150w, https://zubairirshad.com/wp-content/uploads/2018/07/krang-1-300x297.png 300w" sizes="(max-width: 517px) 100vw, 517px" /> End to end imitation learning of dynamically unstable systems Details