Portfolios Archive - Zubair Irshad

Deep Reinforcement Learning based control of complex robotic agents

Deep Q Networks for exploration of an autonomous agent: In this project, an agent has to start from scratch in a previously unknown UnityML Enviornment and learn to navigate the enviornment by collecting the maximum amount of reward(yellow bananas) and avoid bad reward(blue bananas). A reward of +1 is provided for collecting a yellow banana, and a reward of -1 is provided for collecting a blue banana. The agent previously

Embodied Visual Navigation in Habitat

PDF Report: Supervised Learning Baselines for PointGoal Navigation in Photo-realistic indoor cluttered enviornments The aim of this work is to solve the embodied point goal navigation task in photo-realistic, indoor environments using Habitat. In this task, a virtual agent (robot) starts at a random position in an unknown environment. The agent is given the coordinates of a goal location. Primary aim of the agent is to navigate to the goal

Learning inverse dynamics of 7-DOF Robot Arm

An accurate estimation for the inertial parameters of a robot manipulator is essential for many modern manipulator control algorithms including calculating inverse dynamics of the robot. This project implements a unique approach for numerically determining regressor matrix without explicitly deriving the equations. This is accomplished using state of the art articulated body algorithms such as Featherstone’s and an approximate model of the robot usually captured by a URDF file. The

Complex robot maze navigation using image classification and ROS

This project is a ROS based mobile robot navigator using sign recognition based on image classification. It has two major components: Image classification based sign recognition using SVM classifier: A set of 300 images were trained offline to classify 5 different road signs (turn right, turn left, stop, turn around, goal). SVM classifier was used tp obtain an accuracy of over 90% on unseen and diverse set of images taken

Vehicle Control for Autonomous Driving

Implementation of Longitudinal and Lateral control to autonomously navigate a car through a set of given way points using Stanley Control for Lateral Control and PID control for Longitudinal Control. This project was implemented on CARLA simulator based on unreal engine. Input to the system is given waypoints in the form of a text file which specifiy the desired position and velocity along the path Output is throttle_output (betwwen 0 and 1),

Environment perception stack for Self Driving Cars

This projects implements detailed environment perception stack for self driving cars. A semantic segmentation output of an image computed using Convolutional Neural Network is used as an input to the Environment perception stack. This stack constitutes 3 important sub-stacks as follows: Estimating the ground plane using RANSAC:To estimate the drivable surface for a car, pixels corresponding to the ground plane in the scene were computed. This extends to finding

Visual Odometry for Autonomous Driving

A set of 52 images taken from the camera mounted on the car were used to estimate the vehicle trajectory over time. Feature Matching: The first phase of the project constitutes finding features in the first image and matching them with the same features in the second image to locate how much the features have moved because of car motion. Below you can see the features in the first image

End to end imitation learning of dynamically unstable systems

Pixels to Controls is a widely studies topic in the field of controls and machine learning. This project aims to implement behavior based cloning and imitation learning approaches for dynamically unstable systems. The first part of this project has been implemented on ROS and Gazebo. For Golem Krang robot(shown above), an expert LQR controller has been developed which tracks a certain trajectory in simulation. In this ongoing project, next step

Archives: Portfolios