Very Social Robot

A handover interaction between Human and Robot

We want to have robots assisting us throughout our daily activities, which often involve trivial pick and place, grasping, and handover use cases. However, these activities are still perceived by us as “robotic”. In our daily lives, we experience a variety of object handovers. Although the event of an object being transferred from one person to another seems trivial and happens subconsciously, it is a complex collaboration that involves verbal, visual, social and physical cues. It is important to us to develop and train robots in such a way that they are more reactive to humans, making the human-robot interaction seamless and efficient. Therefore, in this course project our aim was to develop more humanistic interaction strategies for a Locobot.

I worked on the following modules:

  • Created a planning and controls pipeline that was used for motion planning of the robot arm based on end-effector poses provided by the other modules. We used the Probabilistic RoadMap Planner for finding out collision free paths and PID controller for following the joint angle trajectories

PRM_Planner

  • Developed the module that predicted the best end-effector handover pose based on the rewards obtained from the interacting human.

Checkout our Slides and Report for further details.

Karmesh Yadav
Karmesh Yadav
AI Resident at FAIR

My research interests include Reinforcement Learning, Robotics and Meta-Learning.

Related