Every day there are new accomplishments with robots that are making them quickly become humanity's partners in life. Robby the delivery robot can deliver food groceries and packages premiered at CES 2018. Sofia the humanoid robot recently became a Saudi Arabian citizen. There is even a robot drummer who can take selfies with human companions and post them to social media. But there are still a lot of developments that need to be made to make robots the perfect partners for humans.
Army researchers have teamed up with the University of Austin to create an algorithm and new techniques to help robots learn how to perform tasks and interact with human instructors. The researchers focused on a single human-robot interaction where the human is critiquing the robot’s performance. Dr. Peter Stone, from the University of Texas, and student Brad Knox, used TAMER — training an agent manually via evaluative reinforcement — during this study.
The study resulted in a new algorithm called Deep TAMER, an extension of TAMER that takes advantage of deep learning for robotics. The robots were able to learn different abilities and tasks by watching videos over a short period of time with the help of a human.
Deep TAMER was demonstrated by giving the robot 15 minutes of human feedback to a robot who was trying to learn how to play Atari bowling. Atari bowling has been a problem for robots and artificial intelligence in the past. After listening to the critique, the robot was able to play Atari bowling at the same skill level as a human who is an expert at playing Atari.
"The Army of the future will consist of Soldiers and autonomous teammates working side-by-side," Warnell said. "While both humans and autonomous agents can be trained in advance, the team will inevitably be asked to perform tasks, for example, search and rescue or surveillance, in new environments, they have not seen before. In these situations, humans are remarkably good at generalizing their training, but current artificially-intelligent agents are not."
The Army wants to develop robots to work side-by-side with humans in war situations, and Deep TAMER is the first step towards perfected robot-human partner teams.