Robots Master Jenga Whipping with AI-Powered Training
Researchers at UC Berkeley have developed an AI-powered training method that enables robots to master complicated tasks like Jenga whipping with a 100% success rate. The system, called Human-in-the-Loop Sample Efficient Robotic Reinforcement Learning (HiL-SERL), teaches robots how to perform tasks by studying demonstrations and learning from both human feedback and its own real-world attempts. This training protocol allows robots to learn complex tasks such as assembling a computer motherboard, building a shelf, and more, within one to two hours.
Key Takeaways:
- The new system, HiL-SERL, enables robots to master complicated tasks like Jenga whipping with a 100% success rate.
- The robots are taught at an impressive speed, allowing them to learn within one to two hours how to perfectly assemble a computer motherboard, build a shelf, and more.
- The system combines reinforcement learning with human intervention, allowing humans to correct the robot's course and incorporate those corrections into the robot's memory bank.
- The researchers put the robotic system through a gauntlet of complicated tasks, including flipping an egg in a pan, passing an object from one arm to another, and assembling a motherboard, car dashboard, and timing belt, all with 100% accuracy.
- The system was compared to a common "copy my behavior" method known as behavioral cloning, and the results showed that the new system made the robots faster and more accurate.
- The researchers emphasized that the bar for robot competency is very high, and that made-to-order manufacturing processes could benefit from robots that can reliably and adaptably learn a range of tasks.
Statistics:
- 100% success rate in mastering complicated tasks like Jenga whipping
- 1-2 hours to learn complex tasks such as assembling a computer motherboard and building a shelf
- 30% human intervention in the initial stages of training gradually decreasing to less attention
- 100% accuracy in tasks such as flipping an egg in a pan, passing an object from one arm to another, and assembling a motherboard, car dashboard, and timing belt
Sources:
- "Human-in-the-Loop Sample Efficient Robotic Reinforcement Learning" study appearing August 20 in the journal Science Robotics.
- Sergey Levine's Robotic AI and Learning Lab at UC Berkeley.
- Jianlan Luo, postdoctoral researcher at UC Berkeley.
- Charles Xu and Jeffrey Wu, researchers at UC Berkeley.
- Science Robotics journal.