INSUBCONTINENT EXCLUSIVE:
A RHyME-equipped robot picking up a mug from a counter
| Source: Cornell UniversityCornell University researchers have developed a new robotic framework powered by artificial intelligence
RHyME — Retrieval for Hybrid Imitation under Mismatched Execution — allows robots to learn tasks by watching a single how-to
video.Robots can be finicky learners, said the Columbia team
Historically, they have required precise, step-by-step directions to complete basic tasks
They also tend to quit when things go off-script, like after dropping a tool or losing a screw
However, RHyME could fast-track the development and deployment of robotic systems by significantly reducing the time, energy, and money
needed to train them, the researchers claimed
: One of the annoying things about working with robots is collecting so much data on the robot doing different tasks, : said Kushal Kedia,
a doctoral student in the field of computer science
: Thats not how humans do tasks
We look at other people as inspiration
: Kedia will present the paper, : One-Shot Imitation under Mismatched Execution, : next month at the Institute of Electrical and
Electronics Engineers (IEEE) International Conference on Robotics and Automation (ICRA) in Atlanta.Paving the path for home
robotshttps://www.therobotreport.com/wp-content/uploads/2025/04/Sequence-01.mp4The university team said home robot assistants are still a
long way off because they lack the wits to navigate the physical world and its countless contingencies.To get robots up to speed,
researchers like Kedia are training them with how-to videos — human demonstrations of various tasks in a lab setting
The Cornell researchers said they hope this approach, a branch of machine learning called : imitation learning, : will enable robots to
learn a sequence of tasks faster and be able to adapt to real-world environments
: Our work is like translating French to English were translating any given task from human to robot, : said senior author Sanjiban
Choudhury, assistant professor of computer science.This translation task still faces a broader challenge: Humans move too fluidly for a
robot to track and mimic, and training robots requires a lot of video
Furthermore, video demonstrations of, say, picking up a napkin or stacking dinner plates must be performed slowly and flawlessly
Any mismatch in actions between the video and the robot has historically spelled doom for robot learning, the researchers said
: If a human moves in a way thats any different from how a robot moves, the method immediately falls apart, : Choudhury said
: Our thinking was, ‘Can we find a principled way to deal with this mismatch between how humans and robots do tasks? : Cornell RHyME
helps robots learn multi-step tasksRHyME is the teams answer a scalable approach that makes robots less finicky and more adaptive
It enables a robotic system to use its own memory and connect the dots when performing tasks it has viewed only once by drawing on videos it
has seen.For example, a RHyME-equipped robot shown a video of a human fetching a mug from the counter and placing it in a nearby sink will
comb its bank of videos and draw inspiration from similar actions, like grasping a cup and lowering a utensil.The team said RHyME paves the
way for robots to learn multiple-step sequences while significantly lowering the amount of robot data needed for training
RHyME requires just 30 minutes of robot data; in a lab setting, robots trained using the system achieved a more than 50% increase in task
success compared to previous methods, the Cornell researchers said
: This work is a departure from how robots are programmed today
The status quo of programming robots is thousands of hours of teleoperation to teach the robot how to do tasks
Thats just impossible, : Choudhury stated
: With RHyME, were moving away from that and learning to train robots in a more scalable way
: Register now so you don't miss out!The post Cornell University teaches robots new tasks from how-to videos in just 30 minutes appeared
first on The Robot Report.Sequence-01.mp4?#Size: 17.12 Mb
