Skip to content
Header Image
Hommeattitude
  • Home Design
  • Home Improvement
  • News Home
  • Home & Garden
  • House Renovation
  • household
  • About Us
    • Advertise Here
    • Contact Us
    • Privacy Policy
    • Sitemap
household

Robots learn household tasks by watching humans

  • Kim J. Clark
  • August 3, 2022
Robots learn household tasks by watching humans
With WHIRL, a robot learned how to do more than 20 tasks—from opening and closing appliances, cabinet doors and drawers to putting a lid on a pot, pushing in a chair and even taking a garbage bag out of the bin. Credit: Carnegie Mellon University

The robot watched as Shikhar Bahl opened the refrigerator door. It recorded his movements, the swing of the door, the location of the fridge and more, analyzing this data and readying itself to mimic what Bahl had done.

It failed at first, missing the handle completely at times, grabbing it in the wrong spot or pulling it incorrectly. But after a few hours of practice, the robot succeeded and opened the door.

“Imitation is a great way to learn,” said Bahl, a Ph.D. student at the Robotics Institute (RI) in Carnegie Mellon University’s School of Computer Science. “Having robots actually learn from directly watching humans remains an unsolved problem in the field, but this work takes a significant step in enabling that ability.”

Bahl worked with Deepak Pathak and Abhinav Gupta, both faculty members in the RI, to develop a new learning method for robots called WHIRL, short for In-the-Wild Human Imitating Robot Learning. WHIRL is an efficient algorithm for one-shot visual imitation. It can learn directly from human-interaction videos and generalize that information to new tasks, making robots well-suited to learning household chores. People constantly perform various tasks in their homes. With WHIRL, a robot can observe those tasks and gather the video data it needs to eventually determine how to complete the job itself.

The team added a camera and their software to an off-the-shelf robot, and it learned how to do more than 20 tasks—from opening and closing appliances, cabinet doors and drawers to putting a lid on a pot, pushing in a chair and even taking a garbage bag out of the bin. Each time, the robot watched a human complete the task once and then went about practicing and learning to accomplish the task on its own. The team presented their research this month at the Robotics: Science and Systems conference in New York.






“This work presents a way to bring robots into the home,” said Pathak, an assistant professor in the RI and a member of the team. “Instead of waiting for robots to be programmed or trained to successfully complete different tasks before deploying them into people’s homes, this technology allows us to deploy the robots and have them learn how to complete tasks, all the while adapting to their environments and improving solely by watching.”

Current methods for teaching a robot a task typically rely on imitation or reinforcement learning. In imitation learning, humans manually operate a robot to teach it how to complete a task. This process must be done several times for a single task before the robot learns. In reinforcement learning, the robot is typically trained on millions of examples in simulation and then asked to adapt that training to the real world.

Both learning models work well when teaching a robot a single task in a structured environment, but they are difficult to scale and deploy. WHIRL can learn from any video of a human doing a task. It is easily scalable, not confined to one specific task and can operate in realistic home environments. The team is even working on a version of WHIRL trained by watching videos of human interaction from YouTube and Flickr.

Progress in computer vision made the work possible. Using models trained on internet data, computers can now understand and model movement in 3D. The team used these models to understand human movement, facilitating training WHIRL.

With WHIRL, a robot can accomplish tasks in their natural environments. The appliances, doors, drawers, lids, chairs and garbage bag were not modified or manipulated to suit the robot. The robot’s first several attempts at a task ended in failure, but once it had a few successes, it quickly latched on to how to accomplish it and mastered it. While the robot may not accomplish the task with the same movements as a human, that’s not the goal. Humans and robots have different parts, and they move differently. What matters is that the end result is the same. The door is opened. The switch is turned off. The faucet is turned on.

“To scale robotics in the wild, the data must be reliable and stable, and the robots should become better in their environment by practicing on their own,” Pathak said.


Researchers develop algorithm to divvy up tasks for human-robot teams


More information:
Conference: roboticsconference.org/

Provided by
Carnegie Mellon University


Citation:
Robots learn household tasks by watching humans (2022, July 20)
retrieved 3 August 2022
from https://techxplore.com/news/2022-07-robots-household-tasks-humans.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Tagged "Home Improvement Jill'S Dad, A&L Home Improvement, D&L Home Improvements, Home Improvement Jill'S Mom, Home Improvement Karate, Home Improvement Karen, Home Improvement Kelly Barnes, Home Improvement Kid Death, Home Improvement Kid Died, Home Improvement Kids, Home Improvement Kit, Home Improvement Kitchen, Home Improvement License, Home Improvement Loan Calculator, Home Improvement Loan Interest Rates, Home Improvement Loan Rates, Home Improvement Loans For Bad Credit, Home Improvement Loans In Texas, Home Improvement Logo, Home Improvement Magazine, Home Improvement Market, Home Improvement Meaning, Home Improvement Memes, Home Improvement Mom, Home Improvement Mortgage, Home Improvement Movie, Home Improvement Mr Wilson, Home Improvement Near Me", J Home Improvement Bakersfield, J Home Improvement Bakersfield Ca 93308, J Home Improvement Bakersfield California, J Home Improvement Inc, J Moon Home Improvements, J&K Home Improvement, J&M Home Improvements, K Home Improvements, K Home Improvements Springfield Pa, K&M Home Improvements, K&S Home Improvements, L Pearce Home Improvements, L&J Home Improvements, L&Q Home Improvements, L&S Home Improvements, M&M Home Improvement, P&K Home Improvements, R&M Home Improvements, T&K Home Improvements, T&K Home Improvements Reviews, T&M Home Improvement

Post navigation

What Are The Benefits of Installing a Split AC?
Maximize your decor: 6 ways to design big without creating clutter

Related Posts

Selling Your Home As FSBO – What You Need to Know

Selling Your Home As FSBO – What You Need to Know

There is no rule dictating that you can’t sell your own by yourself. In fact,…

June 25, 2024December 8, 2022

Kare Design: Why You Should Hire A Butler As Soon As Possible

These residence helpers are assured to conquer everyone’s hearts: the KARE butlers not only faithfully…

May 24, 2022

Essential Additions if You Want a Garden to Entertain In

Most of us could quite effortlessly generate a enormous listing of issues that we’d like…

May 26, 2022
June 2025
M T W T F S S
 1
2345678
9101112131415
16171819202122
23242526272829
30  
« May    

Archives

  • June 2025
  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • November 2018
  • October 2018
  • January 2017

Categories

  • Building Inspections
  • Business
  • Cleaning Portal
  • Construction
  • Entertainment
  • Home & Garden
  • Home Design
  • Home Improvement
  • House Renovation
  • household
  • News Home
  • Property
  • Real Estate
  • Regular Cleaning

Recent Posts

  • Why a Local Solar Company in Phoenix, AZ Is Your Smartest Move
  • The Environmental Impact of Demolition and How to Minimize It!
  • The Ultimate Guide to Buying Home Decor Furniture Online
  • Unlock Free Home Repair Aid in Binghamton
  • Preventative HVAC Maintenance: Save Money and Stay Cool in Florida

Fiverr

Fiverr Logo

Tags

"Home Improvement Jill'S Dad A&L Home Improvement D&L Home Improvements Home Improvement Jill'S Mom Home Improvement Karate Home Improvement Kelly Barnes Home Improvement Kid Death Home Improvement Kid Died Home Improvement Kids Home Improvement Kit Home Improvement Kitchen Home Improvement Loan Calculator Home Improvement Loan Interest Rates Home Improvement Loan Rates Home Improvement Loans For Bad Credit Home Improvement Loans In Texas Home Improvement Logo Home Improvement Magazine Home Improvement Market Home Improvement Meaning Home Improvement Memes Home Improvement Mom Home Improvement Mortgage Home Improvement Movie Home Improvement Mr Wilson Home Improvement Near Me" J&K Home Improvement J&M Home Improvements J Home Improvement Bakersfield J Home Improvement Bakersfield Ca 93308 J Home Improvement Bakersfield California J Home Improvement Inc J Moon Home Improvements K&M Home Improvements K&S Home Improvements K Home Improvements L&J Home Improvements L&Q Home Improvements L&S Home Improvements L Pearce Home Improvements P&K Home Improvements R&M Home Improvements T&K Home Improvements T&K Home Improvements Reviews T&M Home Improvement
hommeattitude.com Theme: Wise News By Artify Themes.

WhatsApp us