Jump to content

Robots learn to cook by watching YouTube

Rohith_Kumar_Sp

When it comes to learning how to cook, it turns out that robots may not be so different from humans after all... or are they?
 

When it comes to teaching robots how to do things, there are some very key differences. A human knows what you mean when you say "I need a cup". A robot needs to be taught that that means it has to turn around, go to the cupboard, open it, take out the cup, close the cupboard, turn back around, return to you, manoeuvre the cup over the bench, and release the cup.
 

This is one of the key parts of figuring out machine learning: How can you program a robot so that it can intuit that a plastic cup, a glass and a mug may all be classified under the general term "cup"? How can you design a robot that is able to teach itself?
 

One way, as researchers at the University of Maryland Institute for Advanced Computer Studies are finding out, is YouTube. More specifically, cooking tutorials on YouTube. By watching these videos, robots are able to learn the complicated series of grasping and manipulation motions required for cooking by observing what humans do on the Internet.
 

"We chose cooking videos because everyone has done it," said UMD professor of computer science and director of the UMIACS Computer Vision Lab Yiannis Aloimonos. "But cooking is complex in terms of manipulation, the steps involved and the tools you use. If you want to cut a cucumber, for example, you need to grab the knife, move it into place, make the cut and observe the results to make sure you did them properly."
 

umdrobotics.jpg

The robot uses several key systems in order to learn from YouTube videos. Computer vision, with two different recognition systems, allows the robot to visually process how the presenter grabs something, artificial intelligence processes that information, and finally language parsing helps it understand spoken commands and translate it into an action.
 

In this way, the robot can gather individual steps from various videos and assign them rules according to its programming, putting them together in the correct order.
 

"We are trying to create a technology so that robots eventually can interact with humans," said UMIACS associate research scientist Cornelia Fermüller. "For that, we need tools so that the robots can pick up a human's actions and track them in real time. We are interested in understanding all of these components. How is an action performed by humans? How is it perceived by humans? What are the cognitive processes behind it?"
 

The difference, the team said, between their research and previous efforts is that they are concentrating on the goal, not the steps. The robot can draw on their databank of actions to string them together achieve the goal, rather than copying verbatim, step-by-step, a series of actions.
 

It's a system that apparently works. According to the team's paper, the grasping recognition module had an average precision of 77 percent, and an average recall rate of 76 percent. For the object recognition module, the robot achieved an average precision of 93 percent and an average recall of 93 percent. Overall, recognition accuracy on objects was 79 percent, grasping was 91 percent, and predicted actions was 83 percent. The drop in object recognition accuracy was because the robot had not been trained on some objects, such as tofu.
 

"By having flexible robots, we're contributing to the next phase of automation. This will be the next industrial revolution," said Aloimonos. "We will have smart manufacturing environments and completely automated warehouses. It would be great to use autonomous robots for dangerous work -- to defuse bombs and clean up nuclear disasters such as the Fukushima event. We have demonstrated that it is possible for humanoid robots to do our human jobs."

The team will be presenting their research at the Association for the Advancement of Artificial Intelligence Conference in Austin, Texas, on January 29, 2015.

https://www.youtube.com/watch?v=xRwhsFtUnpc

Source : http://www.cnet.com/news/robots-learning-to-cook-by-watching-youtube-videos/

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

thats how I learned to cook

 

AM I A ROBOT?

Desktop - Corsair 300r i7 4770k H100i MSI 780ti 16GB Vengeance Pro 2400mhz Crucial MX100 512gb Samsung Evo 250gb 2 TB WD Green, AOC Q2770PQU 1440p 27" monitor Laptop Clevo W110er - 11.6" 768p, i5 3230m, 650m GT 2gb, OCZ vertex 4 256gb,  4gb ram, Server: Fractal Define Mini, MSI Z78-G43, Intel G3220, 8GB Corsair Vengeance, 4x 3tb WD Reds in Raid 10, Phone Oppo Reno 10x 256gb , Camera Sony A7iii

Link to comment
Share on other sites

Link to post
Share on other sites

OH DEAR GOD THEY ARE LEARNING

PLS NO Skynet

CPU: i5-4690k GPU: 280x Toxic PSU: Coolermaster V750 Motherboard: Z97X-SOC RAM: Ripjaws 1x8 1600mhz Case: Corsair 750D HDD: WD Blue 1TB

How to Build A PC|Windows 10 Review Follow the CoC and don't be a scrub~soaringchicken

 

Link to comment
Share on other sites

Link to post
Share on other sites

It's coming....

 

"Robot learns how to search on youtube"

"Robot watches video about murder"

"Robot learns how to kill"

Rig: I5-3570K@4.3Ghz - Cooler Thermaltake Frio Advanced - Ram Kingston 1333Mhz 8gb (2x4) - GPU GTX 970 4GD5T OC - Motherboard Z77MA-G45 - PSU CoolerMaster GX II 750w - Storage WD 500gb HDD - Sound Edifier M3700 5.1 - Headset Corsair Vengeance 1500 - Mouse Razer Deathadder 2013 - Keyboard Razer Anansi - Mousepad Steelseries QcK+ - Xbox 360 Wireless Controller x2

Link to comment
Share on other sites

Link to post
Share on other sites

Spicy meatball

Thats a spicy way to get killed by robots 

Link to comment
Share on other sites

Link to post
Share on other sites

thats how I learned to cook

 

AM I A ROBOT?

Who said anything abt being a robot if you learn from the internet xD  

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

It's coming....

 

"Robot learns how to search on youtube"

"Robot watches video about murder"

"Robot learns how to kill"

This is my biggest fear 

Link to comment
Share on other sites

Link to post
Share on other sites

This is my biggest fear 

it's only as the maker created it , Robots have no gain or motive to kill us , Humans may be greedy and jealous to kill an other person but a robot isn't 

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

PLS NO Skynet

Not anytime soon. A robot doesn't have the "brain capacity" to handle enough information to go beyond basic tasks.

Link to comment
Share on other sites

Link to post
Share on other sites

Not anytime soon. A robot doesn't have the "brain capacity" to handle enough information to go beyond basic tasks.

It's all in good fun man, I'm kidding

CPU: i5-4690k GPU: 280x Toxic PSU: Coolermaster V750 Motherboard: Z97X-SOC RAM: Ripjaws 1x8 1600mhz Case: Corsair 750D HDD: WD Blue 1TB

How to Build A PC|Windows 10 Review Follow the CoC and don't be a scrub~soaringchicken

 

Link to comment
Share on other sites

Link to post
Share on other sites

Who said anything abt being a robot if you learn from the internet xD  

 

clearly I was joking.....

Desktop - Corsair 300r i7 4770k H100i MSI 780ti 16GB Vengeance Pro 2400mhz Crucial MX100 512gb Samsung Evo 250gb 2 TB WD Green, AOC Q2770PQU 1440p 27" monitor Laptop Clevo W110er - 11.6" 768p, i5 3230m, 650m GT 2gb, OCZ vertex 4 256gb,  4gb ram, Server: Fractal Define Mini, MSI Z78-G43, Intel G3220, 8GB Corsair Vengeance, 4x 3tb WD Reds in Raid 10, Phone Oppo Reno 10x 256gb , Camera Sony A7iii

Link to comment
Share on other sites

Link to post
Share on other sites

clearly I was joking.....

so was i ,well atleast i meant it that way ,English is not my first language , pardon me .

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

it's only as the make created it , Robots have no gain or motive to kill us , Humans may be greedy and jealous to kill an other person but a robot isn't 

You say this now

Link to comment
Share on other sites

Link to post
Share on other sites

Not anytime soon. A robot doesn't have the "brain capacity" to handle enough information to go beyond basic tasks.

Idk about you, but i have at least 40 more years of life, now think how everything was 40 years ago(1975) and how's now, and imagine how shit's going to be in 40 years.

 

This shit is not that distant.

 

 

clock_cat.gif

Rig: I5-3570K@4.3Ghz - Cooler Thermaltake Frio Advanced - Ram Kingston 1333Mhz 8gb (2x4) - GPU GTX 970 4GD5T OC - Motherboard Z77MA-G45 - PSU CoolerMaster GX II 750w - Storage WD 500gb HDD - Sound Edifier M3700 5.1 - Headset Corsair Vengeance 1500 - Mouse Razer Deathadder 2013 - Keyboard Razer Anansi - Mousepad Steelseries QcK+ - Xbox 360 Wireless Controller x2

Link to comment
Share on other sites

Link to post
Share on other sites

so was i ,well atleast i meant it that way ,English is not my first language , pardon me .

 

hehe ok

 

 

it's only as the maker created it , Robots have no gain or motive to kill us , Humans may be greedy and jealous to kill an other person but a robot isn't 

 

 

If robots gain intelligence, they might realise we are destroying the planet, and causing wars etc, maybe they will kill us because we are bad for the planet

Desktop - Corsair 300r i7 4770k H100i MSI 780ti 16GB Vengeance Pro 2400mhz Crucial MX100 512gb Samsung Evo 250gb 2 TB WD Green, AOC Q2770PQU 1440p 27" monitor Laptop Clevo W110er - 11.6" 768p, i5 3230m, 650m GT 2gb, OCZ vertex 4 256gb,  4gb ram, Server: Fractal Define Mini, MSI Z78-G43, Intel G3220, 8GB Corsair Vengeance, 4x 3tb WD Reds in Raid 10, Phone Oppo Reno 10x 256gb , Camera Sony A7iii

Link to comment
Share on other sites

Link to post
Share on other sites

I would love a robot that can cook for me when I'm lazy. In a closed environment though to prevent that. V

 

It's coming....

 

"Robot learns how to search on youtube"

"Robot watches video about murder"

"Robot learns how to kill"

*flings kitchen knife*

.

Link to comment
Share on other sites

Link to post
Share on other sites

First the Japanese overlords and their vehicles of destruction, now the impending mayhem of pan-wielding learning death machines? Whats next? IRobot and Skynet shit?

| --- My Stuff --- |


Computer: Apple Late-2008 Macbook Pro ; -Haguro- build: http://linustechtips.com/main/topic/296613-wip-project-haguro-x99-hackintosh-workstation/|


Mobile Devices: Apple 32GB 1st gen Ipad Mini ; Apple 16GB Iphone 5s ; Apple Ipod Classic 80Gb 5th Gen ; Apple Ipod Classic 120Gb 6th Gen ; Apple Ipod Classic 160Gb 7th Gen ; Apple Ipod Nano 16Gb 6th Gen 

Link to comment
Share on other sites

Link to post
Share on other sites

It's all in good fun man, I'm kidding

 

Idk about you, but i have at least 40 more years of life, now think how everything was 40 years ago(1975) and how's now, and imagine how shit's going to be in 40 years.

 

This shit is not that distant.

 

 

-snip-

I personally feel as if we do harness the technology to be capable of at least building a semi-retarded terminator.

 

arnie-terminator-smile.jpg

Link to comment
Share on other sites

Link to post
Share on other sites

I personally feel as if we do harness the technology to be capable of at least building a semi-retarded terminator.

Convince it that bouncy balls are really dangerous and it having the intent to kill.

.

Link to comment
Share on other sites

Link to post
Share on other sites

If robots gain intelligence, they might realise we are destroying the planet, and causing wars etc, maybe they will kill us because we are bad for the planet

The first thing you do when you develop an AI that is self aware is to ask it to create  Robotic laws that can not be broken , namely don't not kill humans and nor can it hurt anyone laws , it will write the code, shut it down , Create another AI implement the law, Robot can only understand the value of saving earth if it is the primary programming to save earth , it isn't , i has no purpose to kill humans to save earth , save earth and do what exactly ? you get what i mean ? 

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

The first thing you do when you develop an AI that is self aware is to ask it to create  Robotic laws that can not be broken , namely don't not kill humans and nor can it hurt anyone laws , it will write the code, shut it down , Create another AI implement the law, Robot can only understand the value of saving earth if it is the primary programming to save earth , it isn't , i has no purpose to kill humans to save earth , save earth and do what exactly ? you get what i mean ? 

 

If it had TRUE AI, then it would be able to break rules and it would understand the concept of self gain

Desktop - Corsair 300r i7 4770k H100i MSI 780ti 16GB Vengeance Pro 2400mhz Crucial MX100 512gb Samsung Evo 250gb 2 TB WD Green, AOC Q2770PQU 1440p 27" monitor Laptop Clevo W110er - 11.6" 768p, i5 3230m, 650m GT 2gb, OCZ vertex 4 256gb,  4gb ram, Server: Fractal Define Mini, MSI Z78-G43, Intel G3220, 8GB Corsair Vengeance, 4x 3tb WD Reds in Raid 10, Phone Oppo Reno 10x 256gb , Camera Sony A7iii

Link to comment
Share on other sites

Link to post
Share on other sites

If it had TRUE AI, then it would be able to break rules and it would understand the concept of self gain

you should see a movie called Automata , it's really good 

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

you should see a movie called Automata , it's really good 

 

Is that the one with Antonio Banderas? looks interesting, will definitely watch it

Desktop - Corsair 300r i7 4770k H100i MSI 780ti 16GB Vengeance Pro 2400mhz Crucial MX100 512gb Samsung Evo 250gb 2 TB WD Green, AOC Q2770PQU 1440p 27" monitor Laptop Clevo W110er - 11.6" 768p, i5 3230m, 650m GT 2gb, OCZ vertex 4 256gb,  4gb ram, Server: Fractal Define Mini, MSI Z78-G43, Intel G3220, 8GB Corsair Vengeance, 4x 3tb WD Reds in Raid 10, Phone Oppo Reno 10x 256gb , Camera Sony A7iii

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×