Daily Inspiration: "The real magic begins once we start to chat with the machines" - Futurist Jim Carroll
In the TV series The Jetsons, the humans regularly talked to the robots.
That future isn't that far away. Watch the video in which the Google DeepMind research group is using ChatGPT-like commands to instruct a robotic arm to use its machine vision to identify and work with a particular object. In this case, it's been asked to identify and lift the extinct animal. It's figured out which animal figure is the extinct one, utilizing its AI-based machine-vision analysis, and proceeds accordingly. Imagine this - the next command could be something as simple as this - "Find the king of the jungle and place it next to the sports item used by LeBron James." Magical!
The full details of this not-too-small achievement can be found on an extensive page that details all the work behind the scenes: "RT-2: Vision-Language-Action Models: Transfer Web Knowledge to Robotic Control."
In other words, we're learning how to use large language models - the tech behind Bard, ChatGPT, and Bing -- to figure out what to do and translate these results into actions that are given to the robots.
