The Updated Spot Robot with ChatGPT: A True Sci-Fi Vision
The robot Spot of Boston Dynamics (property of hyundai) is undoubtedly the most advanced quadruped robot today. So imagine what this robot could look like equipped with the most sophisticated language model of the moment! Engineers managed to update Spot with the chatbot ChatGPT, and the result is very close to certain (nightmare?) visions of SF Equipped with its voice AI, Spot knows how to answer questions about its battery level or the number of tasks planned, and can also react directly to certain commands made aloud (and not through the remote’s graphical interface). Spot runs immediately when the engineer tells him to back off!
We integrated ChatGPT with our robots.
We had a ton of fun building this!
Read on for the details: pic.twitter.com/DRC2AOF0eU
—Santiago (@svpino) April 25, 2023
Spot’s new intelligence has its limits: ChatGPT does not “know” that it is the brain of a robot, for example. Another downside, the synthetic voice of Spot is that of Google’s Text-to-Speech software and does not seem really suited to a machine of this type. The transcription of voice into text (when talking to the robot) is provided by Whisper, a tool integrated into ChatGPT.
For Santiago Valdarrama, one of the two engineers behind this convincing DIY, equipping such a robot with voice capabilities makes sense above all in terms of general ergonomics of use: “Robots perform automated missions every day. Each uses configuration files that are miles long and hard to understand. Only technicians can handle them. At the end of each mission, the robots record a ton of data. There is no easy way to query all of this data on demand. […] We can now query robots about past and future missions and get a real-time response. ChatGPT interprets the question, analyzes the files and formulates the answer. »
