Almost everyone would’ve seen this coming. A group of scientists has decided to merge OpenAI’s popular chatbot ChatGPT and Boston Dynamics’ Spot, giving the robot dog a voice through Google’s Text-to-Speech tool.
This successful integration, which was first shared online by machine learning engineer Santiago Valdarrama, allows for the canine to respond to questions right away, so it seems as though it’s conversing with the operator.
“We can now ask the robots about past and future missions and get an answer in real time. ChatGPT interprets the question, parses the files, and formulates the answer,” Valdarrama explained.
That's where ChatGPT comes in.
We show it the configuration files and the mission results. We then ask questions using that context.
Put that together with a voice-enabled interface, and we have an awesome way to query our data!
According toInteresting Engineering, for the chatbot to work seamlessly with Spot, the researchers had to come up with specific phrases and procedures for the robot to follow.
This means the mechanical pet won’t be able to find the answer to every single query one may have, but it can give helpful information on its missions and receive orders from its operator on the go.
Examples of such questions include “Are you standing?” and “What is your battery level?” allowing the robot to output the data it gathers on a mission in language that’s natural and easy to understand.
Check out ChatGPT-integrated Spot in action below.