ChatGPT Can Now ‘Hear’ Your Voice, ‘Speak’ Back, And ‘See’ Image Prompts
Last week, ChatGPT unveiled a brand-new feature merging the powers of the popular chatbot and the image generator DALL-E—offering more precise responses to prompts and the ability to generate vivid artwork within the former’s platform.
Now, in another significant update, it appears the artificial intelligence program can now “see, hear, and speak” as OpenAI rolls out voice and image capabilities that promise a “more intuitive type of interface.”
For example, users can snap a picture of a landmark while traveling, feed it to the model, and engage in a real-time conversation on its storied history. Stuck at home? One can input images of ingredients in the refrigerator and ask for a step-by-step recipe to use up all the produce.
ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms). https://t.co/uNZjgbR5Bm pic.twitter.com/paG0hMshXb
— OpenAI (@OpenAI) September 25, 2023
When speaking to ChatGPT, individuals can choose from five different voices, all of which are powered by a text-to-speech model that generates “human-like audio” just from a few seconds of sample speeches.
In terms of image prompts, users will be able to show the chatbot more than one picture at once, with the added option of using the drawing tool in the platform’s mobile application to focus on a specific section of the photograph.
Naturally, the new technology brings along with it another set of worries, as these powerful capabilities are likely to lead to the risk of malicious actors using the tools to impersonate others or for nefarious activities.
Use your voice to engage in a back-and-forth conversation with ChatGPT. Speak with it on the go, request a bedtime story, or settle a dinner table debate.
— OpenAI (@OpenAI) September 25, 2023
Sound on 🔊 pic.twitter.com/3tuWzX0wtS
As such, OpenAI decided to tap on voice actors for voice chat, so that other voices cannot be manipulated. Additionally, ChatGPT will not be able to analyze or make determinations when shown images of people in order to “respect individuals’ privacy.”
These new features will be rolled out to ChatGPT Plus and Enterprise users over the next two weeks. Voice chat will be made available on iOS and Android, while the image tool will be integrated on all platforms.
[via Engadget and TechCrunch, cover image via OpenAI]
