This week ChatGPT learned to draw, see and talk

Explore ChatGPT's game-changing features, from generating stunning images to analyzing visuals, and revolutionize your content realization process.

This week ChatGPT learned to draw, see and talk
I usually opt for my own photos, but having one generated by ChatGPT and DALLE-3 just makes more sense.

It was indeed a glorious week for ChatGPT enthusiasts as three exciting new features were launched, making this AI-powered tool even more versatile and capable.

In this blog post, we'll delve into these exciting developments and provide examples to showcase their functionality. I will use a demo approach which will help you discover and use the features described.

1. Image Generation with DALLE-3 Integration

One of the most anticipated additions is the integration of DALLE-3, a cutting-edge image generation model. Now, ChatGPT can generate images based on text descriptions, opening up a world of creative possibilities. Whether you need illustrations for your content or want to visualise your ideas, ChatGPT's DALLE-3 integration has you covered.

Example:

Imagine describing a fantastical scene in your blog post (Show the Amsterdam Rijksmuseum alone in a polder like landscape), and with a simple command, ChatGPT can bring it to life with a stunning image like this:

Example of image generation with DALLE-E in ChatGPT
Example of image generation with DALLE-E in ChatGPT
💡
Please note that the first feature, image generation with DALLE-3 integration, is currently available exclusively on the browser version of ChatGPT and is not yet accessible through the app. To access this feature, simply visit ChatGPT on your web browser, switch to GPT-4 mode, and then select DALLE-3.

2. Image Analysis and Description

Another remarkable feature is the ability to upload images for analysis and description. This functionality can be a game-changer for content creators, marketers, and strategists.

ChatGPT can provide detailed insights about the content of an image, making it easier to understand and utilise visual information.

Example:

Suppose you've captured a photo of a some scene, and you want to know more about its characteristics. Upload the image, and ChatGPT can analyse and describe it like this:

  • Image Analysis: “What do we see here?”
  • Description: "The image displays a collection of wooden pencils neatly arranged in wooden compartments or shelves. Each compartment contains pencils with the same coloured tip, indicating that the pencils have been organised by colour. The tips of the pencils are prominently visible, showcasing a vibrant spectrum of colours. The pencils seem to be of the classic hexagonal shape and appear unused or sharpened to a uniform length. The wooden compartments lend a rustic aesthetic to the image. Overall, the picture captures an artistic and orderly presentation of coloured pencils."
Example of image analysis from within ChatGPT
Example of image analysis from within ChatGPT
💡
I tested this both on browser and app. You select ChatGPT-4, upload an image from the prompt box and start asking questions.

3. Voice Interaction with ChatGPT

The third exciting feature is the ability to have voice interactions with ChatGPT. This takes conversational AI to a whole new level. You can now communicate with ChatGPT using your voice, enabling more natural and dynamic conversations.

Example:

Let's say you're brainstorming ideas for your next blog post. Instead of typing out your thoughts, you can simply speak to ChatGPT, and it will respond with voice, enhancing the flow of your creative process.

💡
Activate this by going to the app, go to settings and choose new features. There you will see a button to activate 'Voice conversations'.
After activation in the settings you will find an icon to start voice conversations
After activation in the settings you will find an icon to start voice conversations

Draw, see, and talk

These three new features represent significant advancements in the capabilities of ChatGPT.

From generating images to analysing them and engaging in voice conversations, ChatGPT is evolving to be a comprehensive tool for content realisation, online marketing, and more.

As a web strategist I am impressed by the capability to analyse photo’s through prompting. And for the content creator, these new features can undoubtedly amplify the capabilities and bring a new level of creativity to your work. So, check out these exciting developments and explore the endless possibilities they offer in your field.

And I hope these simple demo’s help you to keep track of all the innovations and use them.