Revolutionizing AI: ChatGPT Can Now See Through Your Phone’s Camera and Screen
ChatGPT’s New Visual Features Explained
ChatGPT has just gotten smarter and more useful. It can now see what’s on your phone’s camera and screen, letting it help you in all kinds of cool ways. Whether you need advice on decorating your living room, help with a math problem, or a quick response to a text message, this feature makes ChatGPT even more powerful.
OpenAI, the company behind ChatGPT, first hinted at these abilities earlier this year. Now, after months of waiting, they’ve finally rolled it out. This update is part of OpenAI’s “Shipmas” series, where they’re unveiling new features. With this upgrade, ChatGPT can now understand what it sees through your camera and provide live help.
What’s New and How It Works
The new features bring a fresh layer of interaction to ChatGPT by letting it see what’s happening around you. Here’s how you can use it:
- Video Mode: Open the ChatGPT app, tap on the Advanced Voice Mode icon, and then hit the video button on the button far left. This activates the camera, allowing ChatGPT to see what’s in front of it and give feedback or advice based on what it sees.
- Screen Sharing: To share what’s on your phone screen, use the dropdown menu in the app and select “Share Screen.” ChatGPT can then analyze what’s on your screen and help you, whether you’re stuck on a text message or need assistance with an app.
Real-Life Examples
OpenAI showed off these features in a livestream, and the results were impressive. For example, an OpenAI employee made pour-over coffee with ChatGPT’s guidance. The AI noticed the employee’s tools and outfit, walked him through each step, and even gave feedback on how to improve his technique.
Another example involved screen sharing. ChatGPT recognized that the user was in the Messages app and helped draft a thoughtful reply. This makes it perfect for anyone looking to save time and effort in their daily communication.
Who Can Access It
Most ChatGPT Plus and Pro users, as well as all Team users, can access video and screen-sharing features through the ChatGPT mobile app, according to OpenAI. Enterprise and Edu users are set to start using video and screen-sharing in January 2025.
