- Google announces Gemini Live, a real-time AI guide for Pixel phones.
- Uses phone’s camera and screen sharing for instant help understanding the world.
- Can identify objects, compare products, break down instructions, and more.
- Free on Pixel 9, available with Gemini Advanced for other Pixels.
- Accessed by holding the power button and tapping the Live button.
Google Launches Gemini Live: Your Pixel Phone, Now a Real-Time AI Assistant
Mountain View, CA – Google has announced the launch of Gemini Live, an innovative feature designed to turn Pixel smartphones into intelligent, real-time guides. By harnessing the power of multimodal artificial intelligence, Gemini Live allows users to interact with the world around them in a more intuitive and informative way.
Imagine encountering an unfamiliar dish in a restaurant or trying to understand a complex product in a store. With Gemini Live, users can simply point their phone’s camera at the object, and the AI will provide instant insights and information. This new capability extends beyond just identifying objects; Gemini Live can also assist with understanding architecture, comparing products, and breaking down complicated instructions, effectively elevating the Pixel from a traditional smartphone to a versatile problem-solving tool.
Gemini Live utilizes multimodal AI, enabling it to process and understand information from both the camera view and the phone’s screen. This allows for a more natural and comprehensive interaction with the environment. The feature will be available at no cost with all new Pixel 9 phones. For users with other Pixel devices, Gemini Live can be accessed through a Gemini Advanced subscription.
Discovering the World Through Your Camera
Whether exploring a new city and encountering unfamiliar landmarks or navigating a busy train station, Gemini Live acts as an instant guide and discovery tool. By showing Gemini a landmark, a storefront, or even a meal, the AI functions as a personal assistant, providing details about what is being viewed. Users can then ask follow-up questions to delve deeper into the history, significance, or related recommendations. As the camera view changes, Gemini Live dynamically updates the information, offering a multi-faceted understanding of the subject.
Enhancing Online Experiences with Screen Sharing
Gemini Live also integrates seamlessly with screen sharing. When planning an outing, users can share their browser screen with Gemini Live to quickly gather relevant details about nearby places, events, or cultural highlights. This allows for a more interactive planning process, as users can have a conversation with Gemini to explore options and ensure they are well-prepared for their next adventure.
Making Informed Decisions and Simplifying Tasks
Gemini Live can also assist with online tasks, such as comparing products. Instead of sifting through numerous reviews for two big-screen TVs, users can simply share their screen with Gemini Live and ask for a comparison based on specific criteria, like suitability for a bright room. The AI will instantly compare relevant features, prices, and reviews, aiding in making the right choice.
Furthermore, Gemini Live can simplify complex tasks. By uploading an instruction manual PDF, for example, the AI can identify necessary tools and guide users through the steps, eliminating the need to constantly refer back to the document.
Accessing Gemini Live on Your Pixel
Accessing Gemini Live is straightforward. On Pixel 9 and other compatible Pixel devices, users can press and hold the power button, then tap the Live button, which is indicated by three lines next to the microphone icon. Once in Gemini Live, users can choose between camera and screen sharing options at the bottom of the screen. To share the screen directly, holding the power button and tapping the “Share screen with Live” tab is another quick method. Alternatively, the screen share icon can be tapped within the Gemini Live app. To share the camera view, users can simply tap the camera icon within the Gemini Live app.
With the introduction of Gemini Live, Google aims to provide users with an intuitive and powerful tool that transforms their Pixel phone into an indispensable companion for navigating and understanding the world around them. As Google states, “The world doesn’t come with a personal guide. But now your phone does.” Gemini Live promises to offer answers, options, and hands-free help whenever needed, making guesswork and constant rewinding a thing of the past.