Gemini’s Expanding Presence
Volvo Integrates Gemini Into Its Vehicles
Volvo is set to integrate Gemini into its vehicles, enabling drivers to interact with the AI through voice commands while staying focused on driving. This integration will allow drivers to send messages, translate them into different languages, consult the car’s manual, and obtain information about their destinations. The focus is on seamless integration that enhances the driving experience without adding undue distraction. The system is designed to be intuitive and responsive, adapting to the needs of the driver.
Google plans to roll out Gemini AI to vehicles with Android Auto in the coming months, followed by vehicles with Google built-in later in the year. Volvo, with its Google built-in equipped vehicles, will be among the first to experience this integration. This phased rollout ensures the system is thoroughly tested and optimized before being widely released.
Gemini’s Integration within Chrome
Google is strengthening the connection between its AI and browser by bringing Gemini to Chrome on desktops for English-speaking users. Access to this feature requires a Google AI Pro ($19.99 per month) or Google AI Ultra ($249.99/month) subscription. With this integration, users can easily ask Gemini to clarify complex information or summarize content on any webpage. This provides a convenient and efficient way for users to process information.
Future iterations will enable Gemini to work across multiple tabs and navigate to websites on the user’s behalf. This will essentially turn Gemini into a powerful research assistant that can automate many of the tasks involved in online research. The goal is to make the browsing experience more seamless and productive.
Gemini Live: Interactive Quizzes
Gemini has the functionality to generate interactive quizzes. As you answer, the system offers immediate feedback, pointing out areas that require further study. You can find this feature on both desktop and mobile platforms. Students in the US, Brazil, Indonesia, Japan, and the UK are entitled to a free Gemini upgrade during the academic year. This offering is aimed at supporting education and making AI tools more accessible to students. The quizzes are designed to be engaging and informative, helping students learn in a dynamic way.
Personalized Smart Replies
Google Workspace subscribers are poised to receive a suite of enhancements in Gmail, including personalized smart replies that adapt to "your typical tone" and an "inbox cleanup" option to automate mail management. These features are designed to make email communication more efficient and personalized. The AI learns from your writing style to generate replies that sound like you.
In the upcoming quarter, subscribers will also have the ability to restrict Gemini’s writing assistance to specific documents. This feature enhances privacy and control, allowing users to tailor the AI’s assistance to their specific needs. It ensures that sensitive information is not inadvertently shared with the AI.
Gemini Camera and Screen Sharing
Google introduced screen-sharing and live video capabilities for Gemini Live, its answer to ChatGPT’s voice mode. This feature allows users to ask questions about what’s displayed on their screen, initially available for Gemini app users with the Pixel 9 and Galaxy S25. Google announced at I/O that it’s available to all Android and iOS users via the Gemini app. This expansion makes the feature available to a broader audience, allowing more users to experience the benefits of live video interaction with AI.
AI-Powered Tools and Features
Project Astra: The Next-Generation AI Assistant
Project Astra, unveiled at I/O 2024, is designed as a next-generation AI assistant that can perceive the world around you. Astra has been integrated into the camera and screen-sharing capabilities of the Gemini app. Google has upgraded Astra’s voice output to be more natural with native audio, improved memory, and added computer control. The advancements in Astra aim to create a more intuitive and responsive AI assistant.
One demo illustrated a man seeking Astra’s help to fix his bike, from finding YouTube tutorials and extracting details from emails to calling a repair shop to inquire about a specific part. This showcases Astra’s ability to handle complex tasks that require information retrieval from multiple sources. The integration of various tools and services makes Astra a powerful problem-solving tool.
Another demo showcased a student pointing her phone at a math problem and asking Astra for assistance. It provides her with hints and picks back up later when the student returns to the problem. Despite the user diligently working through the homework herself, one can see that it could also help kids glide through without doing the work. This highlights the potential benefits and challenges of using AI in education. While it can provide valuable assistance, it’s important to use it responsibly and avoid relying on it to do the work for you.
Project Astra’s ability to perceive and understand the real world through the camera opens up a range of possibilities for assistance in various tasks, from identifying objects and providing information about them to helping with navigation and problem-solving. The improved voice output and memory further enhance the user experience, making the interaction with Astra more natural and seamless. The computer control integration allows Astra to directly interact with and control devices, further expanding its capabilities.
Project Mariner: Simplifying Mundane Tasks
Project Mariner is designed to assist with time-consuming but relatively simple tasks. In an introductory video, a Google project manager asks Mariner to take a list of companies she’s typed into Google Sheets and find their contact information. Updates in the past few months mean Mariner can now handle up to 10 different tasks at a time. These agents can assist you in looking up information, making bookings, buying things, performing research, and more. Mariner aims to free up users’ time by automating repetitive and mundane tasks.
For now, it’s limited to the $250/month Google AI Ultra plan in the US, but access will expand throughout the year. This limited availability allows Google to gather feedback and refine the system before a wider rollout. The focus is on ensuring the system is reliable and effective before making it available to more users.
Project Mariner’s ability to handle multiple tasks simultaneously makes it a powerful tool for boosting productivity. It can assist with a wide range of tasks, from scheduling appointments and making travel arrangements to finding information and conducting research. The goal is to empower users to accomplish more in less time.
Jules: The Autonomous Coding Agent
Google is releasing a beta version of its Jules coding agent. Jules employs Gemini 2.5 Pro and can perform tasks such as writing tests, building new features, fixing bugs, and providing audio changelogs. It works in the background and remains active until it’s ready for you to review its work. Jules aims to automate many of the tasks involved in software development.
While currently free, Google plans to charge for it once "the platform matures." This allows Google to gather feedback and refine the system before commercializing it. The focus is on ensuring the system is reliable and effective before charging users for it.
Jules’ ability to automate coding tasks can significantly enhance developer productivity. It can assist with a wide range of tasks, from writing unit tests and fixing bugs to generating code and creating documentation. The goal is to empower developers to focus on more creative and strategic aspects of software development.
Flow: AI-Powered Filmmaking
Flow is an AI filmmaking tool intended to assist aspiring filmmakers with the Veo, Imagen, and Gemini models. It incorporates camera controls, a scene builder, and the Flow TV library of content. Flow aims to democratize filmmaking by making it more accessible to everyone.
Flow is currently available to Google AI Pro and Google AI Ultra subscribers in the US; the former gets 100 generations per month, while the latter gets the highest usage limits and early access to Veo 3 with native audio generation, bringing environmental sounds and character dialogue directly into video creation. The opening clip shown at I/O was created entirely with Veo 3.
Flow’s ability to generate video content with native audio generation represents a significant advancement in AI filmmaking. It allows users to create more immersive and engaging video experiences. The integration of camera controls, a scene builder, and a content library further enhances the creative possibilities.
Video Overviews: Transforming Data into Video
NotebookLM utilizes AI to organize documents into a study guide or even a podcast. At I/O, it introduced Video Overviews, which transforms your data dumps into videos supporting "PDFs, photos, and more." This allows users to quickly and easily convert large amounts of information into visually appealing and easily digestible videos. The goal is to make information more accessible and engaging.
AI Mode for All
Google is incorporating AI search-assistant tools in the way they retrieve information. This includes AI Mode for All and Google search results tailored to your past search and web activity, including the contents of your Gmail with Personalized Smart Replies. This personalized approach to search aims to provide users with more relevant and accurate search results.
New shopping options include a virtual try-on option and agentic shopping. These features are designed to enhance the online shopping experience. The virtual try-on option allows users to see how clothes or accessories would look on them before making a purchase. Agentic shopping can assist users in finding the best deals and products based on their preferences.
Automated Password Changes in Chrome
Chrome already helps you keep track of passwords and alerts you if your password has been compromised, is weak, or is being used across services. At I/O, Google previewed a "automated password change" option that prompts you to let the browser change your password for you when it finds a compromised one.
This reduces friction and helps users to keep their account secure, without hunting through account settings or abandoning the process partway. Look for it on supported websites later this year. This feature simplifies password management and enhances security.
Extended Reality (XR) Technology
Android XR Smart Glasses
Android XR is still in early development with a promising hardware potential benefiting from changing attitudes about smart glasses. The advancements in Android XR aim to create a more immersive and interactive XR experience.
XReal’s Project Aura XR Device
XReal showcased Project Aura, an extended reality (XR) device created for the Android XR platform. It’s the company’s second Android XR device and is "an optical see-through (OST) XR device" that’s tethered, lightweight, and cinematic. It’s powered by a Qualcomm Snapdragon XR chipset "optimized for spatial computing." Project Aura represents a significant step forward in XR hardware.
Samsung’s Project Moohan XR Headset
Samsung’s Project Moohan, a headset that uses the Android XR platform, is coming later this year. With Gemini, the device will be "easier to use and more powerful by understanding what you’re seeing and taking actions on your behalf." The integration of Gemini AI enhances the user experience by making it more intuitive and responsive.
The company is partnering with brands like Gentle Monster and Warby Parker to create "stylish glasses with Android XR." Kering Eyewear will join in the future. These partnerships aim to make XR devices more fashionable and appealing to a wider audience.
Other Notable Announcements
Real-Time Speech Translation in Google Meet
Google explored with video-chat live translation for a few years, and revealed their "near real-time speech translation in Google Meet [for] natural, free-flowing conversations." Translations between English and Spanish are now available in beta with more languages expected in the next few weeks, with access for enterprise accounts later this year. This feature breaks down language barriers and facilitates global communication.
Google Beam: Rebranding Project Starline
Project Starline, the company’s hyper-realistic video-conferencing solution, has been rebranded as Google Beam. It "uses an array of webcams to capture you from different angles. Then it uses AI to merge those video streams together and render you on a 3D lightfield display — with headtracking down to the millimeter and at 60 frames per second." Google is collaborating with HP to launch the first Google Beam devices later this year. Google Beam aims to create a more immersive and lifelike video conferencing experience.
Google AI Ultra Plan
For AI power users, Google now offers AI Ultra for $249.99 per month (after a 50% discount for the first three months) in the US. The plan includes the highest usage limits across Deep Research in the Gemini app, video generation with Veo 2 and early access to the Veo 3 model, with 30TB of storage. AI Ultra also offers the new AI filmmaking tool Flow and access to Project Mariner. This plan provides access to the most advanced AI tools and features.
Android 16 Features
Android 16 completing the replacement of the Google Assistant with Gemini Live, the no-subscription-needed chatbot offshoot of its Gemini AI platform, will now extend to cars, TVs, and extended-reality headsets. This makes Gemini Live the central AI assistant across various devices.
Android 16 supports Google’s Advanced Protection mode as a device-level setting. This lets you "activate Google’s strongest security for mobile devices, providing greater peace of mind that you’re protected against the most sophisticated threats," says Il-Sung Lee, Group Product Manager for Android Security. Enhancing security is a key priority for Android.
Android 16 presents a new design vocabulary called Material 3 Expressive, the iteration of the "Material You" design it shipped in 2021’s Android 12. Google’s VP of Product and UX for the Android Platform, Mindy Brooks, describes it as "more fluid, natural, and springy animations." In addition, touch-feedback elements, like the "incredibly satisfying haptic rumble” when you dismiss a notification are new features. These enhance the user experience.
```