Google Home now offers a more conversation-oriented experience with Gemini

Google on Tuesday announced the integration of Gemini AI into Google Home devices and Google Nest cameras. The artificial intelligence (AI) features bring multi-modal capabilities to these devices, such as better image and video segmentation and identification, improved natural conversation, and more. Additionally, the tech giant also announced the successor to the Chromecast with Google TV, now rebranded as the Google TV Streamer. The fourth-generation Google Nest Learning Thermostat was also announced by the company. Availability of the Nest is limited to the US and Canada.

Gemini integration coming to Google Home devices

In a blog postGoogle revealed that multi-modal Gemini AI models have been integrated with its Google Home devices and Google Nest cameras to provide users with an AI-powered experience. The announcement comes after the tech giant unveiled its smart home platform at this year’s Google I/O event.

Gemini AI in Google Nest cameras
Photo credit: Google

The most notable upgrade comes to Google Nest security cameras. Powered by Gemini, these cameras now offer video segmentation and identification. This means that when the cameras see activity, they can now understand and contextualize more information, rather than just a basic description. As an example, Google gave Nest cameras that will tell the user that there’s a “dog digging in the yard” instead of just an “animal detected.”

Users will also be able to check their camera activity by searching for it in the Google Home app. This will allow users to check for things that happened several days ago, rather than reviewing all of the footage. Google says it will be possible to ask questions like “Did the kids leave their bikes in the driveway?” or “Did the FedEx truck drive by today?” and the AI ​​will quickly find the answer and share a helpful summary.

Automation via Google Home devices is also powered by Gemini AI. Using a Google Home speaker or a Display hub, users can set up any smart device to perform a specific function, even if the user doesn’t want to go through the whole complicated automation process. Using the app or display, users can type in what they want from the automation as a simple text prompt and the AI ​​will figure out the rest.

For example, a user can say, “Turn off all the lights and keep the air conditioning at 24 degrees Celsius when it’s bedtime,” and the AI ​​will figure out the user’s bedtime based on previous behavior and adjust the lights and air conditioning accordingly.

Finally, Google Assistant on Google Home speakers is also getting an upgrade. It will be able to have more natural conversations, and users will be able to switch back and forth on a given topic. Users will also be able to ask follow-up questions seamlessly. Later this year, Google will also add more voices to the assistant for users to choose from.

The Gemini AI integration into Google Home and Nest cameras will roll out as a public preview to Nest Aware subscribers later this year.