Google Assistant With Bard: Generative AI Upgrade Coming to Android, iOS

Joseph Henry, Tech Times 04 October 2023, 07:10 pm

Google Assistant has just received a game-changing upgrade. At the recent Made by Google live event, the company unveiled Assistant with Bard, a new iteration of its popular mobile personal assistant, now infused with the prowess of generative AI technologies.

Google Assistant With Bard: Generative AI Upgrade Coming to Android, iOS

(Photo : Mojahid Mottakin from Unsplash)
Google Assistant With Bard

This fusion of Google Assistant and Bard equips the new assistant to tackle a wider array of questions and tasks, elevating its capabilities significantly.

Synergy of Google Assistant and Bard AI

Assistant with Bard effortlessly handles familiar tasks like checking the weather, setting alarms, or sending a text, just as its predecessor did. However, the revamped version now harnesses the formidable intelligence of Google's Bard AI, opening the doors to more insightful responses and personalized interactions, per Bloomberg.

One of the standout features of this update is the ability to delve into your Google apps, such as Gmail and Google Drive, to deliver tailored responses when you opt in.

Beyond Bard Extensions

This enhancement builds on Bard's previous update from mid-September, introducing the ability to integrate with a suite of Google's own apps and services through "Bard extensions."

Users who have already granted Bard access to their Gmail, Drive, and Docs won't need to repeat the process when using Assistant with this feature, according to The Verge.

However, those who haven't explored extensions will need to give Bard the green light to access personal queries within the Assistant app.

Beyond email management, Google envisions these extended capabilities being used for a multitude of personal tasks, from trip planning and creating grocery lists to crafting social media captions. This is currently an experiment aimed at understanding user behaviors, with plans to eventually roll it out more widely to Android and iOS users.

Diverse Interaction Modes

Assistant with Bard offers users the flexibility of interacting in three different ways. You can pose questions and follow-ups using your voice, type in queries for a text-based exchange, or leverage Bard's Google Lens integration to incorporate images into your inquiries. This multi-modal approach adds a new layer of convenience.

The AI-infused assistant is not limited to text and voice interactions; it's designed to be multimodal. It can see and hear, and it can even engage with you through spoken responses.

"It can hear through the microphone. It can speak to you through voice output. It can see through your camera. And it can even take actions to help you out," Sissie Hsiao, Vice President of Google Bard and Assistant, said in an interview, per TechCrunch.

Floating Window of Possibilities

On Pixel devices and select Samsung phones, you can invoke a pop-up, floating window by long-pressing the power or home button. This window offers a conversational overlay on the screen, allowing Bard to respond contextually to the content you're viewing.

For instance, you can overlay Bard on an image of a hotel and inquire about its availability for the upcoming weekend.

Addressing AI Hallucinations

With Bard's integration into Google Assistant, it remains consistent with the web version. This means it can also validate its responses, crucial for addressing the issue of AI hallucinations where AIs construct erroneous answers based on inaccurate information. This feature was introduced in the September update.

Assistant with Bard is set to launch in select markets, transcending language barriers. While the specific markets and languages have yet to be finalized, the company plans to expand its reach in the coming months, catering to iOS and Android mobile users.