Google is bringing multimodal search in AI mode, its Google Search test that allows users to ask for complex, multi-part questions and follow-ups to dig a more deeply. Users who have access to AI mode can now tap the feature to ask questions about the photo uploaded with their camera or taken.
The new image-analyzing effectiveness in AI mode is powered by the multimodal power of Google lens, Google says on a blog post on Monday.
According to Google, AI Mode can understand how the whole scene of an image is related to each other, as well as their materials, colors, size and measures. Using a technique called “Query Fan-Out” asks multiple questions about both the objects displayed in the image and the object in it, providing more detailed information than a Traditional Google search.
For example, you can snap a picture of the shelf of your book and enter the Query: “If I enjoy these, what are some similar books that are highly rated?” AI mode will identify each book and then provide a list of books proposed with links and/or will provide them to buy them.
AI mode lets you ask follow-up questions to narrow your search, such as “I am looking for a fast reading, which of these recommendations is the least?”
As part of Monday’s announcement, Google says it is available for AI mode for more millions of users who are admitted LabsHome on Google for experimental features and products. Prior to that, AI Mode was only available for Google One AI Premium customers.
Launched last month, AI mode appears to receive popular services such as wonderfulness and Openai Chatzipt search. Google says it is planning to refine the user experience and expand the effectiveness in the feature.