Google Lens is expanding its capabilities to offer video and voice search in addition to images. This innovative feature, available in English from Search Labs for Android and iOS, uses computer vision technology and Gemini artificial intelligence to analyze sequences of frames and find relevant information on the Internet.
New features of Google Lens
Expansion of functionality
Google Lens now offers users a new level of interaction with visual content. In addition to traditional image search, the service is now able to analyze video and recognize voice commands. To use this feature, just open the camera in the search bar and say a description of what you see at the moment.
Limited availability
Starting yesterday, this innovative feature is available in Search Labs on Android and iOS devices. However, the feature only supports English at this stage, which may temporarily limit its use for some users.
Technology presentation
Google first demonstrated video search at its I/O event in May. As an example, a situation was shown when a user filmed an aquarium and asked a question about the reasons for the group swimming of fish. Thanks to integration with Gemini AI, Google Lens instantly provided an accurate answer to the query.
Video search technology
Rajan Patel, Google's vice president of engineering, spoke with The Verge to explain how the new feature works. Google Lens analyzes video as a sequence of individual frames, using computer vision techniques similar to those used to process still images. In this case, Gemini artificial intelligence is additionally used, which studies the sequence of frames and correlates them with information available on the Internet.
Limitations and prospects
Currently, the system is not able to identify individual sounds in a video. For example, identifying a bird by its song is not yet available. However, Google representatives say that they are already experimenting with introducing this feature in the future.
Voice search update
In addition to video, Google Lens has improved its voice search feature for image searches. Users can now make voice requests while shooting without having to wait for the image to be processed as was the case before. This feature is already available to all users, but for now only in English.
Glossary
- Google Lens is a visual search technology from Google that uses computer vision and AI for image and video analysis.
- Gemini AI is an advanced artificial intelligence system developed by Google to improve the analysis and processing of information.
- Search Labs is Google's experimental platform for testing new search features.
- Android is a mobile operating system developed by Google.
- iOS is a mobile operating system developed by Apple Inc.
Links
Questions answered
What new features are coming to Google Lens?
How does video search work in Google Lens?
Can Google Lens identify sounds in videos?
What changes have been made to voice queries for image searches?
Where was the Google Lens video search feature first demonstrated?
Hashtags
Save a link to this article
Discussion of the topic – Google Lens expands capabilities: search by video and voice is now available
Google Lens now offers an innovative way to search using video and voice. This feature is available in Search Labs on Android and iOS, but for now only in English.
Latest comments
8 comments
Write a comment
Your email address will not be published. Required fields are checked *
Evgenia
Wow, this is simply incredible! 🤯 Google Lens can now search by video and voice. Can you imagine how many new opportunities this opens up?
Hans
Yes, Evgenia, this is really impressive! Particularly interesting is how they analyze the sequence of frames using Gemini AI. I wonder how this will affect search accuracy?
Sophia
I already tried this feature, guys! 😍 It's just some kind of magic. I dictated the request, pointing to a flower in the garden, and received accurate information about it. It's a pity that it's only in English for now.
Pierre
Sophia, this sounds amazing! Have you tried using it to identify birds? I wonder how well it handles moving objects.
Viktor
Ha, another useless toy. Why do we need all these bells and whistles? Previously, people lived well without any smart searches. It will only spoil your eyesight and waste time.
Isabella
Viktor, don't be such a skeptic! 😄 This technology can be incredibly useful for education and research. Imagine how this could help students or scientists in the field!
Lukas
I agree with Isabella! 👍 I’m wondering how this can change tourism. Imagine: you are walking around an unfamiliar city, shooting a video and immediately receiving information about the sights. Cool!
Evgenia
Guys, have you noticed that they are planning to add sound recognition? 🎵 Lukas, imagine how this will help you identify birds by singing during your travels!