Google has made Project Gameface code available to Android developers, allowing cursor control using head movements and facial expressions, expanding accessibility on mobile devices.
Accessibility Project
New feature for mobile apps
Google gives developers access to Project open source Gameface, positioned as a gaming mouse that allows you to control the cursor using facial expressions and head movements. Android app creators can now integrate this accessibility feature, giving users a hands-free experience. For example, opening your mouth will move the cursor, and raising your eyebrows will click and drag objects.
Application of MediaPipe technology
Project Gameface, presented last year at the Google I conference O as a desktop solution, uses the device camera and facial expression database from the MediaPipe Face Landmarks Detection API to track motion. Now this technology is becoming available for the Android platform, allowing developers to implement it in mobile applications.
Expanding the scope
Although the project was originally intended for gamers, Google is collaborating with an Indian social network Incluzza, a company specializing in accessibility, to expand its application to other areas - work, learning and social situations. Project Gameface was inspired by Lance Carr, a gaming streamer with muscular dystrophy who collaborated with Google to create a more affordable alternative to expensive head tracking systems.
Glossary
- Google is an American multinational corporation and a famous technology giant.
- Project Gameface is an open source Google project that allows you to control your cursor using head movements and facial expressions.
- MediaPipe Face Landmarks Detection API – Google technology for detecting key points of the face and tracking facial expressions.
- Incluzza is an Indian social enterprise focused on accessibility.
- Lance Carr is a quadriplegic video game streamer and the inspiration behind Project Gameface.
Links
Answers to questions
What is Project Gameface?
Who is Project Gameface for?
What opportunities do Android developers get by opening the source code of the project?
Who inspired the creation of Project Gameface?
What technologies are used in Project Gameface?
Hashtags
Save a link to this article
Discussion of the topic – Cursor control using face and head movements - now available for Android apps
Google announced that the code for Project Gameface, which allows you to control the cursor using head movements and facial gestures, is now available to Android app developers. This open-source project is positioned as a gaming mouse and offers people a new way to interact with devices hands-free.
Latest comments
8 comments
Write a comment
Your email address will not be published. Required fields are checked *
Олег
Really cool idea from Google 👍 Controlling the cursor using facial gestures and head movements is very convenient for people with disabilities. It's cool that they decided to make this technology available to Android developers as well.
Франческа
I'm delighted with this progress! 🤩 The lives of people with disabilities will become much easier thanks to the integration of Project Gameface into applications. I wonder how this will work in practice and how accurate gesture recognition will be.
Питер
An interesting innovation from Google, but it seems to me that it will only be in demand in certain circles. 🤷♂️ It is unlikely that a mass user will perform strange body movements and grimaces to control the cursor.
Оля
And I think this is a really useful innovation. My uncle, after a stroke, cannot use a computer due to paralysis of his arms, but with such a system he will be able to control the cursor by moving his head. 👌 Well done Google!
Джанфранко
Well, what kind of nonsense? 🙄 All these newfangled things are a waste of time and resources. It would be better to make a normal functional mouse for people with disabilities than these gestures and grimaces.
Анджела
I think Project Gameface is a great idea for gamers! 💻🎮 Can you imagine how cool it will be to control a character in the game using movements and facial expressions? This will add a whole new gaming experience! 🤩
Матеуш
The technology is interesting, but it is unlikely to be easy to use. Straining the muscles of your face and neck for a long time to control the cursor is tiring. Although for people with disabilities it may not be a problem. 💭
София
Great idea to expand the scope of Project Gameface. 👏 As Google said, this can be used not only in games, but also in work, study, and social networks. Perhaps in this way people with limited mobility will be able to communicate more actively on the Internet. 💻🌐