Who needs a handheld controller when you have a tongue?
A smart device named LipIO has been created by a group of scientists at the University of Chicago, which enables users to control a variety of connected devices and carry out hands-free activities using their tongue, as reported first by Engadget.
The device is designed with a thin film-like structure that can be attached to either of the lips and leverages it as an input/output surface.
Hands-free, Eyes-free
The LipIO technology offers users the ability to interact with devices hands-free and eyes-free, making it a highly convenient solution for a range of situations. By licking the outer layer with their tongue or lower lip, users can record inputs for various tasks.
This allows the user to carry out actions while their hands are occupied or while they are unable to use their hands.
LipIO also provides "co-located tactile feedback" to give the user a sense of where their tongue is making contact with the lip. This ensures precise interaction with the device without the need for visual or manual guidance, making it easy to use in a range of settings.
The LipIO system can detect various input gestures, such as touching the lip at a specific point, sliding the tongue from one end to another, or pressing both lips together. More interestingly, the device is not affected if the user speaks while wearing it, ensuring uninterrupted use.
The LipIO technology has a wide range of potential use cases, such as unlocking doors when the user's hands are engaged and using lip gestures.
Furthermore, it can act as a lip-based guitar tuner, where the user can utilize lip gestures to trigger or dismiss the tuner.
Haptic Feedback, Gaming Capabilities
The system provides haptic feedback to indicate the degree to which a specific note is out of tune, assisting the user in making precise adjustments.
According to the research paper, the team's three studies confirm that participants could perceive electrotactile output on their lips while wearing LipIO with five I/O electrodes and co-located feedback.
They were also able to touch the target location with their tongue with an average accuracy of 93%.
In addition to its utilitarian purposes, LipIO has gaming capabilities as well. The researchers showcased a lip-controlled interface that allows users to play Whack-A-Mole by licking specific areas of the electrode array to capture the mole.
The team believes that LipIO can enhance accessibility for people who cannot interact with their hands and/or eyes. However, the researchers acknowledge that further work is required to reduce its hardware footprint.
Additionally, the researchers suggest potential applications for LipIO in virtual reality experiences, where it can create a more realistic sense of taste. They mention the possibility of tasting virtual ice cream in VR as an example.
Related Article: Global VR Headset Market Grows by Over 240% in Q1 2022 | Can Meta Sustain its Wearable Production?
