Apart from working on a Clubhouse-clone and an Instagram for kids, Facebook is also working on AR-based technologies at its Facebook Reality Labs facility. We’ve already seen reports of Facebook partnering with Ray-Ban to develop an AR Glass. Now, researchers at Facebook Reality Labs (FRL) have come up with a new wrist-based AI technology that lets users interact with AR-based computer interfaces in the real world.
So, the device uses various onboard sensors to detect the motor nerve signals coming from the brain to the hand of a user. Now, as it sits on the wrist, it can decode a certain motor nerve signal even before it reaches the fingers of the user. This way the device responds to precise finger movements of just a millimeter. Moreover, Facebook says that going into the future, it may even be possible for the device to anticipate a movement and take the corresponding action.
You can check out a demo video showcasing the control movements right below.
Now, apart from the ultra-low-friction finger-based input, the company is also working on a feedback system for the new HCI technology. This will include advanced haptic responses that will allow users to “feel” the virtual UIs and objects. Facebook showcased an example in which a user takes a virtual bow and arrow and nocks the arrow onto the bow. In doing so, the user was able to feel the sensation and tension of pulling the arrow through the advanced vibration-based feedback of the system.
