Successfully developed an "fantasy keyboard" for touch screens and VR, based on AI

Successfully developed an “fantasy keyboard” for touch screens and VR, based on AI

A group of 3 AI researchers from the Korean Advanced Institute of Science and Technology (KAIST) has recently successfully developed an invisible keyboard interface, AI support, absolutely does not require any physical keystroke, just relying on the position of your hand in a position ready to type to support the implementation of input operations.

Invisible keyboard? It sounds interesting, but it’s still too vague. So how does this keyboard have a mechanism to work? Bring input efficiency like? We will find out shortly.

  • Mechanical keyboards use a new switch mechanism that can last for up to 1 billion keystrokes

Virtual keyboard is still the number one choice on touch-enabled devices

Each year, the peripheral manufacturing industry, including keyboards, bakes billions of dollars into R&D and marketing plans aimed at bringing more complete products to the market. More advanced features, such as laser-illuminated virtual keyboard, can be used on any surface. But the actual use of current peripherals is, in many cases, still a big question mark.

The launch and popularity of touch screens as well as mobile devices has led to many major changes to the keyboard and mouse. Touch screen and virtual keyboard are a reasonable option for mobile users, but for fixed devices such as desktops, there are not too many notable alternatives to the keyboard. Full size QWERTY (keyboard type that you can put on all ten fingers at once). Although the physical keyboard size is now optimized and significantly smaller, we still have to use rough keyboards if we want to use a desktop computer.

Dozens of different solutions have been proposed, including input methods, voice control instead of traditional keyboards, or swipe input instead of normal keystrokes. The above measures can theoretically replace the traditional keyboard, but the actual use shows that the efficiency is not high, it is easier to miss or deviate than the traditional hardware model.

  • DeepMind’s AI model can learn how to create videos just by watching clips on YouTube

The efficiency of using virtual laser projection keyboard in reality is still not highThe efficiency of using virtual laser projection keyboard in reality is still not high

That is why researchers Ue-Hwan Kim, Sahng-Min Yoo and Jong-Hwan Kim from the Korean Institute of Science and Technology decided to develop a new product that could “redefine”. experience typing with keyboard in the era of AI development today. They have successfully developed a literal “fantasy keyboard” interface.

Information in research papers of Korean scientists is as follows:

“First of all, I need to confirm that this I-Keyboard keyboard will be 100% invisible, helping maximize the utility of the screen on mobile devices. Users can view the content of an application in full screen mode and type freely at the same time without having to take up the display area for the virtual keyboard as before. To further improve practical usability, our I-Keyboard will be completely devoid of fixed key layout, shape or size. Users can start the input process from any position, at any angle on the touch screen without having to worry about the position and shape of the keyboard ”.

  • Nvidia’s STEAL AI brings inference support for better computer vision models

According to the researchers, the I-Keyboard will not require any calibration or adjustment configuration to work. You just need to start typing anywhere on the touch screen, just like you would on a physical keyboard, and it will use deep learning technology, an aspect of artificial intelligence. to identify and understand the content you are trying to type. As follows:

“I-Keyboard keyboard will be integrated and work based on a special decoding algorithm, developed with the core technology of deep learning, thereby requiring no calibration steps to be able to function normally. . The built-in deep neural decoder (DND) is able to effectively handle both finger operating state and variability of touch operations, thereby automatically switching touch points. into a specific letter “.

This seems a bit like a magic trick. How can the keyboard know what you are trying to type while you simply poke your finger everywhere? After all, one of the biggest problems with soft keyboards is that it’s almost impossible to pinpoint where your fingers are on the keys over time without looking, because when there’s no Any physical binding to give touch, we will begin to deviate from our original position.

However, there are some pretty cool technologies out there on the I-keyboard. Instead of pinpointing the exact location of a user’s finger, the algorithm will figure out what you’re trying to do and constantly adjust its invisible keyboard to match the other imaginary keyboard in your mind. friend.

  • 5 genius brains in AI field work together to create awesome robots

Examples of user input tissues. The scales are standardized and gaps are removed for display

There is still a lot of work to be done on I-Keyboard. Although it currently works with impressive accuracy, up to 95.8%, it can only work at approximately 45WPM. Anyway, this can be considered a remarkable improvement compared to current soft keyboard technology.

With further development in terms of algorithms and better touch interface, the researchers believe that I-Keyboard could be improved to become a perfect replacement for today’s physical keyboard, wearing Although their current goal is just I-Keyboard application on touch screens and virtual reality devices.

  • YouTube launches new AR filters, allowing users to try makeup with the world’s leading beauty products

Examples of virtual reality keyboardsExamples of virtual reality keyboards

If used effectively in practice, the benefits that I-Keyboard brings to VR technology are immense. Besides, and the ability to enter data anywhere on the touch screen (even on display information) can be a tool to help comprehensively change UX design. Imagine your phone, tablet can display 100% of the screen even when typing, without using the physical keyboard as today.


Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *