Geek Jun has a small annoyance. There are too many equipments for VR and AR. Every time the manuscript is drafted and measured until the dead of night, he always feels that the body is hollowed out and feels powerless because of these equipments: the operation really hurts the egg!
Currently, we are at a rare moment where we can witness the next generation of technological changes that are getting closer to ours: We first used printers and punched cards to record data. Later we saw screens, mice and keyboards, and now we have smartphones and Touch screen, in the future of virtual reality (mixed reality), do we still use "backward" devices such as mice, keyboards, and remote controllers? The pattern diagram is deeply broken. Today Geek Jun came to reveal everyone's secrets. In the virtual world, how to play in the future!
Eyes, gestures, voice, trinity
The latest Holoens Developer's Edition for Microsoft's mixed reality helmet has been officially launched. With as little as $3,000, you can experience this high-end product that brings together the latest interactive technologies. Hololens has three main interaction modes:
Eyes + Gestures + Speech
We can think of the eye as a mouse, think of the gesture as a mouse button, and regard speech as a keyboard input. In fact, Hololens is not really positioned by eyes, but instead uses the position and orientation of the user's head to determine their line of sight and may therefore be less accurate.
Gesture operation will be a big way of operating in the virtual world in the future
As for voice input, friends who have used Siri know that talking loudly to the air will make you feel like a stupid guy, and the current voice recognition rate is really worrying.
Although the overall accuracy is not high, Hololens' trinity of operations shows us a path. The most worthwhile development is perhaps the "eye-tracking" technique.
Eye tracking technology worth the wait
A company called Tobii has done a good job in this area. While browsing the interface, users can also select objects in the screen. For example, when playing a game, as long as your eyes take aim, you can lock the enemy. So focus on the handle operation.
Look at the target with glasses to lock the enemy
In the mixed reality world, the more attractive product than Hololens is "Magic Leap," which requires Magic Leap to perform high-precision eye tracking between frames and frames to achieve a complete light field display. High-precision eye-tracking technology is likely to be used.
In addition to the eyes, gestures are a very important operation method of Magic Leap. We can see some signs in their patent documents:
Magic Leap gesture operation patent map
In this patent picture, we also found the familiar Home key. In the mixed reality world, countless pictures will be projected in front of you in disarray. At this time, it is very important to use the Home key to find the window we are familiar with.
In Magic Leap's demo, the window is still messy
The future of mobile phones may be block bricks?
In a large number of patents applied for by Magic Leap, Geek Jun discovered an interesting concept:
Totem
Let's see how Magic Leap explains:
"(Totem is) a physical item that the user uses to operate to input or interact in an AR system. Such a physical item is referred to herein as a totem. Some totems may be inanimate objects, such as , a piece of metal or plastic, a wall, and a side of a table. Or, some totems may be living things, such as the user's hand."
To put it simply, the “totem†that Magic Leap refers to can be anything that it can recognize. Just projecting holographic images on ordinary objects can give them life. For example, project a keyboard on a blank rectangle. Since totem dimensions and attributes are both known quantities, simple gestures that belong to totems should also be identifiable.
Soft keyboard totem diagram, the so-called "keyboard" may be just a projection
The key to the totem is the ability to interactively transfer the physical items to the hologram. They are described as empty shells and useless shapes. They are only useful when the holographic environment is projected onto them. A particularly interesting example is that the patent document gives an overview of how to turn blank aluminum into a smartphone:
"The AR system can render the Android phone's user interface to the surface of an aluminum panel. The system can also detect the interactions on the rendered virtual user interface, such as through the front camera to achieve the function of these interactions."
Yes, the smart phone in the future may be a board that gives this aluminum board function through your glasses. Maybe you really need to take out the blockboard later!
Remember the cool mobile phone in Iron Man? Maybe it is the new shape of the smart phone in the future
Geek Jun has something to say
The appearance of new technologies will often bring about new interaction paradigms. This paradigm of basic level will not change frequently. In essence, they are bound to the performance of hardware. In other words, no matter how cool the world of virtual reality (mixed reality) is, the way to operate is still to follow the Basic Law! Intuitive, convenient, and intelligent will be the eternal theme of future technology product interactions.
Geek Jun boldly predicted that after 3-5 years, maybe you just pick up the brick and you can turn it into a mobile phone. As for apples and millet, it's all right...
This article from the Tencent News client from the media, does not represent the views and positions of Tencent News