Dexta Robotics wanted to create the next generation of VR input so that users can not only interact with virtual objects but also let them feel the size of the objects and let them touch the images created by VR. This is Dexmo bone gloves. Prior to Lei Feng network (search "Lei Feng network" public concern) also reported Dexta Robotics.
The core of this technology is the rapid response, but as VR helmets become more advanced, the company is looking for the breakthrough point for the next VR technology. In theory, the next technical breakthrough is likely to be input. The three VR head-display manufacturers have already come up with a VR tracking device paired with their own system. The HTC Vive will come with the Lighthouse positioning system and controller. The Oculus Touch will be available before the end of this year. PlayStation will package its own VR controller Move in October this year. What is the next milestone event in VR interaction?
Dexta Robotics' products can simulate the tactile feedback generated by the corresponding object when the user touches an object in the VR world. Their product is a mechanical joint glove. Dexta believes that this advanced form of haptic feedback represents the next stage of VR device form. They have made several iterations of their prototype and are now ready to display it.
Dexmo provides what you call "real-time force feedback" by fully capturing the movements of your hand. The company claims that with Dexmo users can feel the size, shape and stiffness of virtual objects. When your virtual character hits another virtual object, the computer will process the force feedback according to Dexmo's mechanics software, and then the glove will immediately apply this force to your finger, so that the virtual object can also provide a kind of feedback. The feeling of it is like touching a real object.
Video Portal: Click Here
The company stated that precisely because of this technology, this pair of gloves can also convey more subtle tactile feedback, for example, you can feel the difference between the hardness of rubber duck and rock. In the above video, readers can see some demos of how these functions are implemented. "We did a lot of experiments using the Vive controller or Dexmo. Such as rotating the knob, grabbing the grotesque objects, playing the piano, pressing the button and throwing the ball. The results were as expected and there was no comparability. Users liked Dexmo because Dexmo offers a stronger sense of immersion."
Now, Dexmo is adapting two Vive controllers from the ground up to ensure that users can position and track their hands in the VR world. This tracking feature is what the company is trying to integrate. The integration approach is either through Lighthouse tracking authorization (a recent Valve open feature) or other unpublished methods.
As far as software integration is concerned, the SDK provided by Dexmo allows developers to assign virtual object physical property values ​​so that feedback generated by virtual objects can be wirelessly transmitted to Dexmo gloves through NRF (a near-range wireless transmission scheme). At the moment, they think that the way of Bluetooth and Wi-Fi transmission is too slow, and their transmission scheme can control the delay within 25-50ms.
Dexta is ready to present their latest version of Dexmo, which already has almost all the features of the final version. In order to understand the development history and future of this product, RoadToVR interviewed Dex Gu, CEO of Dexmo.
Reporter: Dexmo has been developing for quite a long time. You can tell us about some "landmark" events in the product development process.
Gu Chi Chi: We started the project in October 2013 and have never stopped upgrading this project:
In June 2014, we proposed the design of "force feedback switch", which proved the feasibility and submitted a US patent.
In October 2014 we launched the Kickstarter project and then went offline, but we found another way to get capital, which drove Dexmo into the production process.
In June 2015, our experiment on "variable force feedback" and some other force feedback experiments were successful. Then we applied for some patents to protect them.
By February 2016, our force feedback unit was ready for mass production, and we assembled it into Dexmo.
By June 2016, we completed multiple Unity Demos to test what Dexmo could achieve. Eventually our SDK entered the final stage.
Reporter: Your promotional video shows that Dexmo will play a role in many industries. However, I am curious whether you are concerned about the consumer market. If it is a consumer-grade device, how much does it cost?
Gu Zhichi: It is not easy for us to talk about price now. Before selling Dexmo to a regular user, we need to make sure it works out of the box. So our current plan is to work with some potential VR development companies to create the best VR immersive experience. So when users get Dexmo, they immediately feel how revolutionary our product is. At the same time, we also exchange views with leaders in the VR/MR industry to see if we can discover the possibility of further cooperation.
Reporter: You are now using the Steam VR controller to implement the tracking function. What are your plans for the final version of tracking? Will you get a Valve Lighthouse tracking license?
Gu Zhichi: Two years ago, we tried to tell people: "Tracking is a problem that has been solved." Because of Valve's reasons, people seem to understand this truth. Integrating Lighthouse's location tracking system with Dexmo is an easy task, and we will certainly proceed.
In addition to Lighthouse, Dexmo is also compatible with other location tracking methods. For example, we are trying to use the positioning coordinate API interface provided by HoloLens, this system does not even need to set up Lighthouse light tower. What I want to express is that Dexmo is worried about the problem of location tracking, and Dexmo only needs to do something about force feedback.
Reporter: What is the weight of the whole machine now and how long is the battery life?
Gu Zhi Chi: There is not a definite value yet, but I can give you some information: Dexmo is lighter than the iPhone 6 Plus, about 172g, this value can continue to decrease. In theory, the battery can support 4 hours of battery life.
Reporter: How low is Dexmo's development threshold? For example, developers took your SDK and started debugging. What do they need to do again?
Gu Zhichi : Dexmo is easy to develop and has detailed development guidelines. After reading the development documentation, developers can learn Dexmo development in just a few hours. We have developed some Unity plugins, which are somewhat similar to Vive. Frankly speaking, developers only need to fill in the parameters of object hardness and impact strength.
Reporter: Why did you cancel Dexmo's project on Kickstarter?
Gu Rong Chi: We were only showing one concept at Kickstarter. When we saw people's reactions, we felt that we were being held too high. We realize that they expect to achieve more than we can do.
What most proponents need is that a final solution can be used right out of the box, and all platforms support it. The VR hardware at the time was not as it is now. We understand that if users are unable to set up a tracking system independently, they will probably not use our products. Therefore, to achieve people's expectations, research and production of products, we need much more than 2 million US dollars of funds.
At that time we faced the choice: either we accept the money, pretend that none of these problems exist, don't tell our supporters what the actual situation is, and finally come up with a garbage product that nobody would be satisfied with, or we support the supporters Responsible, confess everything to them, and then go back and continue to do research and development.
As an engineer, I don't speak much. I think the product can prove everything. I hope people will feel all the energy and effort that we have condensed in this product. We had a hard time making choices, but I'm glad that we made the right decision. And now, our products can finally reach all my expectations of it in the past.
This article is compiled from RoadToVR, reproduced must indicate the source.