An update for Facebook’s Oculus Quest 2 virtual reality system will allow developers to incorporate real-life video of the RV headphone sensors to their games to create “mixed reality experiences”.
With Passthrough Experimental API, The new Oculus application programming interface, developers can customize the appearance of a player’s environment using their virtual reality headphones, applying effects and filters and even representing the real world in certain game surfaces. TThe API will be released first to Unity developers in an upcoming software update, “with support for other development platforms to come in the future,” Oculus VR said in a blog post Friday.
It’s easy to imagine a number of fun ways that games can incorporate your physical environment into the game. A gif that Oculus shared from the API in action shows a player drawing on the walls, immediately reminiscent of paint-based lawn wars squadron.
The ability to switch the opacity of mixed reality, also known as the amount of real or virtual world you see at any given time, shown in another gif, could easily be integrated with some sort of mechanic to solve puzzles.
Enemies in the game could also hide behind your furniture to sneak attack. I’m already a total chicken coop when it comes to horror games, so the idea of monsters being able to jump from the back of my own living room couch makes me want to cry.
The ad included several examples of uses for the API beyond games. Oculus claimed it could improve productivity and enable more collaborative telework by incorporating real-life keyboards and desks from workers. Users could also interact with virtual content without losing the ability to interact with their housemates or pets.
When asked if first-generation Quest users can expect to have access, Facebook told people to UploadVR that the API only reaches Quest 2. A scaled down version of the Pass by the technology is now available on Facebook’s Quest, Quest 2, and Rift S headphones, allowing users to take a look at what’s going on around them while still wearing the headphones.
In its announcement, Oculus added that it designed the API “with privacy in mind.”
“Applications that use the Passthrough API cannot access, view, or store images or videos of your physical environment from Oculus Quest 2 sensors. This means that raw images from the device’s sensors are processed on the device,” he said. the company.
As for when developers can expect to send their games using Passthrough to gamers, Oculus said it plans to release a production version “later this year.”