Nvidia also wants to support Apple's Vision Pro with its 3D tools in the future. As the graphics card and AI specialist announced this week, its Omniverse cloud APIs will be expanded accordingly. Initially, it is primarily thinking about applications for industry, as the company announced at its GTC developer conference, which is currently taking place in San Jose.
Advertisement
Car streamed from the data center
The central innovation is the support of OpenUSD files (Universal Scene Description) from the Internet on the Apple headset. Such scenes can also be streamed to the Vision Pro in the form of “digital twins” via the Omniverse Cloud. To do this, Nvidia uses its own Graphics Deliver Network (GDN), consisting of data centers around the world.
At GTC, Nvidia showed an interactively manipulable vehicle that could be physically accurately displayed in full resolution on the Vision Pro. During the demo, a designer was able to adjust the representation of the vehicle as desired using generative AI – for example in terms of color or environment – and finally “get into” it virtually. Nvidia emphasized that its Omniverse workflow can easily cope with the Vision Pro's high-resolution screens – which support 4K per eye. “The device and an internet connection are enough,” explains the manufacturer. Even scenes on the level of engineering drawings should be able to be streamed without any loss of detail.
Integration into RealityKit and SwiftUI
Mike Rockwell, vice president of Vision Products at Apple, sees the combination of OpenUSD Streams and Vision Pro as a great opportunity for new immersive experiences in the enterprise space. “Spatial computing will redefine how designers and developers create engaging digital content.” At Nvidia, Vision Pro is the first tool for enterprise customers that can be used to display their work “without compromises”.
Another innovation is the so-called hybrid rendering, in which rendering in the cloud using Omniverse RTX is combined with local rendering. There should be a direct integration into Apple's RealityKit and SwiftUI. The new features are expected to be released in the coming months. Nvidia wants to cooperate with developers and independent software providers so that they can use the Vision Pro as an output device. “We look forward to our customers soon having access to these great tools,” said Rev Lebaredian, vice president of simulations at Nvidia.
(bsc)