Valve has introduced a new upgrade for Steam Frame by integrating the Arcturus Vision Camera, which adds color passthrough and tracked 3D video capture. Priced at $149, this accessory significantly enhances the mixed reality capabilities of the headset, allowing users to see their environment in full color and record stereoscopic videos with spatial tracking. This development marks a notable step in Valve’s efforts to improve mixed reality experiences on Steam Frame.

The Arcturus Vision Camera connects directly to Steam Frame’s PCI-E expansion port, attaching securely to the headset. It features two 32-megapixel Sony RGB sensors spaced approximately 64mm apart, mimicking typical IPD measurements, and offers two operational modes: a full resolution mode at 2464×2464 pixels per eye at 72Hz, and a half resolution mode at 1232×1232 pixels at 144Hz. The default passthrough runs at 60fps, with warnings from Arcturus about potential flickering or banding under artificial lighting at higher refresh rates.

The device upgrades the monochrome passthrough, previously limited to grayscale, to a full-color passthrough capable of 6.1 megapixels per eye, surpassing the Quest 3’s 4MP in color resolution. This allows users to see their surroundings in natural color, which can improve usability in mixed reality applications and casual use cases. The camera also captures stereoscopic HDR video at 60fps or 120fps at lower resolutions, with the added feature of tracking the headset’s position throughout recordings.

One of the key innovations is the Stabilized Immersive Playback mode, which uses the tracked position data to animate the recorded video around the viewer, creating a first-person, immersive viewing experience. The startup offers a Sync tool to convert footage for playback on other VR headsets such as Apple Vision Pro and Meta Quest, though this lacks the immersive stabilization feature.

Beyond passthrough and recording, the Arcturus Vision Camera supports a Gaussian splat viewer called Arcturus Vision Gaussian XR, enabling exploration of captured 3D data directly on Steam Frame. While generating new splats involves external open-source tools and a Linux workstation with an Nvidia GPU, the on-device viewer simplifies exploring existing files.

Enhanced Mixed Reality and Content Creation Capabilities

This upgrade improves the visual fidelity and interactive potential of Steam Frame, making it more competitive with high-end mixed reality headsets like the Apple Vision Pro. The addition of full-color passthrough and tracked 3D video capture allows for new possibilities in content creation and user engagement. It also addresses previous limitations of Steam Frame’s monochrome passthrough, which could affect safety and usability during mixed reality use.

The ability to record and playback stabilized 3D videos provides a new method for experiencing first-person content. For developers and hobbyists, the on-device Gaussian splat viewer and open-source workflows for 3D reconstruction expand creative options, supporting a broader ecosystem around Steam Frame.

This development positions Steam Frame as a more capable mixed reality device, bridging the gap between standalone headsets and high-end PC-tethered systems, with implications for both casual users and professional creators.

Background of Steam Frame and Arcturus Vision Partnership

Valve announced Steam Frame in early 2024, positioning it as a versatile mixed reality headset with a focus on affordability and accessibility. Initially, the device offered monochrome passthrough, which limited its effectiveness in natural environment interaction. To address this, Valve partnered with Arcturus Vision, a startup with prior experience working with Valve on 3D passthrough features for the Index in 2020.

The partnership has now culminated in the integration of the Arcturus Vision Camera, a dedicated addon designed to upgrade Steam Frame’s visual capabilities. This follows a broader industry trend of integrating advanced mixed reality features into consumer headsets, exemplified by recent high-profile releases like Apple Vision Pro, which emphasizes full-color passthrough and spatial recording.

Prior to this, Steam Frame’s passthrough was limited to grayscale with configurable tints, which was functional but not ideal for realistic mixed reality experiences. The new hardware aims to close this gap by providing true color passthrough and 3D video capture, aligning Steam Frame more closely with premium devices.

“The addition of full-color passthrough and tracked 3D video recording transforms Steam Frame into a much more capable mixed reality device, especially at its price point.”

— an anonymous researcher

Performance and Battery Life Under Real-World Use

While the hardware specifications and initial demonstrations are promising, it is not yet clear how well the Arcturus Vision Camera performs during extended use or in varying lighting conditions. The impact on battery life, particularly when running in high-resolution or high-refresh-rate modes, remains to be fully tested. Additionally, the stability and quality of stabilized immersive playback in diverse environments are still to be validated through user experience and independent reviews.

Further details about software updates, firmware stability, and compatibility with future Steam Frame versions are also pending. As the product is newly announced, comprehensive performance data and long-term reliability assessments are still unavailable.

Upcoming Review, Software Support, and Broader Adoption

UploadVR plans to evaluate the Arcturus Vision Camera thoroughly in upcoming reviews, testing its performance in various lighting and usage scenarios. Valve is expected to release firmware updates to optimize passthrough quality and video recording features based on initial feedback. Developers and early adopters will likely explore the open-source workflows for 3D reconstruction, potentially leading to community-driven improvements.

Further, Valve may expand compatibility with additional VR headsets or introduce software enhancements to improve stabilization and recording quality. The broader adoption of this accessory could influence future mixed reality hardware, encouraging other manufacturers to integrate similar features at competitive price points.

Overall, the next steps involve real-world testing, user feedback, and potential software updates that will define the long-term impact of this hardware upgrade.

Key Questions

Does the Arcturus Vision Camera improve the visual quality of passthrough on Steam Frame?

Yes, it upgrades the monochrome passthrough to full-color, providing clearer and more realistic environmental visibility.

Can the new video capture feature record in 3D with spatial tracking?

Yes, it records stereoscopic HDR video with tracked headset position, enabling immersive playback modes.

Will this upgrade affect battery life significantly?

Yes, running the camera and high-resolution video features will impact battery life, and real-world performance is still being evaluated.

Is the Arcturus Vision Camera compatible with other VR headsets?

No, it is designed specifically for Steam Frame and connects via its PCI-E expansion port.

What are the next steps for this hardware after launch?

Valve will likely release firmware updates, and users can expect further performance improvements and expanded software support.

Source: UploadVR