TL;DR
Get the latest gadgets delivered free — and shop member deals
- Fast, free delivery on millions of items
- Access to Prime Big Deal Days deals on October 6–7
- Prime Video, Amazon Music and more included
Apple has released visionOS 27 for its Vision Pro headsets, featuring a beta Siri AI with advanced conversational abilities, improved object tracking, and new spatial scene options. The update is available for both M2 and M5 models, signaling a significant upgrade.
visionOS 27 is the fourth major release for Apple’s mixed reality platform, bringing several new features that aim to improve both productivity and immersive experiences. Developers interested in VR development can explore SpatialGen Zeus Streams Live Immersive Video To Apple Vision Pro. Among the most notable updates is the Siri AI, which is now in beta and offers a more conversational, context-aware assistant. This AI is powered by next-generation Apple Foundation Models, developed in collaboration with Google, based on the Gemini architecture, and is designed to handle tasks ranging from simple queries to complex interactions.
To access Siri AI, users must join a waitlist within the visionOS Settings, with initial reports indicating variable wait times. Once enabled, users can interact with Siri AI by simply looking at a persistent orb in their environment and speaking, without needing to say “Siri” aloud. The AI supports only English at launch, with device and language settings aligned. Apple emphasizes that Siri AI can understand personal context, broad world knowledge, and perform actions related to physical and virtual surroundings through its Visual Intelligence integration.
In addition to Siri AI, visionOS 27 introduces high-frame-rate object tracking that can now handle moving and held objects, a significant improvement over previous static tracking. Developers can train models for dynamic objects using an ‘Extended Training’ mode, which enhances tracking performance but requires longer training times—initial developer reports suggest around 18 hours for some objects. The system aims for approximately 30Hz update rates, reducing latency and improving real-time interaction.
Apple also opened support for third-party IR LED tracked accessories, allowing manufacturers to develop their own hardware compatible with visionOS. This broadens the ecosystem beyond the previously supported Sony and Logitech controllers, enabling accessories like styluses and other peripherals to be tracked at 90Hz, integrated with IMU data for precision. The support can be delivered via companion apps or hardware-specific APIs, fostering innovation among accessory makers.
Other enhancements include more realistic image generation in Image Playground, organizational improvements in Safari, and upcoming features like password upgrades and personalized smart replies in Messages. The update also extends spatial scene creation to user-captured panoramas, which can be set as backgrounds in the Shared Space, further enriching the virtual environment customization options.
Implications of Siri AI and Tracking Improvements
The rollout of Siri AI in beta signifies a major step toward more natural, conversational interactions with mixed reality devices, potentially transforming user engagement. Enhanced object tracking and support for third-party accessories expand the device’s utility in enterprise, creative, and consumer applications. These developments position Apple’s Vision Pro as a more versatile and intelligent platform, potentially influencing future AR/VR device standards and ecosystem growth.As an affiliate, we earn on qualifying purchases.
Previous Developments and Expectations for visionOS
Since the initial release of visionOS, Apple has steadily added features like spatial scene creation, object tracking, and accessory support. The OS has been positioned as a platform for both productivity and immersive experiences, with ongoing updates aimed at refining spatial interactions and AI capabilities. The current release, visionOS 27, builds on this foundation, emphasizing AI-driven features and expanded hardware support, aligning with Apple’s broader strategy to integrate AI deeply into its ecosystem.Unresolved Questions About VisionOS 27 Features
It remains unclear how widely available the Siri AI beta will become and how long the waitlist will be. Details about the full range of supported third-party accessories and their integration methods are still emerging. Additionally, the exact update rate for high-frame-rate object tracking and its performance in real-world scenarios are not yet confirmed by Apple or independent developers.Upcoming Milestones for VisionOS 27 Deployment
Apple is expected to expand access to Siri AI beta in the coming weeks, with further developer tools and documentation. The company may also release firmware updates to improve object tracking performance and support additional accessories. Monitoring developer feedback and user reports will be key to assessing the full impact of these features, with Apple likely to announce further enhancements in subsequent updates.Key Questions
When will Siri AI be available to all Vision Pro users?
Siri AI is currently in beta, with access granted via a waitlist. Apple has not announced a specific release date for general availability.Can third-party accessories be used immediately after release?
Support for third-party IR LED tracked accessories is enabled via APIs, but manufacturers need to develop compatible hardware and apps. Availability depends on third-party development timelines.How does high-frame-rate object tracking improve the user experience?
It allows for more responsive and accurate tracking of moving and held objects, reducing latency and enabling smoother interactions in immersive environments.Will future updates expand Siri AI language support beyond English?
Apple has not specified plans for additional languages; currently, Siri AI is limited to English at launch.Source: UploadVR
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
