How does Apple Vision Pro work and why is it called 'spatial computing'?

The answer

Apple Vision Pro, launched on February 2, 2024, is the first mainstream spatial computing device - a headset that projects digital apps, windows, and 3D content into your physical environment rather than replacing it. Unlike traditional VR headsets that isolate users, Vision Pro uses 12 cameras and 5 sensors for real-time passthrough, rendering the outside world in high fidelity while overlaying digital elements. Its dual micro-OLED displays pack 23 million pixels total (more than a 4K TV per eye), and the custom R1 chip processes sensor data in just 12 milliseconds - 8 times faster than the blink of an eye - to minimize motion sickness. The device is controlled entirely through eye tracking, natural hand gestures, and voice commands with no controllers. EyeSight technology displays the wearer's eyes on the external screen so others can see when you're engaged or available. While initial sales were modest due to the high price, Vision Pro demonstrated that consumer-grade mixed reality is achievable, spurring Samsung, Google, and Meta to accelerate competing products and establishing spatial computing as the next major computing platform after mobile.