Forget AirDrop: Developer Turns iPhone Photos Into 3D Worlds You Can Walk Into Using Apple’s Vision Pro

Bihe Xi’s open-source prototype uses Apple’s ML-SHARP technology, Gaussian splats and hand gestures—but it is not a new AirDrop feature

Apple Vision Pro transforms iPhone photo into 3D scene
Developer Bihe Xi turns iPhone photos into immersive 3D scenes using Apple Vision Pro and ML-SHARP, offering a glimpse of how we could revisit memories Mylo Kaye/Unsplash

Developer Bihe Xi has demonstrated how an iPhone photograph can become a 3D scene that Apple Vision Pro wearers can seemingly step inside.

Shared on X on 18 November 2026, the demonstration uses Apple's ML-SHARP technology and hand gestures to make a photograph appear to unfold into the surrounding space.

Xi called it 'the coolest AirDrop you've ever seen', but this is not a new Apple AirDrop feature. The 3D scene is generated beforehand and revealed inside Vision Pro through hand movements.

How an iPhone Photo Becomes a 3D World

The demonstration begins with a photograph displayed on an iPhone. Xi pinches towards the image, and glowing particles appear to rise from the screen and gather around the hand.

When the hand opens, a reconstructed scene appears through Vision Pro and expands around the wearer. It creates the impression of stepping into the original photograph rather than viewing it on a flat screen.

Xi said Apple's ML-SHARP generated the scene, while Tripo helped produce the decorative ginkgo leaves. The developer also described using AI-assisted coding to build the interaction.

The video does not establish that the iPhone converts the photograph into 3D in real time. Nor does it show AirDrop performing that conversion. The interaction is a carefully designed demonstration.

What Apple's SHARP Technology Actually Does

Apple published its SHARP research in December 2025. The model creates a 3D Gaussian representation from a single photograph, allowing realistic views from nearby positions.

Traditional 3D reconstruction often relies on several photographs from different angles. SHARP instead predicts spatial information from one image, estimating depth and appearance that were not directly recorded.

Apple's researchers reported generating the representation in less than one second on a standard graphics processor. That benchmark does not measure the entire process used in Xi's demonstration, including scene preparation and headset rendering.

The result also has limits. A photograph cannot capture hidden surfaces or areas beyond its frame, so parts of the reconstructed world depend on estimates.

Can You Really Walk Into Old Memories?

Xi's experiment suggests a new way to revisit familiar places through photographs. Holiday pictures and family memories could become environments that viewers explore instead of simply looking at them.

Apple already offers spatial scenes in the Photos app on visionOS 26. They add depth to existing pictures and let viewers look around slightly as they move.

Xi's prototype uses Gaussian-splat rendering, animated effects and gesture-controlled reveals. It is an independent project, not a newly announced Apple product or standard Photos feature.

Can Vision Pro Owners Try It?

Xi has released an open-source project called Walk Into Memory on GitHub. It provides a photo-processing pipeline and a visionOS app for viewing prepared scenes and interacting with them through hand gestures.

Using it requires technical setup, including Apple's separately installed ML-SHARP model, scene processing and building the Vision Pro app. The project's documentation also says Apple's model weights are restricted to non-commercial research use.

Prepared scene files can be transferred to Vision Pro using AirDrop or Files, but the transfer does not perform the 3D reconstruction. For most owners, the experience is therefore not something they can simply switch on inside Photos.