Photos AI in appleOS 27
With Spatial Reframing, users can improve the composition of a photo after itβs been taken. Spatial Reframing builds on Appleβs deep understanding of spatial models thanks to Apple Vision Pro, so users can touch and drag a photo and preview in real time how the perspective shifts β as if theyβd repositioned the camera in the original scene. Using powerful image models, Spatial Reframing will only generate new content where the perspective has been shifted, ensuring the reframed photo stays consistent with the original scene.
Users can also expand images with the Extend tool to give their subjects more breathing room. For example, they can straighten a crooked horizon without cropping out anything important, or adjust the aspect ratio, and Extend will fill in the missing pieces. Additionally, the popular Clean Up tool gets a major upgrade, so users can remove distractions with better quality and more realistic infill, even when the scene is complex.
These seem like useful features. I think itβs fine for Apple to offer them, but they do seem somewhat at odds with its previous preening about how they believe in the sanctity of photos that actually happened.
βReframing photos with AIβ - I donβt like this at all π
Kind of the crosses the line to cheating about reality too much for meβ¦ itβs one thing to lighten or darken or colorize pixels, but another thing to reposition them against each other.
βDeep respect for photographyβ right after a demo on generating images bc they do not respect art.
Generative AI is a technology that photographers are distancing themselves from (or should be), thanks to all the AI slop being produced everywhere. And yes, that includes creations from Appleβs Image Playground app, the image generator that the company also showed off during the WWDC keynote.
But generative AI doesnβt need to mean full images created from text prompts. When applied to selective areas, like erasing a piece of trash next to a subjectβs feet, generative AI can do some of the menial work of replacing pixels that photographers would otherwise spend time retouching in an app like Photoshop. Googleβs Pixel phones include a similar Magic Eraser tool.
Spatial Reframing is a great example of how the technology can be used to enhance real photos you capture.
I can personally confirm that Appleβs Photos βClean Upβ feature is DRASTICALLY improved in iOS 27. π³
This is a bit hyperbolic and unkind, so I hope you can forgive me for venting. And, hey, who knows? Maybe the fancy new AI-powered reframing feature will actually get broad use. (But I doubt itβ¦)
See also: MacRumors.
Previously:
- Apple Intelligence in appleOS 27
- Apple Intelligence in macOS 15.1 and iOS 18.1
- What Is a Photo?
- iPhone 16 Pro Camera
- Halide 2.15: Process Zero
Update (2026-06-18): Ben Lovejoy:
In the two weeks since, my view has been very much reinforced. The Clean Up tool is now significantly more powerful, while the Reframe and Extend tools address similar real-life needs β¦