❌

Normal view

Apple Intelligence in appleOS 27

16 June 2026 at 20:36

Apple (MacRumors):

Apple today introduced the next generation of Apple Intelligence, powered by a bold new architecture that integrates the latest Apple Foundation Models deep into Apple’s platforms and is uniquely designed to protect users’ privacy.

[…]

The next generation of Apple Intelligence also helps power Siri AI, an entirely new version of Siri.

[…]

Image Playground offers new powerful ways for users to bring their imagination to life. They can create high-quality images in virtually any style, now including photorealistic, thanks to a new generative model that runs on Private Cloud Compute. This is a major transformation for image generation across platforms. And generated images will automatically include a hidden SynthID watermark to identify them as AI-generated.

[…]

Now Messages offers one-tap suggestions based on the context of users’ conversations, making it easier than ever to get things done, such as creating a reminder or a note.

[…]

Apple Intelligence powers even more enhancements across operating systems. With automatic proofreading, users receive improved suggestions for spelling and grammar as they type across the system.

Damien Petrilli:

Apple WWDC26 “big features”: selling a rebranded gemini.

John Gruber:

What’s confusing about this Apple-Google partnership is that Google pretty much calls all things AI “Gemini”. The models are “Gemini”, the assistant is “Gemini”, and the feature integrations are “Gemini”. So Apple is taking pains to emphasize that they’re building atop the Gemini models, not the Gemini assistant.

Google creating the model, Apple figuring out how to integrate it and make it easy to use. Are we back to Apple and Google each focusing on what they do best?

Dave B.:

This is my favorite Apple event in a long time.

Instead of bombarding you with a million new features that mostly feel half-assed, this feels like it’s actually catered to the user experience instead of to marketing checklists.

Matt Ronge:

All of these AI additions to MacOS/iOS look like nice improvements, but somehow it all feels unambitious given the current state of AI.

But I suppose it’s better for them to underpromise given what happened with Siri last year…

Christina Warren:

As I expected, Apple is going to punt the “on-device” story for Apple Intelligence and push towards the “private cloud compute” story for the models that you’ll actually want to use. I’m glad on-device isn’t going away, but it’s clear a hybrid approach is absolutely necessary

Hartley Charlton:

Apple’s most advanced on-device AI model in iOS 27 requires a minimum of 12GB of unified memory, meaning the standard iPhone 17 is excluded.

Alex Rosenberg:

The 16 Pro was explicitly sold as having Apple Intelligence-capable hardware.

Juli Clover:

Apple today said it is expanding Private Cloud Compute (PCC) beyond its data centers, partnering with Google and NVIDIA to run Apple Intelligence workloads on Google Cloud.

[…]

All server components and software are part of a trusted computing base subject to verifiable transparency and no-privileged-access guarantees, plus Apple has a cryptographically verifiable ledger of all Google Cloud hardware that is part of the PCC fleet to mitigate the risk of supply chain attacks. PCC on Google Cloud also uses many of the same architectural security patterns as PCC on Apple silicon.

John Siracusa:

PSA: Remember that Apple Intelligence is disabled in macOS if you boot from an external drive.

See also: Mac Power Users Talk.

Previously:

Update (2026-06-19): Apple:

As we continue to refine our approach to image generation, the ImageCreator class is being discontinued and will no longer work in iOS 27, iPadOS 27, macOS 27, and visionOS 27 or later.

[…]

Transition to presenting the Image Playground sheet, which provides a consistent, system-managed image generation experience. Alternatively, you can integrate another image generation service of your choice.

Photos AI in appleOS 27

16 June 2026 at 20:34

Apple (MacRumors):

With Spatial Reframing, users can improve the composition of a photo after it’s been taken. Spatial Reframing builds on Apple’s deep understanding of spatial models thanks to Apple Vision Pro, so users can touch and drag a photo and preview in real time how the perspective shifts — as if they’d repositioned the camera in the original scene. Using powerful image models, Spatial Reframing will only generate new content where the perspective has been shifted, ensuring the reframed photo stays consistent with the original scene.

Users can also expand images with the Extend tool to give their subjects more breathing room. For example, they can straighten a crooked horizon without cropping out anything important, or adjust the aspect ratio, and Extend will fill in the missing pieces. Additionally, the popular Clean Up tool gets a major upgrade, so users can remove distractions with better quality and more realistic infill, even when the scene is complex.

These seem like useful features. I think it’s fine for Apple to offer them, but they do seem somewhat at odds with its previous preening about how they believe in the sanctity of photos that actually happened.

Kuba Suder:

“Reframing photos with AI” - I don’t like this at all 👎

Kind of the crosses the line to cheating about reality too much for me… it’s one thing to lighten or darken or colorize pixels, but another thing to reposition them against each other.

Louie Mantia:

“Deep respect for photography” right after a demo on generating images bc they do not respect art.

Jeff Carlson (Mastodon):

Generative AI is a technology that photographers are distancing themselves from (or should be), thanks to all the AI slop being produced everywhere. And yes, that includes creations from Apple’s Image Playground app, the image generator that the company also showed off during the WWDC keynote.

But generative AI doesn’t need to mean full images created from text prompts. When applied to selective areas, like erasing a piece of trash next to a subject’s feet, generative AI can do some of the menial work of replacing pixels that photographers would otherwise spend time retouching in an app like Photoshop. Google’s Pixel phones include a similar Magic Eraser tool.

Spatial Reframing is a great example of how the technology can be used to enhance real photos you capture.

Brian MacDuff:

I can personally confirm that Apple’s Photos “Clean Up” feature is DRASTICALLY improved in iOS 27. 😳

John Siracusa:

This is a bit hyperbolic and unkind, so I hope you can forgive me for venting. And, hey, who knows? Maybe the fancy new AI-powered reframing feature will actually get broad use. (But I doubt it…)

See also: MacRumors.

Previously:

Update (2026-06-18): Ben Lovejoy:

In the two weeks since, my view has been very much reinforced. The Clean Up tool is now significantly more powerful, while the Reframe and Extend tools address similar real-life needs …

Vídeo: as novidades de IA no Safari, Atalhos e Fotos no macOS Golden Gate 27

22 July 2026 at 13:00

Dando continuidade à nossa série de vídeos sobre o macOS Golden Gate 27, desta vez o foco foi em novidades que espalham inteligência artificial por diferentes cantos do sistema: Safari, Atalhos (Shortcuts), Finder, Image Playground e Fotos (Photos).

Neste segundo vídeo, mostramos o agrupamento inteligente de abas no Safari, os recursos de IA no app Atalhos e a sugestão inteligente de nomes para pastas no Finder, feita com base no conteúdo que elas guardam. Fechamos com o Image Playground e as novas ferramentas da Apple Intelligence que chegaram ao app Fotos.

Ainda tem mais pela frente nessa cobertura do macOS 27 — continue acompanhando o canal do MacMagazine para não perder os próximos vídeos! 😀

❌