Desativada por padrão, ela lembra, de certa forma, a interface de ajuste dos estilos fotográficos do iOS, com o usuário tendo que segurar e arrastar o dedo — ou, no caso do Siri no macOS 27, o cursor do mouse — por uma malha de pontos brancos.
Como explicado por mactracker, conforme o cursor do mouse navega por essa malha, a voz da Siri é modulada para reproduzir certas características. Quanto mais o cursor do mouse se aproxima de um ponto, mais clara a voz da Siri fica.
Esse “voice pad”, como a interface está sendo popularmente chamada, também conta com animações elaboradas e bastante coloridas, além de vir acompanhado de um áudio de referência — com direito a Áudio Espacial (Spatial Audio) — que fica tocando sem parar no fundo.
Ainda segundo as informações, essa malha comporta 13 pontos diferentes, sugerindo que o novo sistema operacional do Mac ganhará novas opções de vozes para a assistente virtual. Como a quarta beta do macOS 27 não conta com todos os modelos de voz necessários, no entanto, apenas 2 opções personalizadas podem ser definidas pelo usuário por enquanto.
A nova versão do sistema também inclui um arquivo com descrições (algumas mais completas do que outras) para todas essas 13 vozes:
Gênero
Idade
Características
Estilo
Feminino
Jovem
Fala mansa
—
Feminino
Jovem
Sussurrante, brilhante, suave
—
Feminino
Adulto na faixa dos 20 anos
—
—
Feminino
Adulto na faixa dos 30 anos
—
Amigável
Feminino
Adulto na faixa dos 30 anos
—
Entusiasmada, relaxada, aconchegante
Feminino
Adulto na faixa dos 40 anos
—
—
Feminino
Velho
—
—
Masculino
Jovem
—
—
Masculino
Adulto na faixa dos 30 anos
Profunda
—
Masculino
Adulto na faixa dos 30 anos
Suave
—
Masculino
Adulto na faixa dos 30 anos
Rica
Amigável
Masculino
Velho
—
—
Masculino
Desconhecido
—
—
Ativar essa interface, porém, não é exatamente fácil, com usuários tendo que desativar o recurso System Integrity Protection (SIP) e sobrepor o código interno usando um depurador. Caso contrário, o sistema continuará exibindo o menu tradicional da voz da Siri no app Ajustes do Sistema (System Settings).
Por fim, embora essa interface tenha sido encontrada apenas no macOS 27, ela utiliza o mesmo framework de configuração da Siri que o iOS 27 e o iPadOS 27, o que sugere que ela também poderá dar as caras em iPhones e iPads. Ademais, também foi confirmado que ela será localizada para 44 outros idiomas.
The AI frontier from the two big labs (and – we have to be honest with the numbers here – probably SpaceXAI and Meta now, too) is in a completely different league at the moment. I spent my first couple of weeks with Siri AI trying to convince myself that I could replace Codex with Siri AI, and that was the wrong approach. There is a potential future in which Siri AI can become a more proactive and capable agent, but that’s not what Apple is shipping this year.
[…]
Siri AI is a dramatically better Siri for typical Siri stuff. The new Siri understands your commands and nuanced requests better because of the LLMs behind it; it can often perform multiple requests in one go (such as setting multiple timers with one command); the new expressive (and customizable!) voices sound great, and they’re terrific at reading and summarizing notifications. Apple’s first advantage compared to other chatbots is right here: only Siri can integrate with the iPhone and iPad to this extent, so even if the Foundation models aren’t as smart as the competition, Siri can do a lot more for most people on their devices because neither OpenAI nor Anthropic have OSes they can control.
[…]
The biggest issue I’ve encountered is the inconsistency of it all. Very often, the new Siri AI still replies with a generic “Uh oh, something went wrong“ error that doesn’t explain what the error was or why it happened. Sometimes, I ask a question via voice, and it errors out, but then a few seconds later, I type the same question in the app, and it’s fine.
[…]
My problem is that, right now with Apple’s own apps, both the index and Siri’s ability to perform actions are very inconsistent. The assistant hallucinates abilities it doesn’t have, and it frequently just doesn’t work.
The good news is that Siri AI is capable: impressively so, at times. In the lowest of low bars, it certainly beats the pants off the previous incarnation of Siri, but its access to your own personal data and all of the app on your phone also unlocks a host of new possibilities.
But it’s also not without the pitfalls that underlie all LLM-powered chatbots: errors in understanding, hallucinations, and so on.
[…]
The app itself is pretty barebones, letting you view those conversations in List or Grid layouts, select multiple conversations to delete them, and pin or rename any single conversation. In Settings : Siri, you can choose to either open to the overview or to a new conversation and decide whether old conversations are kept for 30 days, 1 year, or forever. It’s a little strange that one-off queries (“What’s the average height of the Norwegian World Cup team?”) are stored alongside more involved conversations (“Can you help me build a specific RSS feed for this site?”); I also ended up with a few orphan blank “New conversations” which I deleted, but it’d be nice if you could filter to find those. Conversations are fully searchable and sync between devices via iCloud.
Despite the current limitations, if you use chatbots as a replacement for Google Search, you’ll probably have a good experience with the new Siri app. That’s because even in these early betas, if you ask Siri something like, “Give me a day trip itinerary for a trip to Chicago this Saturday,” you’re likely to get good but pretty middle-of-the-road recommendations. From there, though, you can drill down with follow-up queries to get something more in line with your tastes. The results include source links you can follow, too. Given the ad-strewn mess that web search has become, using Siri for this sort of thing is a meaningfully better experience.
The one caveat on Siri’s world knowledge is that it’s roughly 2-3 weeks stale in some places.
[…]
A good example is Music. You can prompt Siri to play a song, but most of the rich metadata in the app isn’t exposed to Siri, which is a shame because it is exposed elsewhere, for example to AppleScript.
Thanks to the top-to-bottom revamp that is Siri AI, Siri is reliably intelligent. Finally. We are still in the midst of beta season, and Apple is yet to confirm whether Siri AI will formally launch with iOS 27 in September or sometime later in the year, but the feature is up to scratch. There are bugs and glitches and edge-case quirks, but on the whole, it wipes the floor with old Siri and is competent enough to supplant my everyday usage of other chatbots too.
[…]
Siri AI can get a snapshot of what’s on screen, but it cannot control the UI for you autonomously. As such, if you ask it to do something outside of its library of available app actions, it will say it can’t do that. Often, it can quote the relevant steps for you to do it yourself, but obviously that falls short of the ideal experience. This feels a bit lacklustre to people already embracing AI agents en masse. Claude and Codex on Mac do not hit these walls; they are all too keen to move your mouse for you and run terminal commands until the job is done.
That show of respect for its customers may change with iOS/macOS 27. Reports suggest that, at least in the first beta, Apple Intelligence is mandatory[…]
[…]
“So what’s the problem?”, you might ask. Apple’s AI takes up several gigabytes of storage and leaves less headroom for RAM.
Those are small inconveniences, however, compared to my biggest gripe with Siri AI: It’s completely ruined Spotlight.
[…]
The new Siri-first interface that presumes that if you’re searching for anything but an app or file, you must want Siri to feed you a few links of Apple Intelligence’s choosing.
Getting to a web search from a Spotlight query now requires multiple taps: Type your query, tap “Show Results” (careful: hitting enter will trigger Siri to craft a response, eliminating the possibility of seeing any actual Spotlight content), tap on “Show More” next to the list of Siri-surfaced web results, scroll down until you see Search Google (or whatever engine you have set as your default), then tap that.
Apple Intelligence used to be opt-in, but now it seems that you can’t even opt out. I had previously mentioned the removal of the switch in the context of hypocrisy, but it seems there are enough issues here for it to warrant its own post. Also, I had previously written that the switch was combined with Siri, meaning that you could turn off Apple Intelligence if you turned off Siri, too. I now doubt that’s the case.
Apple today introduced the next generation of Apple Intelligence, powered by a bold new architecture that integrates the latest Apple Foundation Models deep into Apple’s platforms and is uniquely designed to protect users’ privacy.
[…]
The next generation of Apple Intelligence also helps power Siri AI, an entirely new version of Siri.
[…]
Image Playground offers new powerful ways for users to bring their imagination to life. They can create high-quality images in virtually any style, now including photorealistic, thanks to a new generative model that runs on Private Cloud Compute. This is a major transformation for image generation across platforms. And generated images will automatically include a hidden SynthID watermark to identify them as AI-generated.
[…]
Now Messages offers one-tap suggestions based on the context of users’ conversations, making it easier than ever to get things done, such as creating a reminder or a note.
[…]
Apple Intelligence powers even more enhancements across operating systems. With automatic proofreading, users receive improved suggestions for spelling and grammar as they type across the system.
What’s confusing about this Apple-Google partnership is that Google pretty much calls all things AI “Gemini”. The models are “Gemini”, the assistant is “Gemini”, and the feature integrations are “Gemini”. So Apple is taking pains to emphasize that they’re building atop the Gemini models, not the Gemini assistant.
Google creating the model, Apple figuring out how to integrate it and make it easy to use. Are we back to Apple and Google each focusing on what they do best?
Instead of bombarding you with a million new features that mostly feel half-assed, this feels like it’s actually catered to the user experience instead of to marketing checklists.
As I expected, Apple is going to punt the “on-device” story for Apple Intelligence and push towards the “private cloud compute” story for the models that you’ll actually want to use. I’m glad on-device isn’t going away, but it’s clear a hybrid approach is absolutely necessary
Apple today said it is expanding Private Cloud Compute (PCC) beyond its data centers, partnering with Google and NVIDIA to run Apple Intelligence workloads on Google Cloud.
[…]
All server components and software are part of a trusted computing base subject to verifiable transparency and no-privileged-access guarantees, plus Apple has a cryptographically verifiable ledger of all Google Cloud hardware that is part of the PCC fleet to mitigate the risk of supply chain attacks. PCC on Google Cloud also uses many of the same architectural security patterns as PCC on Apple silicon.
As we continue to refine our approach to image generation, the ImageCreator class is being discontinued and will no longer work in iOS 27, iPadOS 27, macOS 27, and visionOS 27 or later.
[…]
Transition to presenting the Image Playground sheet, which provides a consistent, system-managed image generation experience. Alternatively, you can integrate another image generation service of your choice.
Unfortunately, due to the Digital Markets Act (DMA), Apple will not be able to ship Siri AI in the European Union with the release of iOS 27 and iPadOS 27. Over the past several months, EU regulators did not accept any of Apple’s proposed solutions to bring Siri AI to the EU while safely supporting other virtual assistants.
[…]
EU users will be able to access Siri AI on macOS 27 and visionOS 27. Developers located in the EU will not be able to test or use the new Siri AI features for their apps on iOS 27, iPadOS 27, and watchOS 27.
[…]
According to EU regulators, the DMA requires Apple to give any AI system nearly unlimited access to a user’s device, as well as the ability to act on that access autonomously without a user’s ongoing visibility and control.
[…]
Apple designed a solution called Trusted System Agent — an intermediary that would allow virtual assistants to safely access the same features and capabilities as Siri AI for devices in the EU. Apple also shared a plan to launch Siri AI in the EU while gradually rolling out this new solution over an 18-month period. The European Commission said no. In fact, the European Commission did not agree to any of Apple’s proposals.
This phrasing is not very clear, perhaps intentionally so. Apple is trying to give the impression that it did all this extra work to meet the DMA’s requirements, and yet the EC rejected its proposals, so it’s their fault Siri AI isn’t shipping in the EU. But it looks like the crux is that the Trusted System Agent is currently vaporware. What the EC rejected is that Apple wanted to be able to ship Siri AI now on the promise of future openness. The TSA would actually be built during this 18-month window of exclusivity. It’s not surprising that the EU would reject that proposal. The App Store doesn’t approve apps that flout the guidelines but promise to comply later. It doesn’t even entertain proposals of the form, “If I built this would it be approved?”
Apple said it detailed its plans for Siri AI to EU regulators six months ago, along with a technical proposal to allow secure third-party access to that data.
“In essence, a commission that’s asking us to conduct a very risky experiment on many, many, many tens of millions of users,” Greg Joswiak, Apple’s marketing chief, told reporters, “and we only want to ship these capabilities when we can do so safely.”
The EU said not to ship it without the TSA, yet Joswiak spins this as the EU asking Apple to be reckless? And if Apple wanted to ship them safely, why did it stop working on them?
Apple spoke of having spent hundreds of thousands of engineering hours on changes to comply with the EU. In the new report, though, Apple now says that it no longer knows what to work on.
So currently none of its engineers are working on adapting Siri AI to meet the EU’s demands.
It seems like Apple isn’t taking this very seriously. They’re more interested in trying to score PR points by blaming the delay on the EC rather than on building something compliant. So I guess the EC was prescient not to grant an exemption based on the promise that they’d follow through with the TSA.
However, do I think Apple should be made to open up that level of system access?
Honestly yes. They are worried about protecting my data. But it’s MINE. Me, the user.
Stick a big privacy prompt, maybe a system settings screen and reboot, but I want access to my data!
We can look to BrowserEngineKit to see how well it works out to introduce a trusted intermediate layer that Apple doesn’t itself rely on. And this seems like a much harder problem.
I keep seeing people (usually Americans) confused by where the EU is coming from with Apple and the DMA, eg “how can they care about privacy but also demand AI companies can access your data?”
My read is, the EU’s starting point is that a gatekeeper cannot treat itself as inherently more trustworthy than any other company. So if anyone’s AI can access your data, including Apple’s, it’s not up to the gatekeeper to say “we trust ourselves but don’t trust other companies” and force that on users.
The users should get to choose who they trust. And I think Apple is trying to draw a different line than it says. It worries that AI could be hijacked to steal your passwords and photos. But you can already install apps that manage and access that data. You can also install apps that access your calendar and mail data, and these apps can incorporate AI. Such apps actually get more access than what the EC wants because they must communicate with your servers directly. I would rather let an AI search my downloaded e-mails than read/write to my IMAP server, but Apple is blocking that option. The actual line it’s drawing isn’t that AI can’t access your data but that (aside from iMessage) it can only access it via additional engineering work and additional hoops for users to enter credentials. It seems like what Apple really wants is to make it hard for anyone to compete with Siri.
I’m skeptical that Siri AI is even capable of being meaningfully private or secure. As far as I know there is no mitigation for prompt injection, as Matthew Green describes here.
If it has access to private information, is exposed to external input and can access the Internet then how can they meaningfully claim it’s private or secure?
There’s a lot to unpack here, including more background information — and on-the-record statements — from a briefing Apple held Tuesday that I was invited to at Apple Park.
It’s frustrating that Apple has said so little on the record. They want to communicate that their “offers for compromise have been rejected,” but what exactly did they offer? Personally, I don’t think the TSA would be a very good solution because it would lock in both the limitations of Apple’s technology and their role as a gatekeeper. But Apple did not even say that the EC rejected the idea of the TSA, only that it rejected their proposal to violate the law for 18 months while building it.
But the bottom line is that Apple’s public statements regarding the DMA and the European Commission have never been this strident before.
[…]
Now, they’re a bit more on war footing. There’s a massive gulf between what Apple is willing to do with Siri AI in the EU and what the Commission is demanding from Apple for DMA compliance.
The European Commission isn’t demanding anything, the law is demanding it. The laws have been in place for several years now, Apple is currently in default of the law on several fronts, and is fighting its existing fines.
When the Chinese government wanted access to user data, Apple complied, but when the EU parliament voted for their citizens to be able to choose how to share their own data, that put Apple on a “war footing.”
There is some kind of irony in how Apple isn’t allowing Europe access to the new AI stuff; and meanwhile for the US, Apple is removing the setting for us to opt-out of it, effectively forcing it on us.
That’s how it is these days, huh? Either a government or a giant corporation makes our technology choices for us. We don’t get to choose for ourselves.
What exactly is the motivation for Apple and Google to engineer entirely separate systems for the EU to bring new features into compliance with the Commission’s broad interpretation of the DMA? Because if Apple doesn’t engineer a DMA-compliant version of Siri AI, iOS users in the EU will ... switch to Android, whose system-level AI was deemed noncompliant by the Commission a few months ago?
I briefly hoped that the DMA would lead to a sort of California effect for software, where products are designed for the stricter (more open, in this case) jurisdiction, and everyone else reaps the benefits, too, because that’s easier for companies than making separate versions of their products. But it turns out that Apple finds it well worth it to feature flag away the EU features it doesn’t want us to have, as well as the ones it doesn’t want to adapt for the DMA.
This doesn’t directly hurt Apple. It doesn’t force Apple to design, engineer, and ship a compliant EU-exclusive version of Siri AI that supports plug-and-play LLM back ends. It only hurts iPhone users who live in the EU, who are stuck with the old dumb version of Siri for the foreseeable future.
This demonstrates a market failure or legislative failure, depending on how you look at it. Both halves of the duopoly are in conflict with the law of the second largest economy in the word. Users will get a worse Siri, but this doesn’t bother Apple enough to do anything about it. Maybe the customers in the EU can be used as a bargaining chip. Neither Apple nor Google is worried that a competitor will come along with a compliant phone to challenge their dominance.
Gotta admit that as an EU citizen, I feel handicapped when it comes to brainstorming ideas to utilize Foundation Models.
Like, if I were to build a new app around them, it’s difficult to gauge if this is something Siri AI does out of the box when it isn’t available to me.
And unlike Apple, I intend to build software for the entire world.
Apple is acting out of greed and spite (see their hairbrained fee structures for alternative marketplaces as an example), but also yes, the DMA and enforcement thereof seems like a particularly difficult and capricious regulatory dynamic.
[…]
Those arguing that Apple is acting purely out of spite seem to suggest there is some obvious solution for iPhone Mirroring that would satisfy the interoperability mandate, but they never go into what that obvious solution is because they don’t know. They don’t know because I would guess no one does, not even Apple and certainly not the European Commission.
As far as I can tell, the European Commission doesn’t see it as their responsibility to help gatekeepers design features ahead of time in a way that should be compliant with the DMA. What they want instead is to decide whether or not a given feature runs afoul of the DMA after its released in the EU and presumably after they’ve gotten feedback from third parties.
If a developer emails Apple and asks if an app idea they have will be approved, they will get told to build it, submit it to the App Store, and see. The EU is the App Store here, and Siri AI is the app. I guess Apple don’t like their own policies.
I sympathize, even though Apple is in a better position than the developer, because it has more resources, because it would only potentially be blocked from shipping in one market, and because it can still sell its product in the EU, just with certain features disabled. Building something that might not be accepted is risky, but if you don’t submit anything that you think would be complaint with the rules, you don’t seem very serious. It’s still unclear to me exactly what Apple’s plan is. Its press release says it “will continue working” on bringing the features to the EU, but its SVP of marketing said in an interview that “none of its engineers are currently working on solutions.” Perhaps this implies that it’s banking on a legal or political solution rather than a technical one.
While the relationship between the European Commission and Google tells us nothing about playing ball, it tells us exactly how inconsequential support for alternative marketplaces is when it comes to regulatory scrutiny of integrated features. Apple hasn’t played ball with alternative marketplaces and now its new AI-based features are being withheld from the EU lest they get scrutinized for fines by the European Commission. Google hasn’t had to play ball with alternative marketplaces and now its new AI-based features are either being scrutinized for fines by the European Commission or being withheld lest they also get scrutinized. The European Commission is, rightly so in my opinion, regulating both operating systems equally and regardless of their support for alternative marketplaces.
It struck me today what a contrast this is with the rest of the AI world, increasingly connected via MCP. Imagine if Gmail was only accessible to AI on Android phones. If Teams was only accessible from a Windows Surface laptop. That is the kind of environment Apple’s policies create, with data locked into silos and monopolies free to leverage their existing strengths into dominance of new technologies too.
No thanks. Just as I should be able to sideload an app onto my own phone, I should be able to choose whether ChatGPT can access my iMessage history. The world is not going to come crashing down by giving users control of their own data.
Apple CEO Tim Cook held “constructive” talks with EU tech chief Henna Virkkunen on Tuesday about releasing Siri AI in the bloc while complying with the bloc’s digital rules, reports the Financial Times ($).
[…]
As for Apple’s proposed Trusted System Agent, a Commission official told the publication its contact with Apple on the idea was limited, and that it lacked a concrete proposal or details on how such an agent would work beyond the general concept. The official claimed Apple “focused on obtaining a green light to delay compliance.”
The DMA has been in effect for nearly four years and there is no reason why either party should be having so much difficulty with this proposal stage. Either the Commission is mischaracterizing Apple’s engagement, or Apple’s representatives need to be far better prepared.
It seems like Apple’s strategy is to encourage its customers to pressure the EU into changing the rules.
Siri AI is an entirely new version of Siri deeply integrated into iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. It can draw on personal context understanding to search across messages, emails, photos, and more, and get things done across apps with even more systemwide app actions. Additionally, Siri AI can answer questions related to the content on a user’s screen or go out to the web to get up-to-date information using broad world knowledge and generate a helpful answer. A dedicated Siri app allows users to revisit a past conversation or kick off a new one — all in one place — and uses iCloud to privately sync conversational history across a user’s products.
Powered by the next generation of Apple Intelligence, Siri AI is a completely reimagined version of Siri that is more helpful, more capable, and more intelligent. With detailed, engaging responses and natural back-and-forth conversation, Siri AI helps users get more done than ever.
[…]
Siri has been rebuilt from the ground up with powerful AI at its core. It takes full advantage of the bold new architecture for Apple Intelligence, including the next generation of Apple Foundation Models that run on device and on servers using Private Cloud Compute. When Private Cloud Compute is handling users’ requests, their personal data is not stored nor made accessible to Apple or anyone else. Outside experts can continue to verify this privacy promise at any time. Additionally, Siri AI uses the system orchestrator to tap into core capabilities like the Spotlight index and App Toolbox, which work entirely on device to keep users in control of their data.
[…]
For products that support Apple’s most advanced on-device model ever, Siri AI offers even more expressive voices, as well as a major boost in accuracy with systemwide dictation. Users have the ability to customize the expressiveness and pace of Siri’s voice so it’s just right for them. Dictation now captures what users say as polished text with greater precision, automatically handling capitalization, punctuation, and formatting as they speak. With improved speech understanding, users can speak naturally and trust that their words will appear clearly, accurately, and as intended.
I remain uninterested in these more advanced Siri features. They matter in that Apple needs to show that they’re not “behind” and that they can actually deliver on what they announce and advertise. But I don’t find the use cases compelling and wouldn’t trust the results.
If you really care about a particular concert, would you believe Siri about how the tickets work and that it will auto-create a reminder at the right time? Why should I believe that it can figure out whether a particular irregularly shaped object can fit inside an irregularly shaped container when said shapes are probably not even published on the Web? Can it really dig into my e-mail to find the right flight info? An answer without being able to see the sources is not useful. And I certainly don’t want it to pick for itself which vacation photos to send out.
I just want the basic features—from a decade or so ago, like music controls, reminders, and access to my purchases—to work quickly, reliably, and offline to the extent possible. I did not hear anything to suggest that this was a focus. Instead, everyone is celebrating how slow the demos were because that proves they weren’t fake.
The other interesting thing to note from the keynote: watching the demos, there is ZERO doubt these are real, recorded demonstrations on live devices. There will be no confusion about what is real or fake like there was at WWDC 2024 and the initial attempt at the new Siri.
And, if your standards are the state of the art in AI circa June 2024, when Apple took their first crack at answering the question, they did quite well.
[…]
What’s fascinating about this specific demo is that it also showed just how far behind Apple is.
[…]
Still, the bubble was strong enough to convince OpenAI to make the exact same mistake Dropbox did: the company somehow convinced itself that it could make enough money selling subscriptions to consumers; Anthropic, meanwhile, realized that it was enterprises who were willing to pay for AI’s massive productivity benefits, even as OpenAI failed to capitalize on their consumer market penetration by refusing to build an advertising product.
This is a long-winded way of saying that I don’t think that Apple’s agentic shortcomings are a big deal, at least for now. Agents help you do work and be more productive, and consumers don’t want to work or care about being productive. What they do want to do is watch short-form video, and an iPhone is simply much better at that than any other device ever will be; in that context, Siri being good enough is enough, and it appears that Apple crossed that bar.
They need to execute, they need to prove this can scale, and most of all, they need to get third-party apps on board with App Intents and App Schemas. But it seems like they’re doing all of that. This is not a done deal but it is very realistic.
Siri doesn’t have access to the filesystem or tool-calling, so it’s completely unable to do the kinds of tasks you might easily do with Codex or Claude. It’s a good start, but the state of the art has already dramatically shifted over the past year. The question is will Siri move in this direction, or stick to providing answers from the web?
Will Apple introduce its own distinct Codex-style agentic programming model that can do all this, and work with Xcode? You would hope so…
The revamped version of Siri that is officially named “Siri AI” will be available to test in the iOS 27, iPadOS 27, macOS 27, and visionOS 27 developer betas starting today, and it is coming to the Apple Watch in a future watchOS 27 beta. “Siri AI” will also be included in the public betas of each platform that are launching in July.
“Siri AI” requires a device that is compatible with Apple Intelligence.
Apple senior vice president of software engineering Craig Federighi has explained why the company launched a standalone Siri app in iOS 27, after previously characterizing a dedicated chatbot as contrary to its Apple Intelligence strategy.
[…]
“We see Siri not as a separate chatbot, just an unintegrated place you go and chit-chat, but rather as an integral, conversational tool that you use in the moment, deeply integrated into your experience.”
…And playlists, contacts, settings and preferences. Peel off the agentic slop bandwagon and focus on core performance, smarter caching, and resilience under adverse network conditions.
Though this is a test conducted on the very first version of Siri A.I. from a fixed point in Calgary, it seems to work quite well. So far, it is better than any version of Siri Apple has released yet and, as you can see above, it is almost as good as the original 2010 demo, before Apple acquired the company.
On the one hand, if Siri has indeed become this reliable at understanding queries like those demoed so far, it’s indeed impressive. On the other hand, I can’t help but ask myself, once again, whether people at Apple even know how regular people actually use their phones and devices.
Apple executives downplay and obfuscate the role of Google in Siri AI. The Siri AI announcement didn’t even mention Google or Gemini once! Does anyone actually believe Apple’s BS? The argument seems to be that since Google made a bespoke implementation for Apple, Google is not really involved, and it’s all Apple. Ridiculous.
It’s really odd to me that Apple is getting so much credit for Google’s work. Siri now “works” to the extent it does because Siri is to a very large extent Gemini, and Apple has wrapped that in a bow.
Apple didn’t “nail” anything. Apple failed at its own internal efforts and was forced to outsource.
This is the advantage of being a platform: you can fail and still win.
Apple’s Siri team, led by Craig Federighi, held a post-WWDC keynote tech talk with members of the press this afternoon to talk through iOS 27 and the new Siri AI.
During the talk, Federighi shared more details about Apple’s collaboration with Google.
Apple looks like it will use some combination of Google Gemini models, combined with Google’s Confidential Inference and Apple’s own Private Cloud Compute for private hosting. These systems will process both your queries and evaluate private data from your devices.
[…]
Apple has since “expanded” PCC to encompass Google’s hardware as well. I will confess that I find the details of the new “expanded” PCC just a bit vague. It sounds a lot like Apple is primarily going to rely on Google’s existing confidential compute (running in Google datacenters) to process this data, but they’re bolting on a new layer of technical security to control which models are actually running. In any case: security experts can argue about whether this is good enough to keep Cozy Bear away from your data. What I will grant is that it’s probably good enough to keep Google and Apple from accessing your stuff, which is what most people are worried about in the first place.
So why am I so nervous?
[…]
So far we’ve discussed two adversaries: the misaligned designers of private agents (such as search operators), and the possibility of remote prompt injection attacks. But of course, in any discussion of technical privacy systems we need to talk about the last elephant in the room: your government.
Ainda que não seja perfeita, a Siri pode ajudá-lo em diversas coisas — como ativar alarmes, conferir a previsão do tempo ou abrir um aplicativo.
Em se tratando do Apple Watch, a assistente pessoal da Apple pode ser ainda mais útil, já que está no seu pulso o dia todo.
Caso você utilize a assistente no seu smartwatch, saiba que é possível habilitar o Ajuste Automático do Volume, que regula o volume de fala da Siri com base nos ruídos de fundo do ambiente onde você estiver no momento.
Material: alumínio ou titânio Cores: cinza-espacial, prateado, ouro rosa, preto brilhante, natural, dourado ou ardósia Tamanho: 42mm ou 46mm Conectividade: GPS ou GPS + Cellular Pulseiras: esportiva ou estilo milanês
NOTA DE TRANSPARÊNCIA: O MacMagazine recebe uma pequena comissão sobre vendas concluídas por meio de links deste post, mas você, como consumidor, não paga nada mais pelos produtos/serviços usando os nossos links de afiliado.
Começando pelas novidades que chegaram hoje, a maioria delas tem relação com a Siri AI. Agora, por exemplo, o sistema exibe uma tela de boas-vindas para o usuário quando ele usa a nova assistente pela primeira vez.
New in iOS 27 beta 4: There is a new splash screen when using Siri AI for the first time pic.twitter.com/R6kFXk1loF
Falando em Siri AI, a nova beta acrescentou novas opções de vozes na personalização da Siri — que requerem dispositivos com pelo menos 12GB de memória, cabe recordar.
New in iOS 27 beta 4: Apple has added more Siri voices with a note that customizations for them are coming soon pic.twitter.com/5ksQXTERAm
Já na seção da Siri do aplicativo Ajustes, há uma nova opção para ajustar o tamanho das prévias das informações da assistente, com a possibilidade de escolher entre nenhuma e até até cinco linhas. No menu de Acessibilidade, há uma nova opção “Sempre Mostrar Solicitação” que exibe na tela uma transcrição do que você diz à Siri.
Além disso, a Apple removeu o recurso que causava um efeito de profundidade ao abrir a central de notificações. Ao deslizar, era possível ver um recorte do elemento principal do papel de parede da Tela de Início, mas isso não está mais disponível.
iOS 27 beta 4 removes the depth effect when opening Notification Center, a change that first showed up in beta 3. pic.twitter.com/1at4mqM3KU
Ainda em termos de correção, os ícones de atalhos na Tela Bloqueada mantém a aparência tanto no modo escuro quanto no modo claro.
Outras novidades incluem:
Na seção de ajustes do app Apple TV, há uma nova opção “Downloads Automáticos”. Ao ativá-la, os dois próximos episódios das séries que você começar a assistir na seção “Continuar Assistindo” serão baixados automaticamente.
Uma nova opção “Ampliar fotos para preencher”, na seção de ajustes do aplicativo Fotos (Photos), amplia levemente as fotos que têm proporção próxima à da tela e vem ativada por padrão.
Na seção Câmera (Camera) do aplicativo Ajustes, há uma opção para escolher um formato ProRes Log se você ativar o Apple ProRes.
Existe uma opção para ativar ou desativar o recurso Assistência ao Wi-Fi para cada rede Wi-Fi conectada, independentemente de a função geral estar ativada ou não.
Ainda durante o ciclo da terceira beta, outro destaque vai para a possibilidade de a Siri AI obter informações de aplicativos de terceiros — algo que, por ora, parece se restringir a informar o nível de bateria de veículos elétricos.
O app Traduzir (Translate), por sua vez, também suportará os idiomas/dialetos português (Portugal), dinamarquês, malaio, norueguês bokmål, sueco, cantonês (chinês tradicional) e espanhol (México e Estados Unidos).
Além disso, uma nova (e bem bonita) animação ao estilo Liquid Glass para o ícone de bateria fraca aparece quando o iPhone está prestes a “morrer”.
Apple really cooked with iOS 27 Beta 3🔥 That new liquid-glass, low-battery animation is absolutely sick. The glow and texture on the graphic are pure eye candy—almost makes you want your phone to die just to look at it. pic.twitter.com/gmFwRMhSbd
Por fim, de acordo com o Cult of Mac, especificamente na terceira beta do watchOS 27, a Apple passou a permitir usar a Siri para configurar um tempo adicional para um timer já em andamento — algo impossível até então nos relógios da Maçã.
A Apple está testando uma nova interface na beta do macOS Golden Gate 27 que exibe uma série de atalhos da Siri AI sempre que o usuário seleciona texto em um app qualquer.
Descoberta pelo usuário identificado como “pdfu” em uma comunidade do Reddit, a novidade está claramente inacabada, o que explica o fato de ela vir desativada por padrão nas versões mais recentes do sistema operacional.
Como é possível notar abaixo, a interface assume a forma de um popover que aparece no canto superior esquerdo da seleção feita pelo usuário. Além disso, os atalhos são contextuais, o que significa que ações diferentes poderão ser sugeridas dependendo do conteúdo em destaque.
Caso o usuário esteja trabalhando em um texto, o recurso exibirá atalhos relacionados às Ferramentas de Escrita (Writing Tools), só para citar um exemplo. Ainda de acordo com as informações, o recurso também pode sugerir ações como enviar um email, adicionar um número aos contatos, exibir um endereço no app Mapas (Maps) ou rastrear um voo.
Para desativar a novidade (o que talvez se prove necessário, já que, como dito, ela ainda está inacabada e apresenta inconsistências), basta abrir o Terminal novamente, rodar o comando a seguir e reiniciar o Mac:
Como essa nova interface já está disponível (mesmo que escondida) nas betas do macOS 27, é bem possível que ela dê as caras em uma futura versão de teste do sistema — provavelmente em um estado bem mais polido.
Depois de já termos publicado vários vídeos sobre as novidades do iOS 27, chegou a vez de começarmos a cobertura em vídeo do macOS Golden Gate 27 em nosso canal. E não tem jeito melhor de abrir essa série do que falando sobre a mudança mais aguardada do sistema: a Siri AI.
Neste primeiro vídeo, mostramos como funciona o novo app da Siri, os ajustes de voz disponíveis, as melhorias na busca do Spotlight, os recursos da Inteligência Visual a partir de screenshots e as ferramentas de escrita e revisão de texto integradas ao sistema.
In the month that I’ve been using iOS 27 (launching in public beta today) and the new Siri AI, I’ve come to a few conclusions: Siri AI is a much better Siri and will (probably) be a massive success; the newfound chatbot capabilities of Siri will pose a serious threat to OpenAI and the vast majority of free ChatGPT users they have; and the new Siri is (again, probably) not for me at the moment. At the very least, it can’t be right now given its lack of support for third-party apps and technical issues I’ve encountered during beta testing.
It took me a while to accept the fact that Siri AI can’t be the kind of AI assistant I’d spend hours working with every day. But after testing iOS 27’s new Siri experience every day (and breaking it often in the process), I think that’s okay – and, arguably, what Apple is shooting for at the moment.
The new Siri AI is not designed for people who have grown accustomed to working with frontier models and agents such as Claude Code and Codex. The first version of Siri AI can’t be considered an “agent”, nor can it be compared to products from Anthropic, OpenAI, or Google that are targeting power users living at the bleeding edge of AI. If you go into Siri AI thinking that it’s Apple’s answer to ChatGPT Work or Claude Cowork for long-running tasks or deep research queries, you’re going to be disappointed – like I initially was.
Instead, Siri AI carries all the typical traits of a new Apple product: it’s a user-friendly experience designed for the masses, without any of the complexities that define a power-user tool, for better or worse. This is how Apple rolls: they don’t start from a high power-user ceiling and let products trickle down to consumers; they always start from the consumer level and refine, iterate, and extend until products trickle up to power users. This perspective isn’t meant to excuse the (many) current flaws of Siri AI. (More on them below.) It’s just the necessary lens for understanding how Apple is addressing their AI shortcomings in a way that doesn’t betray the company’s soul and design ethos.
There will be plenty more to say about iOS 27, the improved Shortcuts app, Liquid Glass tweaks, and other system enhancements later this year. After all, I have a review to write. Today’s column is merely an opportunity for me to reason through the obstacles I’ve faced with Siri AI and the way I’ve had to re-learn how to think about Siri.
Siri AI: The Good Stuff
You see, I believe my issue is that I’m too agent-pilled and accustomed to products like Claude Code and Codex at the moment. Desktop agents have fundamentally changed what I do as a creator who writes and talks on podcasts but also releases softwareproducts for my team and audience. There is no denying that Apple’s new Foundation models powering Siri are a far cry from Fable and Sol, or that they feel like models from two years ago. The AI frontier from the two big labs (and – we have to be honest with the numbers here – probably SpaceXAI and Meta now, too) is in a completely different league at the moment. I spent my first couple of weeks with Siri AI trying to convince myself that I could replace Codex with Siri AI, and that was the wrong approach. There is a potential future in which Siri AI can become a more proactive and capable agent, but that’s not what Apple is shipping this year.
If you, like me, are a heavy Claude or ChatGPT user but are curious about Siri AI, you need to reset your expectations and understand that Apple is going after something else entirely. For starters, the new Siri AI is a dramatically better Siri for typical Siri stuff. The new Siri understands your commands and nuanced requests better because of the LLMs behind it; it can often perform multiple requests in one go (such as setting multiple timers with one command); the new expressive (and customizable!) voices sound great, and they’re terrific at reading and summarizing notifications. Apple’s first advantage compared to other chatbots is right here: only Siri can integrate with the iPhone and iPad to this extent, so even if the Foundation models aren’t as smart as the competition, Siri can do a lot more for most people on their devices because neither OpenAI nor Anthropic have OSes they can control. Claude and ChatGPT are extremely intelligent inside their own apps; Siri AI is intelligent enough for routine tasks that can span an entire operating system.
The new expressive voices (right) sound great.
The other key advantage of Siri AI is its system-wide persistence. In addition to voice mode, there’s now a full-blown Siri app that behaves like a traditional chatbot app, allowing you to revisit threads and pin specific ones at the top; but most importantly, you can now finally invoke the new hybrid Spotlight/Siri AI search UI from anywhere on iOS by swiping down on the Dynamic Island.
Spotlight and Siri have been unified in the same UI, so you can still quickly launch apps and documents via search in addition to asking questions.
The lack of system-wide access to Spotlight on iOS bothered me for years, ever since I started reviewing iOS on an annual basis. Now, search is only a swipe away no matter the app I’m using, and the search box itself is smart enough to understand whether I’m looking for an app to launch or formulating a longer request for Siri AI.
It’s been challenging for me to “undo” advanced habits I’ve developed with agents like OpenClaw and assistants like Codex; I think MacStories readers who fall on the power-user end of the AI spectrum will probably face the same hurdles with Siri AI. However, I’ve been able to identify a variety of areas where Siri AI was faster, nicer, and more comfortable than ChatGPT or Codex Remote for practical, everyday questions.
I recently spent a few days in Gaeta, and as we were walking to dinner one night, we spotted this huge vessel docked in front of the restaurant. Typically, I would have taken a picture, started a new ChatGPT thread, uploaded the image, and asked a question about it. This time, I simply held down the Camera Control button (which now defaults to Siri AI mode in the Camera app) and captured a photo. A few seconds later, Siri AI told me I was looking at the Palinuro, a three-masted barquentine that serves as a training vessel for the Italian Navy – which was spot-on. An interaction that would have taken 20-30 seconds with ChatGPT was reduced to a five-second affair with Siri AI. Even nicer, I was able to ask follow-up questions from Siri AI’s floating overlay as well as find the chat in the Siri app later, where I continued asking questions about the ship’s history and usual locations.
The ability to go from Siri in the Camera to a longer conversation in the dedicated Siri app is one of my favorite aspects of Siri AI.
Improved on-screen awareness and integration with Apple Maps has been another highlight. On our way to Gaeta, Google Maps had us drive through narrow mountain roads that we really didn’t like, even though they arguably saved us some time. For the return trip, I decided to use Apple Maps, but I noticed that it also recommended the same mountain roads. So without leaving the Maps app, I swiped down to invoke Siri and typed:
I wanna go back home (from Gaeta to Rome) but I don’t like this route. It goes through too many mountains. I wanna do the Autostrada as much as possible. Is there any way to maybe add some time to the trip and go slightly further down south to find another Autostrada entrance?
To which Siri responded:
To avoid the mountainous routes and stay on the Autostrada A1 longer, you can head slightly south from Gaeta toward the Cassino entrance or even further south toward Capua before heading north to Rome. This will add some time to your trip but provides a flatter, more straightforward drive on the highway.
Again, spot-on: the Cassino toll booth proved to be the way to go for a more comfortable trip.
These Maps-related suggestions were perfect.
A couple more things worth noting here:
Siri AI didn’t mind my mix of Italian and English in the same request. Even though it’s only officially launching with English support, Siri AI is backed by a large language model – and LLMs are inherently good at multiple languages.
Siri AI assembled a multi-step route for me, which I opened in Maps, and it was perfect.
After some hiccups in the first two developer betas of iOS 27, Siri AI has also become an efficient way to work with the Reminders app, which I started using as my primary task manager several months ago when I began working on my RemCTL CLI for it. In addition to the usual stuff that Siri could already do in Reminders before, such as creating tasks and fetching items due on the current day, Siri AI – thanks to the new and improved App Intents Apple added to Reminders – can now handle more advanced questions. For instance, I can ask Siri to get tasks belonging to two specific sections of a list in Reminders, and it’ll do it. Claude can also integrate with Reminders on iOS, but since its integration is powered by the old and limited EventKit framework, it can’t be as flexible as the exclusive App Intents integration now available for all apps in Siri AI.
Siri AI can finally show me tasks from sections of lists…too bad it also included a task from another section.
I’ll have plenty more examples to share and analyze in my review of iOS and iPadOS 27 later this year. As things stand right now, my thoughts on Siri AI are converging around this idea: with system-wide access, an exclusive app ecosystem, and good enough performance, Siri AI doesn’t need to be a frontier-level model to be useful to millions of people.
Siri AI: The Bad Stuff
All of this, however, is not to say that Siri AI is perfect. Far from it.
This is beta software, of course, and Apple has time to improve the experience. But I’m afraid that some design choices and intrinsic limitations of Siri AI will remain in place for the next year, leaving us with a product that, despite a two-year delay, still feels very early compared to the likes of ChatGPT, Claude, or Gemini, even in their plain “chatbot” modes.
The biggest issue I’ve encountered is the inconsistency of it all. Very often, the new Siri AI still replies with a generic “Uh oh, something went wrong” error that doesn’t explain what the error was or why it happened. Sometimes, I ask a question via voice, and it errors out, but then a few seconds later, I type the same question in the app, and it’s fine.
Anecdotally speaking, these issues seem to occur more frequently when Siri “thinks” longer for a request, which perhaps suggests Apple needs to optimize the performance of their larger model on Private Cloud Compute. However, the fact that Apple wants to keep things simple compared to their competition isn’t doing them any favors here: in ChatGPT or Gemini, I can know when the model is reasoning for longer, but Siri AI’s interface is a black box. There are no reasoning selectors or hints in the UI at all. That is a fine, Apple-y approach when everything works well; but as soon as something breaks (as often happens with chatbots), the lack of clarity and controls stings.
The entire Siri app is, in fact, a bit of a mess. Its performance is subpar: I’ve noticed frequent stutters when scrolling threads, delays when typing (letters wouldn’t appear on-screen and autocorrect wouldn’t work), and broken ‘Sources’ popups displaying no actual sources for a query.
The results of this query were stale (I was on a trip last week), and the Sources panel for linked emails came up empty.
The app lets you rename and pin threads, which is nice, but it doesn’t offer basic controls such as the ability to select text in a Siri response or create folders for chats. Although the grid view looks good in marketing screenshots, in practice, I had to disable it immediately because I couldn’t quickly parse my threads and find what I was looking for.
I really don’t like Siri’s grid layout.
Which brings me to indexing. As I noted above, Apple’s advantage compared to other chatbots will be Siri’s access to an on-device index that draws from the user’s apps and personal context. The problem is that I’ve yet to see an example of personal context “enhancing” any of Siri’s answers, and performing actions in or retrieving data from apps has been half broken for me since the very first beta of iOS 27.
I can’t speak about personal context because it has literally never worked in my examples. For apps, my understanding is that third-party ones will need to be specifically updated for iOS 27 in order to work with Siri AI – although some of them seem to work already, but others don’t? Apple requires developers to implement new features of the App Intents framework for Siri AI, and I’m optimistic that those who do will have their apps appear in Siri AI by September. Greg Pierce, the developer of Drafts, has added early support for Siri AI in his app, and I’ve been able to successfully create a note within the app from Siri, which presented a custom UI snippet for Drafts and completed the request in seconds. That was neat.
My problem is that, right now with Apple’s own apps, both the index and Siri’s ability to perform actions are very inconsistent. The assistant hallucinates abilities it doesn’t have, and it frequently just doesn’t work. In the examples below, I wanted to get notes from a specific folder, songs from a playlist, and a link from a note. Siri AI responded with an empty list of notes, said it couldn’t get songs from a playlist, and told me that my note didn’t have any links, respectively. (It did.)
Reminders integration started working for me in iOS 27 beta 3, but it still isn’t perfect. When I ask for tasks due today, Siri AI insists on presenting the same tasks twice, my only fault being that I enabled the integration between Reminders and Calendar:
At one point, I asked Siri to show me my overdue reminders. Siri AI struggled with that: it cut the list of overdue items short, apologized when I pushed back, then did it again anyways. I know that Siri AI is not based on a Gemini model but is rather a Gemini distillation, but I think that if you’ve ever used a Gemini model before, this kind of behavior with tool-calling should be awfully familiar.
Siri AI isn’t a replacement for agentic workflows with other LLMs that can perform multiple actions in one chain of events. Here, for instance, I asked Siri to get my latest screenshot from the Photos app and frame it with my Apple Frames shortcut. Not only did Siri AI not get the most recent screenshot from my library, but the assistant couldn’t perform two actions sequentially. At least, however, it told me; when I repeated a similar question but asked to copy the screenshot to the clipboard instead, Siri first asked me to confirm my action and then changed its mind and said it couldn’t do it.
Why ask for clipboard confirmation if you can’t do it?
Searching for content hasn’t been ideal on my end, either. When I asked Siri to find me the latest single by Phoebe Bridgers, its default text response was an EP from two years ago; when I asked via voice, the response was correct. (…Why?) I similarly haven’t been impressed with Siri’s ability to search for messages and emails. Siri AI can reliably find recent texts from the Messages app, but the moment I start going a little further back in time, the system seems to struggle. I wanted to know when we took some time off at MacStories last summer, which I know was mentioned in a MacStories Weekly email that I have in the Mail app. Siri AI could only find a generic mention of John recharging after some time off, but it couldn’t give me an exact date because it did not find the correct email. ChatGPT Work did it in one minute and gave me a full breakdown of the weeks we took off.
Left: ChatGPT Work. Right: Siri AI.
All of this begs the question:
Is Apple’s on-device index a solid technological foundation or not? Is this system actually going to work at scale, for users with dozens of apps installed, each donating their data to the index, perhaps spanning multiple years of content? And can the cloud models – which are not using MCP but appear to be based on a plain JSON schema for structured data – make sense of it all?
My early tests haven’t been encouraging, but we have until September to find out.
The Trickle-Up
A trickle-up strategy cuts both ways: it gives Apple an opportunity to start simple and refine over time, but it also means that you, the user, are never given any more control than what the product allows for. As a result, Siri AI can be magical when it works; when it doesn’t, it feels like a mystery.
I can’t say whether I’m optimistic that Apple will get all of this to work in time for the fall or not because they don’t have the greatest track record in AI. I’m willing to give them the benefit of the doubt since the product itself is genuinely interesting and different from any other chatbot on the market. I want Siri AI to work, and if Apple can deliver on their vision, I’m convinced that it’ll spell trouble for OpenAI and ChatGPT. (Let’s face it: it’s the product to beat here, both in and outside of court.)
Siri AI permeates iOS 27, and that’s a threat to OpenAI and the hundreds of millions of users they have using ChatGPT for free with GPT-5.5 Instant. I don’t think Apple Foundation Models are as good as GPT-5.5 Instant, but Siri AI is the more ergonomic and integrated product. When the underlying chatbot and its world knowledge capabilities are good enough, and they can also be invoked via voice, text, the Camera app, context menus, or keyboard shortcuts, why would I open a siloed chatbot when I can use Siri AI and get a comparable answer more comfortably? If you’re a casual user of ChatGPT and do not pay for it, I think Siri AI can be a very compelling product that provides similar answers and, unlike OpenAI’s chatbot, integrates with the iPhone apps you already use. I don’t think it’s a coincidence that OpenAI is now following in Anthropic’s footsteps to monetize the business and enterprise markets rather than the consumer one.
At the same time, my concern is that we may be collectively assuming that “normal people” won’t see the differences between the capabilities of ChatGPT and Siri AI. In this industry, we have a tendency to sell “normal people” short and paint them as some perplexed bunch of occasional smartphone users who somehow passively accept any technology that is thrown at them. I strongly disagree with that. Maybe those people don’t care about ChatGPT Work, Codex, or Fable (yet?), but they can tell when an AI assistant is useful and when it’s not. People will compare the utility of ChatGPT to Siri AI, and I’m concerned that Apple’s 1.0 product will feel like it’s too little, too late – especially since Siri AI will be launching in select regions and in English only.
In the AI scene, companies move fast and break things. Apple needs to move fast without breaking anything, anymore. That’s a tough challenge, but here we are.
In the current era of coding agents becoming productivity assistants, iPadOS’ limitations are no longer defined by the lack of desktop-class multitasking or access to external peripherals. A new class of iPadOS shortcomings looms large on the horizon: the iPad’s app sandboxing and the absence of an open filesystem have relegated it to acting as a remote control for agents.
I’ve been ruminating on this thought for some time. I, of course, am very satisfied with the improvements Apple brought to the iPadOS platform throughout the 26 cycle: between new windowing, local capture, a menu bar, and the improved Files app, I can get most of my old-school work done on the iPad Pro without begrudging the experience like I used to a few years ago. What I’ve noticed this year, however, is that iPadOS 26 was an update designed to address the pre-existing low-hanging fruit of quasi-desktop efficiency; by design – and we have Craig Federighi on the record saying as much – it wasn’t intended to reinvent the wheel in any meaningful way.
That would have been fine a few years ago. The problem is that the productivity wheel is literally being reinvented by other companies as we speak. And in an unsurprising turn of events, the Mac is at the forefront of that reinvention, while the iPad is being left behind once again.
I’m writing this as someone who likes to be on the bleeding edge of AI tools. Since the release of Claude Code in early 2025, I (and, realistically, millions of other nerds whose taste aligns with mine) have increasingly moved a lot of my research, automation, coding, and other tasks considered “productivity” to desktop agents. These are powered by the same underlying technology as chatbots, but they’re considerably more powerful: Claude Code and Cowork, Codex, Perplexity’s Personal Computer, and self-hosted agents like OpenClaw and Hermes can understand intent and perform long-running tasks on your computer. They can write code, stay on a task for hours (or even days) at a time, analyze the contents of your screen, and even use a computer on their own. To believe that these AI tools are still a fad and chatbots are useless is misinformation at this point.
As of June 2026, I spend most of my days with two apps constantly open on my M4 Pro MacBook Pro: Codex and Notion. I’m a huge fan of what OpenAI has accomplished with Codex for Mac; their all-in-one package that combines thread-based chats with skills, plugins, connectors, computer use, memories, and system-wide filesystem access has genuinely allowed me to produce content for my audience that I wouldn’t have even dreamed of years ago. Since I started working with Codex, I’ve released a major update to Apple Frames, twoCLIs (with two more coming soon), Shortcuts Playground, and a brand new MacStories Shortcuts Archive. These are actual products that are used by thousands of people and are generating real revenue for MacStories. I’ve also created an entire suite of MacStories-only internal apps (now used by our whole team) and am currently in the process of researching my iOS 27 review, creating an app for Shortcuts Playground, and brainstorming a different product altogether for MCP.
I’m doing all of this on a Mac because the true Codex experience isn’t even “desktop-only”: it’s Mac-only.
Let me give you some examples. To make the original version of Shortcuts Playground, I had Codex with Computer Use scrape my entire library on the old MacStories Shortcuts Archive, download over 300 shortcuts, and learn my coding style. Once I had a plugin, I also had Codex create over 1,000 shortcuts on its own, install them in the Shortcuts app for Mac, and debug them visually to find issues. For the new Shortcuts Playground plugin and app, I’m going even further: Codex created over 3,500 shortcuts spanning the entire library of Shortcuts actions while simultaneously coordinating with other Codex threads – some of which are running on my Mac Studio – to build an app, train a local model for Core AI, and constantly iterate on the new harness behind the app. Meanwhile, I’m also spending time in Codex organizing sources for my iOS 27 review, managing my tasks with Reminders and my own RemCTL, and performing general research on any topic I think of. The net result of all this is that I’m shipping more things, making more money for MacStories, saving money thanks to our new internal tools, and – most importantly – learning a lot and having fun.
Working with Codex for Mac.
Some of the CLIs I’ve built. Two of them are coming soon.
In all of this, the iPad’s role is to be, once again, an accessory to the Mac – and a rather expensive one at that. I wrote last year about iPadOS’ third-party app problem, and I still think all of it applies today. What’s different in 2026 is that these powerful agentic tools that are redefining coding and knowledge work, and which are centralizing productivity inside so-called “super apps”, aren’t coming to the iPad, but not for political or financial reasons: they’re Mac-only because only macOS is mature and open enough to support them.
In a funny twist of fate, Apple spent years trying to make iPadOS catch up to macOS on the surface, only for macOS’ underlying nature to unlock a new generation of apps that are rewriting the rules of modern software. No amount of windowing and menu bars can change the fact that neither Claude Cowork nor Codex will ever be possible on the current version of iPadOS. From an open filesystem that lets agents poke around anywhere to powerful Accessibility and Screen Recording APIs for developers to features like system-wide hotkeys, dictation, and true background processes, Apple’s oldest operating system is the one that feels the freshest (and the most powerful) in the AI industry today.
In fact, the Mac is so powerful and well-equipped for this new wave of desktop agents, it even yields an amazing experience when used in a “headless” setup with no display attached to it. This may have started as a trend because of OpenClaw, but six months later, I believe that a Mac mini with Codex running on it is the best bang for your buck if you’re building an always-on agentic setup based on a frontier model that can do just about anything you throw at it.
Which brings me to the iPad’s only silver lining in this space right now.
Most of my Codex tasks are running on my Mac Studio server, but I also use Codex on my MacBook Pro. Thanks to Codex’s support for remote connections, I can chat with threads running on the Mac Studio from the Codex app on a different machine, which is a fantastic feature. Alternatively, I can use Apple’s excellent (and, again, Mac-only) Screen Sharing app to log into my headless Mac and interact with macOS with superior performance and image quality to VNC. (I also use this HDMI 2.1 dummy plug to unlock 4K resolution when headless.) Coordinating Codex threads across different projects and machines feels like the sort of thing that shouldn’t be possible, yet here we are.
If the iPad is still relevant to me in this specific new way of working, it’s entirely because of the ChatGPT app and the fact that OpenAI cared enough to design a good remote experience for iPhone and iPad users. The Codex section inside ChatGPT is a solid product and getting better every week; it’s also the only app of this kind that lets you connect to multiple computers at once and manage threads across all of them. With Codex remote on iPad, I can continue my projects from the MacBook Pro or Mac Studio, pin specific threads, and keep an eye on all my agents working in the background. In general, it’s also a way to bridge functionalities that are missing from iPadOS. Without Codex remote, I wouldn’t be able to ask my agent to reschedule my reminders and turn some emails into tasks in the same workflow; I wouldn’t be able to tell my agent to go to the Apple Newsroom, find me a specific press release, extract all images from it, and upload them to our CDN.
Codex remote on iPad.
Perhaps Siri AI will unlock similar capabilities (although I doubt to the degree of a frontier desktop agent), but it’ll still be limited to apps made by companies that decide to support App Intents. When I’m not using my Mac and I think of something I can’t do on the iPad these days, I instantly reach for Codex inside ChatGPT. I suspect this trend will only grow as more AI companies release similar remote experiences for iOS and iPadOS.
Here’s the issue, though: these are remote companion experiences. It’s great that they exist and that OpenAI cared enough to make them great, but they’re still no substitutes for the real Codex experience on a Mac. It’s ironic if you think about it, isn’t it? A headless Mac is still more flexible and powerful than an iPad hamstrung by the closed nature of its own OS and software gatekeeping.
My headless Mac Studio in Mirage for iPad.
Mirage for iPad’s app launcher.
If you’re among the five million people using Codex on a weekly basis and will be planning your next laptop purchase in a few months, perhaps these considerations will change the calculus for you. Especially in the face of price increases and RAM uncertainty, would you be better served by spending $1,499 on a hybrid laptop that gets work done the old way with 256 GB of storage, or $1,499 on a computer where AI is a first-class citizen with 24 GB of RAM and double the storage? If we accept that power users’ priorities and workflows will be dramatically changing in the near future (if they haven’t already!), all prices being equal, which OS is best positioned for the future?
Of course, I like using both an iPad Pro and a Mac for different tasks. But let’s face it; in this day and age – and especially after last week – not everybody has the budget for two computers that have some overlap between them. Sure, I could argue that an iPad Pro + a headless Mac mini is an insane combo to get the best of both worlds these days: the nimble and delightful nature of iPadOS and the freedom to experiment with AI on a Mac. You can install apps like the latest Jump Desktop beta or the great new screen sharing app Mirage on the iPad and use your Mac mini almost as if it were connected to the iPad’s display. Set up Tailscale on your network, and the Mac’s power can be with you at all times. But that’s a lot of money, and a lot of setup, to achieve an approximation of what a single MacBook Air can handle with more memory, more storage, and a couple of Mac apps.
I’m sure that Apple is aware of the changing nature of this landscape, but in a similar vein to chatbots and Siri, perhaps they were unprepared for the tide of agents to accelerate so quickly. If the idea of putting macOS on an iPad Pro continues to be a non-starter at Apple, and assuming agent-based coding and knowledge work are here to stay, what should the company do to make sure the iPad doesn’t get left behind again? Is a sandboxed Terminal for iPad backed by a dedicated “Agent Framework” the solution? Is working with other companies to build more “remote companion” apps the way forward?
Or, perhaps more obviously: how long until Siri AI can also become a capable agent, connected to App Intents, on par with competing frontier agents?
Until, and if, that happens, the iPad will once again play the role of sidekick to macOS.
When it comes to the bleeding edge of AI and pushing the frontier of agents forward, there’s nothing like the Mac.
A Apple confirmou na WWDC 2026 todos os modelos compatíveis com o iOS 27, e a boa notícia é que nenhum iPhone ficou para trás face à versão anterior. Já a nova Siri com IA só chega aos modelos mais recentes, mas apresenta uma justificação para tal.
Segundo Thomas Regnier, porta-voz da Comissão Europeia, não existe nada no Regulamento dos Mercados Digitais que impeça a Apple de lançar novos produtos, acrescentando que a empresa "simplesmente não conseguiu desenvolver soluções de interoperabilidade que cumpram os requisitos essenciais de privacidade e segurança".
I'm desperate for a personal AI assistant, but do I really want to become the kind of person who can't function without the friendly robot voice in my phone?
Après plusieurs années d’attente et de promesses, Apple revoit en profondeur son assistant vocal. Il est plus intelligent, plus conversationnel et désormais capable d’agir directement dans les applications. Mais est-ce que Siri AI est plus qu’un simple clone de Google ?
Segundo a Apple, foram apresentadas à Comissão Europeia soluções que permitiriam trazer a nova Siri para o mercado europeu e garantir o suporte a outros assistentes inteligentes no iOS e iPadOS 27. No entanto, a Comissão Europeia terá recusado a proposta por não cumprir as regras do DMA.
Apple primarily made the case for an improved experience with its long-standing Siri assistant, which like most other announcements had a hefty helping of AI.
Login
