WWDC26 felt like a defining platform moment. Apple is no longer simply promising that AI will arrive eventually; it is arguing that Apple Intelligence and Siri AI should become central to the future of its ecosystem. If that works, the company will have turned AI from a perceived weakness into a new reason to stay inside Apple’s world.

Still, the bigger question is execution. Apple did not present AI as a lab experiment; it presented a polished, consumer-ready experience. That raises expectations. 

Apple must deliver this time

Users will not judge Apple Intelligence by model architecture or parameter counts. They will judge it by whether Siri understands them, whether actions work reliably, whether personal context feels useful rather than intrusive, and whether the experience is consistent across devices.

Since Monday’s announcements, we’ve learned that some features will not work on all devices — and there’s speculation Siri AI may not fully escape beta until 2027. “Until Apple puts a stake in the ground and says when the new Siri features will be available, the debate remains: Does Apple actually have the chops in personalized AI? The demo suggests yes. The lack of timing suggests maybe,” wrote analyst Gene Munster.

Optimists argue that Apple has regained momentum by presenting a coherent AI story, one built around privacy, integration and everyday utility rather than spectacle. Skeptics counter that many of the features resemble capabilities already available elsewhere, and say the company still needs to prove it can ship them at scale and make them a meaningful reason for consumers to upgrade.

What the analysts say

That balance is visible in analyst reaction. In a client note seen by Computerworld, Erik Woodring of Morgan Stanley described the keynote as clear progress on Apple’s AI roadmap and said it suggested monetization opportunities could arrive earlier than expected — even if the overall journey will be “a marathon, not a sprint.”

UBS, in contrast, said the privacy-focused AI additions are useful but unlikely to be a material driver of iPhone demand in the near term, while Barclays called the changes interesting but incremental, and not enough to drive an upgrade cycle.

Ben Wood, chief analyst at CCS Insight, argued that Apple had to answer concerns about its AI shortcomings and now has to prove that its privacy-led, integration-first approach translates into a meaningfully better everyday experience. “Consumers will not judge Apple Intelligence by model sizes, partnerships or technical architecture,” Wood told me. “They will judge it by whether Siri understands them, whether actions work, whether personal context feels useful rather than intrusive, and whether the experience is consistent across devices.”

Dipanjan Chatterjee, vice president principal analyst at Forrester, said Apple’s strength lies in shifting the focus from the underlying technology to outcomes such as usefulness, simplicity and trust, while warning that the company still has skeptics to win over after its stop-start AI rollout. “The lesson for brands is clear: market the value, not the ingredients,” said Chatterjee. “After stumbling with the Apple Intelligence roll-out, Apple’s success will hinge on delivering the new Siri experience quickly, and ensuring it works as promised for iPhone users at scale.”

What about Apple developers?

While many are infuriated about Europe’s inability to build compromise, Apple’s developer army otherwise seems positive about what the company has accomplished. 

“On the AI front, it never made sense to me for Apple to develop their own LLM, so focusing on powerful, fast and private for implementation of Apple Intelligence seems to be an effort that is progressing rather nicely.  In all, a pretty good Keynote, I’d say,” Rich Siegel, founder and CEO of Bare Bones Software, said in an interview.

“It’s great to see Apple continue to pursue a vision of AI that leverages local systems, preserves privacy, and integrates with third party tools,” said Ken Case, CEO of the Omni Group. “A lot of our work around the Apple Foundation Models and automation, App Intents, and adopting Swift look to be fruitful investments, but it’s clear there’s more to do starting this summer. It’s also welcome to see them refine Liquid Glass, giving customers more control and listening to feedback they’ve heard over the past year.”

“I expected that this year’s Siri revamp would be the biggest personal assistant update Apple has ever done, and that’s exactly what we got,” said Sergii Kryvoblotskyi, director of AI and research at MacPaw. “Since Apple acquired Siri back in 2010, it has lacked one thing: real intelligence. Behind the great speech recognition service it provided, the tech was not ready to provide real value to users.”

“Most notable for me was Siri AI and the push towards on-device and more capable models that can do more with user context,” Matt Vlasach, Jamf senior vice president, enterprise products and solutions engineering,” said in an interview. “While obvious for consumer use cases, as illustrated in the keynote, the opportunity to evolve this to the work context using a more advanced Apple Intelligence framework is an exciting evolution.”

“OS 27 feels like a deliberate reset, less about new features and more about polish and quality-of-life improvements, which most users will welcome,” said John Richards, general manager, IT products, at Iru. “The new capabilities are focused entirely on Apple Intelligence and Siri AI, and what’s encouraging is how much Apple leaned into privacy with the Gemini partnership. That combination of capability and privacy-first design is the right instinct.”

“The single biggest request I made at Apple’s Foundation Models workshop in Madrid was opening Private Cloud Compute to third-party developers,” said Serhii Popov, senior software Eengineer at CleanMyMac. “It’s here and free for apps under 2 million users. That’s a real breakthrough and a huge opportunity for a lot of great apps.”

How will integrated AI change things?

Joel Rennich, senior vice president for product management at JumpCloud, looked ay how on-device AI will transform other paradigms. For starters, it shifts identity from simple authentication to governing what actions an AI agent is allowed to take.v“Enterprises will need identity frameworks that govern both human and non-human actors consistently,” he said.

“iOS 27 and Apple Intelligence point toward an operating system that does not just launch apps, it executes intent,” Rennich said. “Instead of users navigating between tools, the OS increasingly mediates outcomes directly through AI. This changes how work is initiated and completed on devices.

“With Apple Intelligence integrated across core experiences like Siri, Safari, and system services, AI is no longer an overlay but infrastructure. The separation between where data lives and where it is used becomes increasingly invisible to the user. Intent becomes the primary input, not app selection.”

I also spoke with Hexnode CEO Apu Pavithran, who pointed to some of the concerns enterprise users might have following WWDC: “The keynote didn’t speak much to admins,” he said. “The features that matter most at the management layer, such as how Apple exposes Siri AI through MDM APIs, whether IT gets granular per-app controls for Apple Intelligence, how shared device deployments handle the new assistant — these will be answered in the developer documentation. This week, that’s where IT teams should be looking.”

“Admins should dig in immediately and see what’s changed. Watch the developer docs, audit how Apple Intelligence interacts with existing device policies, and remember that the keynote is only a part of the story for enterprises,” he said.

Making AI great again

“Rebuilt from the ground up, Apple is trying to make AI feel native, useful and invisible across the devices people already use every day,” Francisco Jeronimo, vice president for client devices at IDC, said in an interview. “This matters, because the winning AI experience for consumers will not be the loudest or most technically complex. It will be the one that understands context, respects privacy, works reliably across apps, and reduces friction without forcing users to change behavior.”

“[Apple] is also clearly seeking to differentiate through its privacy promises,” said CCS Insight’s Wood. “This looks like a step in the right direction, but there is no room for complacency, and Apple still has a long AI journey ahead.”

Pavithran reflected on something more. “Overall, it’s hard not to think of this year as a deliberately measured keynote, one that’s intentionally playing it safe and seeking to rewrite the AI narrative,” he said. “I won’t be surprised if this ends up setting the stage for a much bigger installment next year with incoming CEO John Ternus hitting the ground running with some ‘wow’ features like new hardware or agentic AI at scale.”

That we can now seriously consider that possibility shows the extent to which Apple has regained momentum in AI on its platforms.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon and The Core.

There were several key components to emerge from Apple’s developer conference Monday as the company sought to reassure users (and investors) that it has met the existential challenge represented by AI. Aside from a serious focus on Siri AI and embedded Apple Intelligence across its varied platforms, officials also hailed a slew of performance/usability tweaks, described new child safety tools, gave macOS 27 a real name, “Golden Gate” — and offered a standing ovation in farewell to outgoing CEO Tim Cook.

Before the Worldwide Developer Conference (WWDC), analysts seemed optimistic about the company’s plans, most of which had already leaked. Analysts didn’t expect Apple to announce anything that would transform the AI industry (it didn’t), but they did hope the company would introduce tools to keep it competitive with rivals (it did). That’s assuming all the demos at the event were live, actual feature demos, rather than faked set-ups as seen before.

Hard, hard work

Apple’s teams have evidently worked incredibly hard to come this far, and execs did introduce truly impressive new AI features focused on what customers and developers actually need. The company also played to its strengths, particularly around vision intelligence; private-by-design (large language models) LLMs; highly useful contextual awareness; and Siri AI, which works as an app and lets you carry on conversational quests securely across all your Apple devices.

As anticipated, Apple also introduced APIs developers will be able to use to provide new AI features in their apps.

Among the many individual tools most of us can expect to use this fall, are:

• Siri AI, which can help users search for information across their messages, emails, photos, and more; answer questions about virtually any topic; and take action in apps. 
• Apple Passwords, which now automatically fix weak and compromised passwords with agentic AI.
• Spatial reframing, which lets users recompose a photo after it’s been taken by dragging to shift perspective, as if repositioning the camera in the original scene.
• A new Extend Tool, which expands the edges of an image to add breathing room, fix a crooked horizon, or change aspect ratio without losing the original subject.
• A Notify Me tool that monitors web pages for changes such as price drops or restocks and sends a notification when something changes.
• Photorealistic image generation, which supports the creation of high-quality photo-realistic images via a new generative model running on Private Cloud Compute.
• One-tap contextual suggestions in Messages, which surface actions such as creating reminders and notes, or finding relevant photos based on conversation context.
• And Describe a Shortcut, which means users can describe an automation they want in plain language and Shortcuts assembles the required steps automatically.

All about you, not AI

Apple did not seek to introduce AI features for their own sake; instead, it remains deeply focused on how to make its devices more useful to customers. As Craig Federighi, Apple’s senior vice president of software engineering, said: 

“Truly helpful AI must be centered on our users’ needs, deeply integrated into the products they rely on every day, grounded in personal context, and built with privacy at every step. That is our vision for Apple Intelligence. With useful features for browsing the web, expressing creativity, editing photos, and so much more, today marks a big step forward on our journey to integrate powerful AI into the core of our platforms and make our products even more personal and useful.”

Apple is not Gemini

Apple confirmed that it worked with Google Gemini to create some of the AI models highlighted today. This led some analysts before the event to say: “For Apple, the bull case is that a working Siri reframes it as an AI winner; the bear case is that paying a rival for core intelligence caps the premium investors assign to the stock.”

Perhaps they need not worry, as what we now seem to have is a far more solid base from which to continue to develop AI services and tools that compete against others in the space. Not only that, but Apple is not using rebranded Gemini — it simply worked with Google to build its own models, as Federighi insisted. In meetings at the show, Apple explained the full extent of the work it did with Google, stressing that none of the new features should be considered white label versions of Google’s LLMs. 

(Even Apple’s new search tools are based on its own search database, rather than anybody else’s. And when advanced searches are shared with Google-hosted Nvidia processors, Apple puts privacy protection in place.)

In the end, the most important consideration — for customers and developers — is that Apple seems to have succeeded in bringing dozens and dozens of powerful new on-device AI tools to its customers, giving it a firmer, more impressive peer position in the business. (It’s also true that investors were disappointed that the new AI features won’t be made available in Europe or China due to regulatory challenges, putting developers in both nations at a disadvantage.) Developers elsewhere will be able to explore Apple’s Foundation Models and its new Core AI APIs to their heart’s content. 

First reactions to Apple’s news

While Apple’s stock value dipped as investors sold on the news and invested into the speculation, I do think Apple successfully turned this corner — though it will need to continue to invest heavily in AI across its platforms. The work is far from over.

“It is great to see Apple continue to pursue a vision of AI that leverages local systems, preserves privacy, and integrates with third party tools,” Ken Case, CEO of the Omni Group, told me. “A lot of our work around the Apple Foundation Models and automation, App Intents, and adopting Swift look to be fruitful investments, but it’s clear there’s more to do starting this summer.”

Creative Strategies President and Principal Analyst Carolina Milanesi explained why it matters Apple is deploying these capabilities across its ecosystem, as it gives the company a unique market position. “Where Apple Intelligence is today is different than what Claude or ChatGPT are because is it really embedded in the devices, and we need to remember that Apple sells devices,” she said.

Apple did also note that the new Siri AI will be available in beta this year. “Investors wanted it in September. That means the real version is likely early to mid 2027,” said Gene Munster at Deepwater Asset Management. “Funny that the stock actually ticked up 0.5% on the “beta later this year” update given [that] while it’s later than what they wanted, it is at least a date that investors can focus on.”

It is also true that what Apple did achieve this year at WWDC is to offer up a set of new AI features that investors already see as having significant value.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon and The Core.

Everybody is watching to see what comes from Apple at its annual Worldwide Developer Conference (WWDC) today. There’s a great deal at stake, as when it comes to artificial intelligence (AI) today’s event represents an existentially important moment for the company. 

Apple execs absolutely must convince developers, industry watchers, users — all of us — that it has learned from its well-publicized mistakes of the past two years and put together a serious proposition for AI across its platforms.

What we think we know

Right now, we think Apple intends to offer a hybrid of its own self-developed AI tools and services combined with others made with Google Gemini — all supported by an open approach to using AI services from third-party providers such as Anthropic or OpenAI. 

When it comes to implementation, this should mean a contextually sensitive Siri that can respond to what you have on the screen of your device, or in the viewfinder of your camera app. The idea here is that you’ll be able to do contextual tasks like book restaurants or send a message to your granny, translate a sign, or even navigate around a room. More than this, you should also be able to combine tasks giving Siri complex — agentic AI — tasks it can then transact on your behalf.

Many of these functions will take place on device. Some will rely on Apple’s own fleet of Private Cloud Compute servers, supported by additional capacity from Google and Nvidia. When Apple Intelligence/Google Gemini can’t accomplish a task, you’ll be able to request that another service handle it on your behalf outside Apple’s managed garden. Siri itself will also gain a brand new interface.

What developers expect and how we got here

As discussed here, developers expect Apple will make access to many of its new Apple Intelligence APIs available to them.  This will let them deploy useful functionality in their apps at no charge, in part because the intelligence takes place on the device. 

It will also be possible for developers to permit their apps to run without being opened, which means a user should be able to ask Siri to do complex tasks that also include functionality from their apps. During this past weekend, we were warned that some or all of the new Siri functionality might be introduced on a staggered basis using a waiting list.

Apple has come a long way since that tense meeting in early 2025 when the company’s senior leadership established a new approach to AI. With Apple CEO Tim Cook taking an uncharacteristic interest in driving his teams to pull their act together, Apple developed a new, partnership-based approach to try to recapture lost ground.

Has Apple achieved it? That’s the test

Has Apple finally regained the initiative?

To a great extent, that will be the big focus across the industry once the company tells us what it’s done. Cook’s final WWDC as CEO sees a company at the absolute top of its game in so many ways, including soaring Mac sales. But to some extent he will be judged on how successfully Apple’s AI pivot comes across.

Weekend analyst notes summed it up, with bears and bulls tossing insights along. In one camp, you’ll find the true believers who argue that if Apple does come to us with something convincing, it has a chance to absolutely dominate consumer AI. “Siri/Apple Intelligence 2.0 has the potential to become the ultimate AI resource offload and deliver a form of Agentic AI to the consumer at a lower cost than incumbents,” said Morgan Stanley analyst Eric Woodring.

Cynics, however, warn that Apple really must demonstrate the kind of contextual, agentic AI it first announced (and failed to ship) two years ago; they want a chatbot with muscle, and will see right through any attempt to place a PR veneer over something weaker than what others already provide. If Apple fails to deliver on this, it can expect its stock to be utterly savaged over the next few days, though some analysts believe that Apple’s previous missteps mean the damage is already priced in.

A chance to shine, but can it?

Ultimately, of course, in addition to convincing industry watchers, Apple will need to find a way to deliver the kind of AI power consumers have been told to expect — while also protecting privacy. If it does get that right, particularly if it truly exploits its powerful hardware to ensure the most common tasks take place directly on the device, it has a major opportunity to deliver a form of Agentic AI at a lower cost than incumbents can. And it can do so while leaving the core AI bubble to burst as and when it will.

Will Apple succeed? We’ll know in a few hours, when you should check back for first takeaways on what Apple has to share. Join me on the Core for the headline summaries.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon and The Core.

As we lean into WWDC, three strategically brilliant Apple moves have been exposed in the last couple of weeks, two of which will have immense consequences in the coming year, while one sets the scene for essential future growth.

In each case, Apple’s leadership has found counter-intuitive gambits that actually secure the company’s future. Let’s start with Vision Pro.

It came from the future

News this week is that incoming CEO John Ternus has made some tough decisions around Apple’s approach to spatial computing, terminating development of Vision Pro (even as leaked images of a black model emerge) while focusing R&D on two smart glasses projects to compete with Meta. 

The intention is to introduce XR and AR glasses priced at around $300 to $500 each. While not as richly-featured as the Vision Pro, they will be within the reach of more people and draw deeply on the huge R&D effort that went into the original Apple AR visors. Apple hopes a focus on trust and privacy will be enough to push Meta aside, helping Cupertino dominate this part of the category. If that plan succeeds, don’t be at all surprised to see plans for Vision Pro 2 return to the table, though that’s not the focus now.

Apple frequently described the Vision Pro as a product “pulled from the future,” a device for enterprise users and early adopters. For many such users, the existing product will be useful in their work for time to come. 

What’s strategically solid about this is that Apple has now defined a good future for spatial computing and is bringing components of that future to the mass market on the basis of a provable technology you can already try for yourself in any Apple Store. This is a long game, and while it will take time to play out, it’s a game the company has proved it can join.

Privacy as a standard

Apple has apparently chosen to use Nvidia and Google technologies to support at least some of the Apple Intelligence/Siri improvements to be announced at WWDC next week. This seems to fly against the company’s general approach to privacy on its platforms, with the silicon, operating system and — thanks to Private Cloud Compute — the cloud all in its control.

How, you might ask, can Apple ensure privacy when using third-party infrastructure to manage some AI transactions? How can it do so without damaging its trusted brand?

One direction that makes sense is to consider that Apple and its partners have reached consensus on what privacy should be and how it should be delivered. That’s a very important consensus, as it suggests Apple is building an approach that makes privacy an attestable standard.

The company has been pushing governments for years to agree to such standards, but all it seems to have had in return are continued government attempts to erode personal privacy. That’s particularly evident in the UK government’s egregious move to undermine encryption to the detriment of all. (The UK isn’t really alone in preferring surveillance above liberty.)

Android developer Google has had the same experience, and while its approach to privacy differs from Apple, both companies understand the need for encryption. As such, any form of consensus on some form of privacy standards is welcome — and while I’d very much prefer an enforceable, verifiable approach, some industry agreement has to be better than nothing at all. 

While I don’t believe Apple’s approach to privacy in the new breed Siri/Apple Intelligence will be introduced in this way at WWDC, it will be interesting to see what does emerge from the new tech triptych (Apple, Google, Nvidia) in the coming months. Certainly, all three have a great interest in guarding encryption against Quantum attacks for which hidden backdoors would be easy pickings.

Winning the PC War

Apple has won the PC war.

• MacBook Neo is selling in such vast quantities; IDC had to boost its laptop market growth forecast even while predicting a huge Windows PC sales decline. 
• Competitors are churning out products they’re marketing as MacBook Neo competitors, even though many reviewers note higher prices and lower build quality.
• Rapid component price increases, particularly around memory, are prompting some Neo competitors to come with just 8GB of RAM.  

That last point needs explanation: Apple’s entry-level MacBook Neo also has just 8GB RAM, but it also has custom-designed Apple processors and an operating system optimized to run on the hardware. That means those Macs use memory far more efficiently than their competitors. 

So, you can pick up some mass market Windows laptops for $800 that hold just 8GB memory, or spend $699 for a MacBook Neo with double amount and that can also run Windows in VM extremely well. 

Component prices are not going to shrink back for a while, any more than further magical thinking is going to end the war in Iran. At this point in the cycle, Apple has the PC market advantage. Millions are purchasing its entry-level Mac and the vast majority of those new users will love the platform, as new users usually do. That’s going to lead to a spike in Apple services sign-ups, and prompt solid future upgrade and accessory sales cycles.

Apple accomplished this by selling a low-cost Mac at a time when competitors face existential problems maintaining their grip on the mid-range market. The longer Apple holds prices on the device, the greater the advantage it builds, while applying huge pressure on PC competitors.

Summing up the goods

With the Mac hitting its iPod moment as it achieves mass market sales, Apple finally seeing something like progress in its attempt to secure privacy in a digital age, and a strong position from which to grow in the wearables market, the company has played a fine hand. 

That’s even before it introduces us to its improved Apple Intelligence, and an era of AI access in which many everyday tasks take place token free directly on the device. Indeed, when it comes to AI, if it gets things right at WWDC, Apple appears to be making money, while AI competitors are bleeding financial oxygen as their inflated bubble heads to its inevitable demise. What about the enterprise? Take a look at this chart.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon, and follow The Core.

Apple’s latest Safari privacy campaign is more than pre-WWDC marketing. It is an early signal of how the company plans to frame artificial intelligence (AI): as something that only works if users trust the platform behind it.

The week before WWDC is often significant, as Apple tends to make announcements it simply can’t fit into the keynote itself. This year’s first pre-show reveal is a new campaign focused on privacy that shows how much more private Safari is than rival browsers; there’s even a highly entertaining video that makes the point.

Privacy on Safari

Apple has been building privacy protections into Safari for years. The browser protects you from malicious scripts that might attempt to access passwords or credit card information. Safari also tells you what data an extension wants to access and can restrict access to match your settings. It blocks third-party cookies by default, detects and removes trackers, and has measures in place to prevent data companies from identifying — and following — you through device characteristics. 

That’s even before Apple’s powerful Private Browsing mode, which includes meaningful protections. The company has put together a page packed with resources to explain the privacy protections it has in place across its platforms.

Privacy is critical to Apple — not only because the company regards it as a human right, but because it correctly recognizes that to make new generations of sensor-laden technologies it must ensure privacy is protected. Without privacy and trust, people won’t use the technology.

Trust is the product, not you

The truth is that people are becoming increasingly concerned about how the digital devices we depend on for convenience are now being used for different kinds of surveillance, and we need to be convinced that our personal data is protected. We do not want every aspect of our life to become fodder to feed a digital dystopia, even as we still want the positive solutions technology promises.

Think about the Apple Watch. Consider the data it gathers: distance walked, calories burned, and more — it’s a rich trove of personally identifiable data that no one really wants to share with others without consent. Apple Watch is not the only Apple device that is gathering information, even your web browser captures a great deal of it. Hence, the focus on Safari in Apple’s new campaign.

Privacy will become an even greater concern as AI spreads. Data brokering services already make extensive use of AI to analyze and identify patterns in the online data they harvest. AI deployed without strong privacy protections poses serious risks to the way we live, while the consolidation of AI ownership in the hands of a few companies risks creating dangerous imbalances of power. That’s the context in which private data needs to be protected, making privacy an essential component of a positive tech-augmented future. 

Why the AI era raises the stakes

Apple’s focus on privacy is far from new; it has been consistent in this work for many years. Competitors often accuse Apple of hypocrisy, but the company has been arguing for privacy’s importance for more than a decade. Others have adopted some of the same principles, though not all of them — and while Apple may sometimes use privacy as a moat for its own products and services, that does not diminish its value.

It’s with all this in mind that I consider Apple’s latest privacy ad campaign and its rollout just before WWDC, where it is expected to introduce new AI services. That Apple’s new privacy campaign seems not to have made the final cut for the show tells me the company has much more to discuss on the topic, particularly around Apple Intelligence.

What Safari’s signals suggest

When Apple introduces its new AI features at WWDC it will do so while celebrating the privacy built into them. The current privacy ad campaign will be part of an overall push as the company explains that its ecosystem can run third-party AI services while also offering its own bespoke Apple Intelligence AI to do really useful things in complete privacy.

This isn’t just a competitive moat, it’s a realistic assessment in practice. It shows that Apple understands that in the age of AI, privacy matters more than ever. As AI becomes central to everyday digital experiences, privacy is no longer optional — and Apple is prepared to make the case to support it.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon, and follow The Core.

Apple will open the doors to developers at its Worldwide Developer Conference (WWDC) next week. Beyond a big push on AI and new OSes focused on stability and performance, what should developers expect? Mostly it’s about new APIs, Foundation Models, and App Intents; here’s what I’ve been able to figure out so far.

Foundation Models

Apple has been building new Apple Intelligence APIs. One way it is achieving this is to take models made with Google Gemini, then distill and shrink them to fit inside (and run on) its devices. The progression will be to introduce these as a new crop of Foundation models developers can use in their apps. There’s more:

• New APIs mean developers will be able to run Apple Intelligence tools such as summarization directly on the customer device, all offline, all private.
• Developers that use Apple’s standard text editing/entry views will gain access to improved Apple-developed tools inside their apps without custom-coding.
• Because intelligence takes place on the user’s device, neither developers nor users will need to pay for those AI tokens. This is a distinct cost and privacy-saving advantage for customers and developers.

App Intents: The next generation

Apple continues on its quest to convince developers to make features of their apps available for use via Siri with App Intents. Doing so requires developers to wrap their apps into semantic structures, enabling speech/text-based interaction. To help them achieve this, Apple is expected to introduce a complete redesign of its App Intents framework.

Speak as you wish

While users must say “Hey Siri” to invoke its attention today, the assistant will respond more dynamically to natural language. Combined with App Intents, that means users should be able to ask Siri to use a combination of apps to make things happen on the device.

A developer might build a travel app that can take an itinerary and hand it across to a budgeting tool, for example. The idea is that with a spoken or typed command, a person will be able to call on a collection of apps to identify the destination, create an itinerary, put together a to-do list, prepare relevant letters or emails, and assemble a budget — all invoked by the original command.

What about context?

We’re expecting Siri to become better at using the content of your screen, location, and other personal data as it seeks to provide more contextualized responses. We don’t yet know the extent or form in which Apple will make that information available to third-party developers to help contextualize their own apps. Apple’s focus on privacy matters a great deal, as does its relationship with regulators, some of whom will demand that data made available to Apple’s own apps be made available to third-party apps. These are important matters for Apple, app developers, and customers who want the convenience of AI without loss of privacy.

More consistent UI tools on Swift

Swift should get better at migrating legacy code, but the big speculation around it concerns Liquid Glass. Will Swift make it easier for developers to build consistent user interfaces that work properly across all Apple’s platforms? If it does, then it will help overcome one of the big criticisms of Apple’s liquid-inspired UI. Swift will also usher in the tools developers need to support agentic application coding.

Better vibes for Xcode

Vibe coding is everywhere, including within Xcode, which is expected to gain improved contextual and predictive understanding to help boost developer productivity. Xcode could also  introduce improved real-time architectural debugging hints, aiming to make it easier for developers to build bug-free apps.

A Mac you can wear: Vision OS

All the AI enhancements made available across Apple’s other products will also be offered to visionOS. That access takes the headset another step closer to becoming the Mac you wear like sunglasses.

Elsewhere

• A new Camera API means developers can build specialized, interactive buttons that users can deploy directly within the native iOS Camera interface. This should be a great way to use more sophisticated camera apps more naturally.
• Wallet Pass means apps will be able to ingest things like barcodes or gym passes for use within Wallet.
• Icon Composer might offer more tools designed to promote consistency.

Intel finally retires

Apple will abandon Intel support in macOS 27, which means developers will likely end support for legacy Intel applications in response.

After the gold rush

Once the lights go down on WWDC, Apple’s real test will be to see if its announcements help make AI useful, private, and affordable to developers and their customers. After all, if Apple gets AI right on a platform basis, it should be able to offer the kind of on-device intelligence no one else can match, at no charge to developers or users — a move that might yet kick-start AI innovation across its platforms. This will provide a moat around the Apple ecosystem, inside which developers can explore new potentials for AI to give customers the tools they need at costs they can afford.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon, and MeWe. 

I will sit right down (waiting for the gift of sound and vision)
And I will sing (waiting for the gift of sound and vision)

— David Bowie

Apple is planning to sponsor and present 14 AI research papers at the annual IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) in Denver next week, just days before it introduces major new AI features at its Worldwide Developer Conference (WWDC).

The fresh research explores topics such as using LLMs in image generation, quality testing, and user interface prototyping. For months, supply chain rumors have hinted at a radical evolution for the ubiquitous AirPods in the form of built-in ambient cameras. With this in mind, it’s noteworthy that one of the research papers, “From Where Things Are to What They’re For: Benchmarking Spatial–Functional Intelligence for Multimodal LLMs,” specifically seems to cater for such use cases. 

Accessibility for the people

In application, this tech promises profound potential for accessibility. It suggests that someone with limited vision might be able to get their AirPods to guide them through an unfamiliar room. This is something that should fit well inside the company’s ongoing narrative around machine vision intelligence and accessibility. 

Accessibility is central to a second presentation to be made during the Generative AI for Sign Language Workshop at the conference. Led by Apple’s Colin Lea, who presented a session on speech tech for people with speech disabilities at a similar event, this focus on machine vision intelligence and accessibility is entirely deliberate. 

Indeed, even though the industry and critics condemn Apple for lagging behind others in the AI space, the publication of these 14 papers at a key industry session just before WWDC shows the company has been doing a great deal of foundational work behind the scenes. We expect this work to bear its first fruit at WWDC, and it is important to understand the disclosures as a power move. Apple is using the show to celebrate its strengths in AI development, and given its decade work on Apple Car, many of those strengths relate to machine vision intelligence. 

Apple is so advanced in the field it is already deploying advanced models that empower consumers. Just last week, it promised to introduce a new tool called Image Explorer in VoiceOver to help partially sighted customers later this year. Among many other features, this will arrive alongside a system to let disabled users control compatible wheelchairs with spoken word commands. 

Apple is pushing boundaries all the way. Its paper “VSAS-Bench: Real-Time Evaluation of Visual Streaming Assistant Models,” proves it is actively refining models to process live video instantly on consumer hardware. 

What matters, the human or the machine?

The difference between Apple and its competitors is deep and philosophical. I’d argue that while others build cloud-dependent chatbots, Apple is embedding AI tools that solve real human problems in its systems. 

This extends to its plans at WWDC, where it will introduce a raft of AI tools made with help from Google Gemini and a host of AI services it has developed in house. The latter will include a great many accessibility tools of the type it will discuss at the CVPR event, the beauty of which being that they will run privately and on-device. You could argue that while other tech giants are using AI to automate white-collar jobs or build a surveillance dystopia, Apple is searching for applications of machine intelligence that solve real human problems. 

The company seems pretty realistic about the ongoing AI transformation. It recognizes that its own ecosystem must become a peer player in the emerging AI-augmented environment the tech industry seems intent on building. 

With that in mind, Apple is willing to engage in strategic, mutually beneficial partnerships, such as permitting Siri to use third-party AI services to handle requests. But even as it does that, it is also focusing on those areas in which it can make a unique difference, such as the accessibility features Apple as a platform has always provided.

Open up

As the Vision Pro demonstrated, and as these mythical video-enabled AirPods will in the future suggest, computers are steadily getting smarter. So, the way we use them is also changing as we move away from the rigid boundaries of keyboards, mice, and touchscreens. Apple’s quest for ambient computing began long before the sudden gold rush for generative AI chatbots. 

In the end, as the latter services become commodified, the way humans interact with them will define the next generation of hardware. That’s exciting for Apple, given that product design is where it excels. The era of sound and vision may finally have arrived.

You can follow me on social media! Join me on BlueSky,  LinkedIn, Mastodon, and MeWe.