Normal view

WWDC: What can developers expect?

Apple will open the doors to developers at its Worldwide Developer Conference (WWDC) next week. Beyond a big push on AI and new OSes focused on stability and performance, what should developers expect? Mostly it’s about new APIs, Foundation Models, and App Intents; here’s what I’ve been able to figure out so far.

Foundation Models

Apple has been building new Apple Intelligence APIs. One way it is achieving this is to take models made with Google Gemini, then distill and shrink them to fit inside (and run on) its devices. The progression will be to introduce these as a new crop of Foundation models developers can use in their apps. There’s more:

  • New APIs mean developers will be able to run Apple Intelligence tools such as summarization directly on the customer device, all offline, all private.
  • Developers that use Apple’s standard text editing/entry views will gain access to improved Apple-developed tools inside their apps without custom-coding.
  • Because intelligence takes place on the user’s device, neither developers nor users will need to pay for those AI tokens. This is a distinct cost and privacy-saving advantage for customers and developers.

App Intents: The next generation

Apple continues on its quest to convince developers to make features of their apps available for use via Siri with App Intents. Doing so requires developers to wrap their apps into semantic structures, enabling speech/text-based interaction. To help them achieve this, Apple is expected to introduce a complete redesign of its App Intents framework.

Speak as you wish

While users must say “Hey Siri” to invoke its attention today, the assistant will respond more dynamically to natural language. Combined with App Intents, that means users should be able to ask Siri to use a combination of apps to make things happen on the device.

A developer might build a travel app that can take an itinerary and hand it across to a budgeting tool, for example. The idea is that with a spoken or typed command, a person will be able to call on a collection of apps to identify the destination, create an itinerary, put together a to-do list, prepare relevant letters or emails, and assemble a budget — all invoked by the original command.

What about context?

We’re expecting Siri to become better at using the content of your screen, location, and other personal data as it seeks to provide more contextualized responses. We don’t yet know the extent or form in which Apple will make that information available to third-party developers to help contextualize their own apps. Apple’s focus on privacy matters a great deal, as does its relationship with regulators, some of whom will demand that data made available to Apple’s own apps be made available to third-party apps. These are important matters for Apple, app developers, and customers who want the convenience of AI without loss of privacy.

More consistent UI tools on Swift

Swift should get better at migrating legacy code, but the big speculation around it concerns Liquid Glass. Will Swift make it easier for developers to build consistent user interfaces that work properly across all Apple’s platforms? If it does, then it will help overcome one of the big criticisms of Apple’s liquid-inspired UI. Swift will also usher in the tools developers need to support agentic application coding.

Better vibes for Xcode

Vibe coding is everywhere, including within Xcode, which is expected to gain improved contextual and predictive understanding to help boost developer productivity. Xcode could also  introduce improved real-time architectural debugging hints, aiming to make it easier for developers to build bug-free apps.

A Mac you can wear: Vision OS

All the AI enhancements made available across Apple’s other products will also be offered to visionOS. That access takes the headset another step closer to becoming the Mac you wear like sunglasses.

Elsewhere

  • A new Camera API means developers can build specialized, interactive buttons that users can deploy directly within the native iOS Camera interface. This should be a great way to use more sophisticated camera apps more naturally.
  • Wallet Pass means apps will be able to ingest things like barcodes or gym passes for use within Wallet.
  • Icon Composer might offer more tools designed to promote consistency.

Intel finally retires

Apple will abandon Intel support in macOS 27, which means developers will likely end support for legacy Intel applications in response.

After the gold rush

Once the lights go down on WWDC, Apple’s real test will be to see if its announcements help make AI useful, private, and affordable to developers and their customers. After all, if Apple gets AI right on a platform basis, it should be able to offer the kind of on-device intelligence no one else can match, at no charge to developers or users — a move that might yet kick-start AI innovation across its platforms. This will provide a moat around the Apple ecosystem, inside which developers can explore new potentials for AI to give customers the tools they need at costs they can afford.

You can follow me on social media! Join me on BlueSky,  LinkedInMastodon, and MeWe

Intel stakes new claim in physical AI with robotics chips

Intel is invading the physical AI space with a reentry into the robotics market it quit many years ago amid financial struggles.

The robotics strategy is part of the company’s larger plan to establish AI on the “edge,” in which devices have the computing capability to run AI locally. Many devices lack AI capabilities and have to offload processing to the cloud.

The chipmaker said its Intel Series 3 processors are now in 130 edge AI and robotics designs. It also had a design win with SensoryAI, which provides technology for robots that include Ella, a robotic barista made by Crown Digital.

The company’s Core Ultra Series 3 processors are derivatives of chip designs intended for laptops. But Intel has achieved a level of power efficiency for long battery life that allows those chips to be adapted for handheld devices and laptops.

Intel also said it can build advanced robotics chips thanks to its latest manufacturing technologies.

For example, many robotic functions, such as computer vision and real-time controls, can be integrated into a single chip. Previously, functions like graphics and movement and control were distributed among different cores in a chip.

SensoryAI, for example, has a chip architecture that provides the robotic barista — which is more like a robotic arm — with AI capabilities, Intel said.

The main “Avatar” agent handles customers as the main “Ella” agent reasons and executes the task. If Ella encounters errors, it passes on the issue to a Guardian agent, which helps with the recovery. Some issues could include making sense of an order, or cups that might be stuck. 

The three agents are embedded in a single piece of Core Ultra Series 3 silicon.

Intel is displaying some of those robots at the Computex trade show in Taiwan. The company shared a video of a humanoid-style robot from the floor in a X.com post  

This is not Intel’s first attempt at the robotics market. Intel sold robotics chips and kits when it was a dominant chip player in the field, but curtailed efforts in 2021 after Pat Gelsinger took over as CEO and restructured the company to focus on manufacturing.

Robotics is now back on the menu under new Intel CEO Lip-Bu Tan, who replaced Gelsinger last year. He has restructured to company to focus on high-growth areas that can generate high returns.

A Morgan Stanley study last year indicated the robotics market could be worth $5 trillion by 2050 — and more than 1 billion humanoid robots could be in operation. 

Robots are seen to improve human productivity and manufacturing output. For example, they could help factories that are facing labor shortages or be used to complete tasks that are dangerous

However, challenges remain. There isn’t yet enough real-world data to train robots to do targeted work. And the AI models — generally called world models — they will need are still under development. 

Training robots to do a specific job requires a sequence of events to happen in succession without any errors. Companies are still training robots to spot and understand errors, analyze possible resolutions, and take the right corrective action.

IBM unveils tool to track sovereignty risks for cloud workloads

IBM has launched a tool designed to help customers assess cloud-sovereignty risks and meet regulatory compliance requirements. 

The Sovereignty Risk Profile launch comes as digital sovereignty becomes a higher priority for organizations concerned about where data is stored and processed. According to an IBM survey, 93% of executives believe sovereignty needs to be part of their business strategy.  

Via the new tool, customers can set up policies related to regulatory and business requirements — such as where data resides and how it’s protected, for instance. These policies can be applied to specific cloud workloads, regions, or zones in the Sovereignty Risk Profile tool, allowing users to track sovereignty requirements “in real time,” IBM Cloud product manager Janet Van said in a blog post, with “visibility into configurations, encryption posture, and environmental controls.” 

It’s then possible to assess compliance and decide what workloads meet sovereignty requirements. 

Tracking the factors that contribute to sovereignty is a challenge for many organizations, said Holger Mueller, vice president and principal analyst at Constellation Research. “It is very difficult, as you don’t know about the details of the stacks; sometimes, even the location of data is not fully transparent,” he said.

The Sovereignty Risk Profile “addresses many of the compliance-related requirements associated with data residency and encryption, while also tackling sovereignty from a resilience and concentration-risk perspective,” said Dario Maisto, senior analyst at Forrester.

However, the monitoring tool can only do so much to address digital sovereignty concerns, he said. While it can help organizations identify and report on potential issues, it “does not help [make] clients more or less sovereign, per se: it has only the potential to tell that a sovereignty problem is there.”

Broader questions around digital sovereignty remain difficult to address, he said, as there’s no universally accepted definition of the concept and limited legislation to establish clear requirements. 

Mueller described a spectrum of sovereignty issues that depend on factors such as whether data is stored, processed, and backed up in a customer’s own country, as well as whether staff that operate the data are domestic nationals. “Then there is the sovereignty of the software supply chain — but here everybody is dependent,” he said.

To further complicate matters, while several US hyperscalers sell sovereign-branded cloud services to European customers — with local staff and infrastructure —  concerns remain about the potential for extra-jurisdictional access to data, due to the US CLOUD Act and the US Foreign Intelligence Surveillance Act (FISA).

The Sovereignty Risk Profile is available within IBM’s Security and Compliance Center Workload Protection. It’s the latest in a range of IBM Cloud products aimed at addressing customers’ sovereignty concerns, including the recently launched IBM Sovereign Core software platform

❌