Siri AI is beginning its public rollout as Apple transforms its familiar assistant into a substantially more conversational system built around personal context, onscreen awareness, web knowledge, and the ability to perform actions across apps.
The beta is available first in English on compatible devices running iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27. French, Japanese, Korean, Portuguese, and Spanish support is scheduled for October. Availability remains more limited in some regions, with Siri AI initially unavailable on iPhone, iPad, and Apple Watch in the European Union and unavailable in China while Apple addresses regulatory requirements.
The release follows several years of gradual Apple Intelligence expansion, but Siri AI represents a more fundamental change. Instead of handling each request largely as an isolated command, the assistant can maintain conversations, find relevant personal information, understand what is displayed on a device, and combine those capabilities to complete multistep tasks.
Image Credit: Apple Inc.
Siri AI can connect personal context with app actions
The system can search across a user’s messages, email, photos, notes, and other information when responding to a request. Apple offers an example in which someone asks what a family member suggested doing during an upcoming visit. Siri can locate the relevant conversation, find a recipe previously sent by email, and then place the ingredients into a Reminders grocery list.
That combination of retrieval and action is central to the new design. Siri AI can draft an email, edit and share photos, create calendar events, manage reminders, control media, and perform other supported actions without requiring users to manually move information between applications.
Third-party apps can participate through Apple’s App Intents architecture. Existing integrations include tasks such as messaging through WhatsApp or playing an audiobook in Audible, with Apple also previewing deeper capabilities in applications including Microsoft Outlook, Notability, and Tripsy.
Onscreen awareness adds another layer. Siri can identify information currently visible on a device and act on it. Someone viewing a sports website, for example, can ask Siri to identify upcoming home games and add them to Calendar without manually copying dates.
Apple has also expanded Siri beyond voice. On iPhone, users can invoke the assistant with the side button, voice command, or by swiping down from Dynamic Island. On iPad and Mac, Siri AI is integrated into Spotlight, while systemwide context menus can send selected files, images, or text directly to the assistant.
Image Credit: Apple Inc.
Siri AI gets its own app and conversation history
Siri AI is no longer confined to a temporary interface that disappears once a request is complete.
Apple has introduced a dedicated Siri app where users can begin new conversations or revisit previous ones. Conversation history can sync privately through iCloud across iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro, allowing a discussion started on one device to continue on another.
Follow-up questions can retain the context of an earlier answer, giving Siri a more conventional conversational interface for longer exchanges.
The assistant also has access to broad web knowledge for questions that cannot be answered through personal information or local device data. Apple says Siri can retrieve current information for topics ranging from sports results to travel planning and nearby businesses.
Visual Intelligence expands alongside the assistant. On iPhone, a dedicated Siri mode inside Camera can identify and respond to objects or information in front of the user. A concert poster, for example, can become the starting point for questions about performance times followed by the creation of Calendar events.
On iPad, Visual Intelligence is integrated with screenshots. Mac users can select content on their displays through a keyboard shortcut, while Vision Pro users can ask Siri about app windows or physical objects simply by looking at them.
Writing Tools are similarly integrated across the system. Siri can generate drafts, revise existing text from natural-language instructions, and provide writing suggestions. In Mail and Messages, Apple says it can take a user’s typical communication style with a particular recipient into account, including tone and punctuation patterns.
Image Credit: Apple Inc.
Siri AI runs across on-device and private cloud models
Siri AI is powered by a new generation of Apple Foundation Models developed in collaboration with Google using Gemini technology, marking a notable shift in Apple’s AI infrastructure.
The architecture divides processing between models running directly on the device and larger models operating through Private Cloud Compute. Apple says requests sent to Private Cloud Compute are processed without personal data being stored or made accessible to the company.
Core resources such as the Spotlight index and Apple’s App Toolbox can remain on-device, allowing Siri to retrieve local information and perform supported actions without sending every request to a remote server.
More capable devices can also use AFM Core Advanced, Apple’s highest-performance on-device model. It powers improvements including more expressive Siri voices and advanced systemwide dictation that automatically handles capitalization, punctuation, and formatting.
Compatibility varies by feature. Apple Intelligence supports iPhone 16 models and later, iPhone 15 Pro and Pro Max, M1 or later iPads and Macs, iPad mini with A17 Pro, Apple Vision Pro, and supported Apple Watch models when paired with a nearby Apple Intelligence-enabled iPhone.
AFM Core Advanced requires newer hardware, including iPhone Duo, the iPhone 18 Pro line, iPhone Air, iPhone 17 Pro models, qualifying M4 or later iPads with at least 12GB of unified memory, M3 or later Macs with at least 12GB, and Apple Vision Pro with M5.
Image Credit: Apple Inc.
Siri AI arrives with limits as Apple expands access
The initial Siri AI release remains explicitly labeled beta, and some of the surrounding Apple Intelligence features are scheduled for later updates.
Apple also confirms that features relying on server-side models can be subject to daily usage limits. That includes Siri AI, cloud-based photo editing, Image Playground, and AFM 3 Cloud models used through Shortcuts. Limits can vary depending on the feature, request complexity, system demand, and other factors.
Apple says expanded access to server-dependent features will eventually be available for a fee, introducing a future paid layer to parts of Apple Intelligence even as the core system remains integrated into supported devices.
Apple will also expand its intelligence capabilities on Apple Watch later in 2026. Planned Audio Intelligence features on Apple Watch Series 12 and Ultra 4 include Live Rewind, which can display text representing the previous 15 seconds of a conversation, and Siri Recap, which generates high-level summaries that can be reviewed later in the Siri app.
Those functions are designed around a hardware-isolated Secure Exclave on the S11 chip, with Apple saying raw audio is processed in isolation and immediately deleted rather than stored as recordings. Live Rewind and Siri Recap are scheduled to enter beta later in 2026, making the current Siri AI launch the beginning of a staged expansion rather than the final form of Apple’s new assistant.
Apple’s all-new Siri AI. An even more capable AI assistant with expanded intelligence to be more helpful every day.
Apple on Monday released the next generation of Apple Intelligence, powering Siri AI, an entirely new version of Siri, and capabilities that make the apps and experiences users rely on every day more personal and helpful than ever. Siri AI is a profoundly more capable and conversational assistant with personal context understanding, broad world knowledge, onscreen awareness, and even more systemwide app actions. Siri AI can help users find what they need in the moment, from answering questions on virtually any topic to surfacing relevant information from a user’s messages, emails, photos, and more. And Apple Intelligence makes everyday experiences across Apple products more personal and helpful with new editing capabilities in Photos, intelligent browsing tools in Safari, an all-new Image Playground that can create photorealistic imagery, and more.
With Apple’s 2027 software releases, users can now access new Apple Intelligence capabilities across apps. Siri AI begins rolling out today in beta in English, and will expand to French, Japanese, Korean, Portuguese, and Spanish next month.
An Entirely New Siri
Siri AI is a completely reimagined version of Siri that is more personal and powerful. With detailed responses and rich, natural conversations, Siri AI helps users get more done than ever before.
Built on Apple Intelligence, this new version of Siri draws on personal context understanding to help users find what they need in the moment across messages, emails, photos, and more. And with even more systemwide app actions, Siri AI can help users with tasks such as drafting an email from scratch or editing and sharing a set of photos.
With even more systemwide app actions, Siri AI can help users with tasks such as drafting an email from scratch.
For example, if a user asks Siri what a family member suggested as an activity during an upcoming visit, Siri can search the user’s messages and find that they mentioned wanting to bake a family recipe together. It can then pull up the cooking instructions from an email the relative sent previously and add the ingredients to their grocery list in the Reminders app.
Siri AI already works seamlessly with apps from Apple’s vast ecosystem of developers. Users can continue to take action in the apps they already use with Siri, like texting a friend in WhatsApp or playing a book on Audible. And soon, users will be able to ask Siri AI to draft an email in Microsoft Outlook, search for a homework assignment in Notability, or add a restaurant recommendation to Tripsy.
With onscreen awareness, Siri AI can answer questions or take actions related to the content on a user’s screen. For example, while viewing their favorite sports team’s website, a user can ask Siri to find all the upcoming home games and add them directly to their calendar. And Siri AI can also use broad world knowledge to get up-to-date information on virtually any topic. Whether a user is looking for the score of a football game, tips for planning a vacation, or the best local coffee spot in a new city, Siri AI will leverage information from across the web to deliver helpful, accurate answers.
With onscreen awareness, Siri AI can answer questions or take actions related to the content on a user’s screen.
Users can extend almost any response from Siri into a rich conversation and ask follow-up questions. And users can take advantage of Siri AI anywhere across the system. In addition to saying “Hey Siri,” iPhone users can invoke Siri with the side button, or swipe down from the Dynamic Island to start a conversation and get an in-depth answer. On iPad and Mac, Siri AI is integrated into Spotlight so users can search for answers to almost any question. It is also integrated into systemwide context menus, allowing users to Control-click to ask about images, files, or text on their screen. On Apple Vision Pro, Siri AI leverages spatial computing with a 3D visualization that users can place anywhere in their space, and they can invoke Siri by looking at it and starting to speak.
To revisit a past conversation or start a new one, users can open the all-new dedicated Siri app. The Siri app uses iCloud to privately sync conversational history across a user’s products, so they can start chatting with Siri on iPhone, and pick up the conversation on Mac, iPad, Apple Watch, or Apple Vision Pro, bringing together rich conversations in one place.
When users want to revisit a past conversation or kick off a new one, they can open the all-new dedicated Siri app.
Expressive Voices and Improved Dictation Powered by the Most Advanced On-Device Model
Siri AI offers even more expressive voices, as well as a major boost in accuracy, with systemwide dictation for products that support Apple’s most advanced on-device model ever, AFM Core Advanced. Users have the ability to customize the expressiveness and pace of Siri’s voice so it’s just right for them. Dictation now captures what users say as polished text with greater precision, automatically handling capitalization, punctuation, and formatting as they speak. And with improved speech understanding, users can speak naturally and trust that their words will appear clearly, accurately, and as intended.
Visual Intelligence Is Now on iPad, Mac, and Apple Vision Pro
With Visual Intelligence, Siri AI offers powerful image understanding and multimodal capabilities, so users can ask questions about visual content across iPhone, iPad, Mac, and Apple Vision Pro.
On iPhone, Siri’s multimodal capabilities are integrated right into the Camera app with a brand-new Siri mode, allowing users to get information and take action on what’s in front of them. For example, while looking at a poster for a music festival, a user can ask Siri what the set times are for their favorite artists, and then have Siri automatically create multiple calendar events for the weekend. On iPad, Visual Intelligence is integrated right into the screenshot experience. And on Mac, users can tap into it with a dedicated keyboard shortcut, allowing them to select something on their Mac display and type directly to Siri to get a helpful answer. Visual Intelligence also expands to Apple Vision Pro, allowing users to ask Siri about things just by looking at them, from the content inside app windows to physical objects around them.
The Ability to Write and Edit Virtually Anywhere with Siri AI
Siri now offers integrated Writing Tools that are more powerful than ever, allowing users to write with Siri AI virtually anywhere they type. Users can describe what they need and Siri can generate a draft from scratch to get the ball rolling. If a user wants to refine what they’ve written, they can describe the change they want to make and Siri can quickly update it.
Integrated Writing Tools are more powerful than ever, allowing users to write with Siri AI virtually anywhere they type.
When writing in Mail and Messages, Siri can reflect how users usually communicate with each recipient, including the punctuation and tone they typically use. Users can ask Siri for tips and suggestions to improve their written work. Plus, Apple Intelligence now automatically proofreads for users as they type across the system, including within most third-party apps.
Apple Intelligence now automatically proofreads for users as they type across the system, including within most third-party apps.
Powerful AI Capabilities Integrated into Everyday Experiences
In addition to Siri AI, Apple Intelligence powers many more new capabilities in the apps users rely on every day:
• The Photos app taps into more powerful image models to provide new ways to edit photos, while still respecting the original moment as it was captured. With Spatial Reframing, users can improve the composition of a photo by adjusting the camera perspective after the photo was taken. Users can also expand their shots with the Extend tool to give their subjects more breathing room, and the popular Clean Up tool is more powerful than ever, allowing users to remove distractions from their photos with even better quality and more realistic infill.
• Powered by a new generative model that runs on Private Cloud Compute, Image Playground is more powerful and useful than ever, giving users the ability to create high-quality images in virtually any style — now including photorealistic — and simply describe any changes they want to make. This capability extends to the new Siri, allowing users to generate images just by describing them in the Siri AI app, powered by Image Playground. And with upcoming support for the SynthID standard, users can identify images generated or edited with AI using Apple Intelligence-powered tools.
• Safari adds new tools that transform how users can browse the web. Now, Safari can simplify the browsing experience by automatically organizing a user’s tabs into topics. It can also notify users of website changes, like product restocks or price drops, with Notify Me, and create custom extensions based on a user’s description.
• In Mail and Messages, Smart Reply can draw on a user’s personalized writing style, and Suggestions in Mail are even more capable with the ability to take actions with third-party apps.
• With Call Context in Phone, users can proactively receive relevant information, like a confirmation code or reservation number, when they’re calling a business.
• In Calendar, users can now add or modify events with simple descriptions.
• Shortcuts is more approachable than ever. With the ability to describe a shortcut, users can create complex automations simply by describing what they want.
• The Home app adds the ability to understand related notifications as a single activity, view what’s happening across a sequence of video clips with generated video descriptions, search for clips across multiple cameras, and access noteworthy ones at the top of the Search page.
Coming Later This Year: New Audio Intelligence and Health Capabilities
Since Apple Watch is always on a user’s wrist, it is the perfect device to help users stay alert to important sounds and stay present and engaged in conversations throughout the day. With the built-in microphone, the power of the S11 chip, the latest Apple
Intelligence models on iPhone, and Private Cloud Compute, Apple Watch Series 12 and Apple Watch Ultra 4 offer a brand-new class of Apple Intelligence features. Audio Intelligence helps users stay aware of the world around them, catch what they missed, and remember key moments — with user control, privacy, security, and accessibility at the center of its design.
Audio Intelligence features include:
• Sound Recognition, which comes to Apple Watch to alert users who are deaf or hard of hearing of important sounds, even when their iPhone isn’t with them. This feature listens for sounds like sirens, alarms, doorbells, or a baby crying, and uses on-device intelligence to notify users when they’re detected.
• Live Rewind, which can help users recall what was just said in conversation. A double press of the Digital Crown shows the previous 15 seconds of a conversation as a text snippet, so users can catch something they may have missed or are less familiar with. Users can ask Siri about the content of the text or save it to the Siri app to revisit later.
• Siri Recap, which can create high-level summaries of conversations that users can review later to jog their memory. When Siri Recap is turned on, after a conversation, Apple Intelligence automatically generates a title and key points in the new Siri app, allowing users to be more present and engaged in the moment.
• Shazam, which instantly detects the music playing around the user and automatically displays the song title and artist’s name on the Music Recognition widget in the Smart Stack, easily glanceable on the wrist.
Sound Recognition can alert Apple Watch users who are deaf or hard of hearing of important sounds, even when their iPhone isn’t with them.Live Rewind can help Apple Watch users recall what was just said in conversation.Siri Recap can create high-level summaries of conversations that users can review later to jog their memory.Shazam can now instantly detect the music playing around the user and automatically display the song title and artist’s name on the Music Recognition widget on Apple Watch.
Audio Intelligence features are private by design, combining hardware, software, and services to protect user privacy in a way that only Apple can. These features do not create or store audio recordings, and the raw audio used for processing is completely inaccessible to the operating systems, apps, the user, or Apple. This is because the S11 chip on Apple Watch Series 12 and Apple Watch Ultra 4 includes Secure Exclave, a dedicated hardware-isolated compartment that processes audio in complete isolation from the rest of the system, then immediately deletes it.
Users are in control and can choose whether to opt in to each Audio Intelligence feature. They can decide exactly where and when Siri Recap takes notes, and can turn Siri Recap on or off at any time, right from Control Center.
By design, Audio Intelligence features do not identify and attribute speakers, to protect the privacy of both the user and those around them. Siri Recap produces a brief, high-level summary of conversations — not a transcript — and is designed to exclude sensitive information like financial information or government-assigned identifiers. Live Rewind plays an audible chime when it is being used, even if Apple Watch is on silent, and shows a full-display animation and microphone indicator so people nearby can hear and see that the feature has been activated.
Live Rewind text snippets and Siri Recap summaries are end-to-end encrypted in the Siri app with iCloud syncing, and are not accessible even by Apple. Learn more about how Audio Intelligence protects privacy. Siri Recap and Live Rewind arrive in beta later this year.
In addition, the Health app gets a new design, turning a user’s metrics into personalized guidance with Apple Intelligence at its core. The new Insights tab has a summary generated by Apple Intelligence that highlights a user’s most timely information, surfacing details like the latest on their sleep or peak VO2 max. Users will also get personalized guidance from the Health app. For example, if they are working to improve their cardiovascular health, they may see suggestions to incorporate intervals in their regular morning run — recommendations that dynamically adapt to the user and their data.
The new health capabilities will be available later this year.
The redesigned Health app on iPhone features a new Longevity tab that analyzes a user’s longitudinal health data for deeper insights, including Health Age, an Apple Watch feature showing users how certain metrics are tracking relative to their age. Arriving later this year, the updated Health app will also feature a new Insights tab that surfaces timely health information with a summary that updates throughout the day across heart, sleep, readiness, fitness, vitals, and cycle tracking data.
A Bold Architecture, Built Privacy-First
These new capabilities are powered by the next generation of Apple Foundation Models, custom-built in collaboration with Google and its Gemini models for deeply integrated Apple Intelligence experiences. These latest models run on device and on servers using Private Cloud Compute. Every facet of new Apple Intelligence architecture is built privacy-first, from the latest Apple Foundation Models to the core operating system technologies that integrate these models deep into Apple’s platforms.
Apple Intelligence uses on-device processing and Private Cloud Compute to help protect users’ privacy. Private Cloud Compute gives users access to frontier-level intelligence while extending the privacy and security of iPhone into the cloud. When Private Cloud Compute is handling users’ requests, their personal data is not stored nor made accessible to Apple or anyone else. Outside experts can continue to verify this privacy promise at any time.
Siri has been rebuilt from the ground up with powerful AI, taking full advantage of the bold new architecture for Apple Intelligence. Additionally, Siri AI uses the system orchestrator to tap into core capabilities like the Spotlight index and App Toolbox, which work entirely on device to keep users in control of their data.
With powerful new features and unrivaled privacy protections, Siri remains the world’s most private digital assistant, backed by a bold architecture that allows Apple to deliver innovative new features with privacy and security at their core.
Pricing and Availability
• Apple Intelligence in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 is available on iPhone 16 models or later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPad models with M1 or later, MacBook Neo (A18 Pro), Mac models with M1 or later, Apple Vision Pro, Apple Watch Series 9 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when paired with an Apple Intelligence-enabled iPhone nearby.
• Apple Intelligence is available with Siri settings and device language set to Chinese (simplified), Chinese (traditional), Danish, Dutch, English, French, German, Italian, Japanese, Korean, Norwegian, Portuguese, Spanish, Swedish, Turkish, or Vietnamese. Some features may not be available in all regions or languages. Some devices may not be available in all regions.
• Siri AI is rolling out in beta in English in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27, and requires an Apple Intelligence-enabled device set to a supported language. Support for French, Japanese, Korean, Portuguese, and Spanish is coming next month.
• Siri AI will not be available initially in the EU on iOS, iPadOS, and watchOS. Features that rely on Siri AI will also not be available in the EU on iOS, iPadOS, and watchOS. Apple is working hard to find a path forward that preserves its users’ privacy and security.
• Siri AI and the other new Apple Intelligence features will not be available in China while Apple works through regulatory requirements.
• Certain Apple Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Siri AI, intelligent photo editing tools, Image Playground, and AFM 3 Cloud models in Shortcuts. Daily limits may vary by feature, request complexity, system demand, system policies, and other factors. Expanded access to such features will be available for a fee in the future. Use of these features is subject to Apple Intelligence terms and conditions. Learn more at apple.com/apple-intelligence.
MacDailyNews Note: Siri AI is not available for users under 13.
Apple’s most powerful on-device model and the features it enables, like expressive voices and more advanced dictation, are available on iPhone Duo, iPhone 18 Pro, iPhone 18 Pro Max, iPhone Air, iPhone 17 Pro, iPhone 17 Pro Max, iPad (M4) or later with at least 12GB of unified memory, and Mac (M3) or later with at least 12GB of unified memory. The model and expressive voices are also available on Apple Vision Pro (M5).
SynthID will be available in a software update later this year, and will be included for most edited images, depending on the edits applied.
Home app’s ability to understand related notifications as a single activity, view what’s happening across a sequence of video clips with generated video descriptions, search for clips across multiple cameras, and access noteworthy ones at the top of the Search page requires a home hub such as HomePod (2nd generation), HomePod mini, or Apple TV 4K with the latest operating system software. The owner of the home must have an Apple Intelligence-enabled iPhone, have Apple Intelligence enabled in the Home app, and subscribe to an eligible iCloud+ plan.
Audio Intelligence includes Live Rewind, Siri Recap, Sound Recognition, and faster Shazam, and requires Apple Watch Series 12 or Apple Watch Ultra 4. Live Rewind and Siri Recap will be available in beta in late 2026, and require an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). They will be available in English to start and will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354.
Sound Recognition requires Apple Watch Series 12 or Apple Watch Ultra 4.
Live Rewind will be available in beta in late 2026, and requires Apple Watch Series 12 or Apple Watch Ultra 4, paired with an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). It will be available in English to start and will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354.
Siri Recap will be available in beta in late 2026 and requires Apple Watch Series 12 or Apple Watch Ultra 4, paired with an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). Available in English to start. Siri Recap will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354.
Faster Shazam requires Apple Watch Series 12 or Apple Watch Ultra 4.
The redesigned Health app is available on Apple Intelligence-enabled iPhone and iPad models with the latest software, with select features available only on iPhone. Some features may not be available in all regions or languages. Health Age requires Apple Watch. The test to estimate VO2 max requires Apple Watch, AirPods Pro 3, or a third-party heart rate sensing device. Some features require users to be 18 or older. For information on Apple Intelligence availability, visit support.apple.com/en-us/121115.
Please help support MacDailyNews — and enjoy subscriber-only articles, comments, chat, and more — by subscribing to our Substack: macdailynews.substack.com. Thank you!
Apple software updates for 2026 are now reaching supported devices, bringing iOS 27, iPadOS 27, macOS 27, watchOS 27, visionOS 27, and tvOS 27 out of preview and into everyday use. The releases place Siri AI and the next generation of Apple Intelligence at the center, but many of the changes extend well beyond generative AI.
The updates began rolling out September 14. Alongside new intelligence features, Apple has made measurable performance changes to iPhone and iPad, overhauled several parental controls, refined the Liquid Glass interface introduced across its platforms, improved search, and added smaller changes to services including iCloud Shared Albums, Maps, AirPods, and Health.
Siri AI is initially rolling out as a beta in English. Apple says French, Japanese, Korean, Portuguese, and Spanish support is scheduled for October, making some of the headline functionality a staggered release rather than something every user receives immediately after installing the new operating systems.
Apple software updates make Siri AI a cross-device feature
Siri AI is built around personal context, onscreen awareness, expanded app actions, and access to current information from the web. The assistant can draw on material stored in areas such as Messages, Mail, and Photos when responding to requests, while Visual Intelligence allows users to ask about content currently displayed on their screen.
On iPhone, Siri mode is integrated directly into the Camera app. A user can point the camera at something and ask questions or perform supported actions based on what appears in front of them.
The assistant also gains a dedicated Siri app that synchronizes conversation history privately through iCloud. A conversation started on an iPhone can therefore be continued on an iPad, Mac, Apple Watch, or Apple Vision Pro.
Write with Siri expands the assistant into text creation and editing. Users can describe the material they need drafted or ask Siri to refine existing writing without moving to a separate application.
Apple Intelligence is also adding more specialized features outside Siri. Photos receives Spatial Reframing, Extend, and an updated Clean Up tool. Image Playground can generate images in a wider selection of styles, including photorealistic output, with metadata designed to identify AI-created material and planned support for the SynthID standard.
Safari can automatically organize tabs by topic and monitor webpages for changes, such as a product returning to stock or a price dropping. Apple is also introducing tools that can create custom extensions from a description.
Image Credit: Apple Inc.
iOS 27 and iPadOS 27 put more emphasis on speed
Some of the less visible changes could be among the most frequently experienced.
Apple says apps can launch up to 30% faster on iPhone and iPad after installing the new software. Photos can load an image up to 70% faster immediately after it is taken, while AirDrop transfers can be up to 80% faster.
iPadOS 27 receives additional work around file handling and multitasking. Apple says browsing files and transferring them to an external USB drive can be as much as five times faster, accompanied by smoother window closing, switching, and dragging.
Connectivity behavior has also been adjusted. Transitions between cellular connections and Wi-Fi are designed to happen more seamlessly, while Messages no longer needs to hold subsequent texts behind a large photo or video being uploaded over a slow connection.
Search across Spotlight, Photos, and Mail has been revised on iPhone, iPad, and Mac. Mail gains a new ranking system for Top Hits, while Apple describes search across the three platforms as more stable and comprehensive.
Liquid Glass has received another round of refinements after becoming the common visual language across Apple’s software. A new Settings slider allows users to adjust the interface from an ultraclear appearance toward a more heavily tinted version, and app icons have been sharpened.
Screen Time and child safety controls get a substantial redesign
Apple has also expanded the controls available to families rather than limiting this software cycle to interface and AI work.
The setup process for child accounts now allows parents to specify which apps a child can access from the beginning, with additional apps added later if appropriate. Ask to Browse extends approval controls to Safari, letting parents require permission before a child opens a new website.
Communication Safety has been expanded beyond sexually explicit material to detect and intervene when gore or violent content appears in shared images and videos.
Screen Time presents average device usage and frequently used apps more prominently. Parents can establish daily time allowances across categories such as Entertainment, Games, and Social Media, while Schedules can change which apps remain available at different points during a weekday or weekend.
These changes are particularly notable because they work at the account and platform level rather than requiring parents to configure separate controls inside every individual app.
Image Credit: Apple Inc.
watchOS 27, visionOS 27, and tvOS 27 add targeted upgrades
The smaller platforms receive their own additions rather than simply inheriting features from iPhone and Mac.
watchOS 27 introduces a dedicated Siri app, a dynamic app grid, expanded Smart Stack suggestions, and a new single-handed tap gesture for opening widgets. Workout Buddy can now operate without the paired iPhone nearby, while Cycle Tracking in Health adds support related to perimenopause and menopause.
visionOS 27 brings Siri AI and Visual Intelligence into Apple Vision Pro, where the assistant can respond to objects a user is physically looking at. Panoramas can be converted into spatial scenes and used as personal Environments, while Mac users can bring compatible 3D models into their physical space to preview and edit them.
Apple says Vision Pro can now start up and connect to Wi-Fi up to three times faster. New curved windows, Control Center changes, eye-controlled notification expansion, and improvements to Dwell Control further adjust the spatial interface.
tvOS 27 takes a narrower approach. Apple Music gains high-resolution lossless audio support, Apple Podcasts has been redesigned, and additional text-size accessibility options have been introduced. Apple TV 4K owners can install the release on supported second- and third-generation models.
Other changes stretch across device categories. iCloud Shared Albums can now retain full-resolution photos and videos while making participation easier from Android and Windows devices. AirPods gain custom EQ settings, Maps expands Flyover with AI-assisted aerial detail, and Missed-message notifications and unread counts now synchronize more quickly and reliably across Apple devices.
With the September 14 releases now public, the software cycle shifts from preview demonstrations to staggered feature delivery. Siri AI language expansion begins in October, while some Apple Intelligence capabilities and individual app features will continue arriving through later updates rather than being tied exclusively to the initial 27.0 releases.
Available today, Apple’s latest software updates introduce Siri AI and deliver helpful new Apple Intelligence features that make the apps users interact with every day smarter and more useful.
Apple’s latest software updates introduce Siri AI, a more intelligent, knowledgeable, and capable version of Siri, and deliver helpful new Apple Intelligence features that make the apps users interact with day to day smarter and more useful. The updates also bring powerful and intuitive new features to help parents create safer, more enriching digital experiences for kids and introduce an expansive set of improvements that make Apple products more responsive, more delightful, and easier to use.
Making Apple Products More Personal and Useful Than Ever
Siri AI is an entirely new version of Siri powered by the next generation of Apple Intelligence and deeply integrated into iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. A more capable and conversational assistant with personal context understanding, broad world knowledge, onscreen awareness, and even more systemwide app actions, Siri AI is now rolling out as a beta in English, with support for French, Japanese, Korean, Portuguese, and Spanish coming in October.
Siri AI can understand personal context across messages, emails, photos, and more, to help users find what they need in the moment. It can also answer questions related to the content on a user’s screen or go out to the web to get up-to-date information to generate a helpful answer. Siri is integrated into the Camera app on iPhone with Siri mode, allowing users to get information and take action on what’s in front of them, like splitting a bill and paying friends with Apple Cash, or adding a custom pass to Wallet. With Visual Intelligence, users on iPhone, iPad, or Mac can now ask Siri about what they’re looking at on the screen, and Vision Pro users can search, ask questions, and take action simply by looking at their surroundings and asking Siri.
With Write with Siri, users can simply describe what they need to generate a draft or help refine what they’ve written. A dedicated Siri app uses iCloud to privately sync conversational history across a user’s products, so they can start chatting with Siri on iPhone and continue the conversation on Mac, iPad, Apple Watch, or Apple Vision Pro.
The next generation of Apple Intelligence also brings helpful new features to apps that users rely on every day. In Photos, Spatial Reframing, Extend, and an upgraded Clean Up tool provide more ways to edit photos while respecting the original moment as it was captured. Image Playground gives users the ability to create high-quality images in virtually any style, including photorealistic, and with image metadata and upcoming support for the SynthID standard, users can identify images generated or edited with AI. In Safari, Apple Intelligence powers new tools that automatically organize a user’s tabs into topics; notify them of website changes, like product restocks or price drops; and enable the creation of custom extensions based on a description. Call Context surfaces relevant information, like a confirmation code or reservation number, when calling a business.
New Expert-Informed Child Safety Features and a Redesigned Screen Time Experience
Easy-to-use new features help parents manage what their kids can see, who they can talk to, and when they have access to apps. A new setup flow for child accounts makes it easier to enable age-based safeguards across the system. From the beginning, parents can choose the exact apps their kids have access to on their device, and gradually add more over time. Ask to Browse allows parents to require approval before their kids access a new website in Safari. In addition to being able to approve each new contact their kids connect with, parents can lean on Communication Safety, which now also detects and intervenes to block gore or violent content when detected in shared images or videos.
Redesigned to be more intuitive for parents, Screen Time offers an at-a-glance view of their kids’ average device usage and top apps. New tools make it easy to set daily total time allowances across Entertainment, Games, and Social Media apps, with guidance from leading clinical and child development experts, and Schedules let parents manage which apps their children have access to at different points in the day.
For parents and families looking for more information on how to help create safer, more enriching digital experiences for their kids, Apple has a dedicated website, which includes details on the latest tools and how to get started using them.
A More Refined Experience Across Platforms
The 2027 software releases deliver platform improvements that span performance, connectivity, search, and more, making Apple products even more responsive, reliable, and delightful to use.
• Performance: Users will experience faster performance on iPhone, iPad, and Mac. On iPhone and iPad, apps launch up to 30 percent faster, photos load up to 70 percent faster after being taken, and AirDrop transfers are up to 80 percent faster. On iPad, browsing files and transferring them to an external USB drive is now up to 5x faster, and there are additional improvements to closing, switching, and dragging windows while multitasking. On Mac, things users do every day feel extra snappy and responsive. AirDrop transfers are quicker, iCloud Photos uploads begin faster, swiping between spaces and Mission Control is smoother, and more. On Apple Watch, music playback is even faster.
• Connectivity: On iPhone and iPad, transitions between cellular and Wi-Fi networks are more seamless than ever. In Messages, sending large photos and videos in low-bandwidth situations no longer prevents subsequent texts from going through, so users can continue replying while media is being delivered. On Mac, users will experience faster network file browsing. Apple Vision Pro starts and connects to Wi-Fi up to 3x faster.
• Search: On iPhone, iPad, and Mac, search across Spotlight, Photos, and Mail is more stable, efficient, and comprehensive, so it can better help users find exactly what they are looking for. Additionally, a completely new ranking system in Mail surfaces even more relevant results in Top Hits.
• Design: Refinements to the software design with Liquid Glass deliver an even more focused and approachable experience. For example, a new slider in Settings gives users the option to personalize Liquid Glass, adjusting it anywhere from ultraclear to fully tinted to match their preference, and app icons have been updated to be sharper and more defined.
Additional features across platforms:
• iCloud Shared Albums support full-resolution sharing for photos and videos, and make it easier for Android and Windows users to join and contribute.
• The Health app brings support for perimenopause and menopause in Cycle Tracking, including notifications about cycle deviations inclusive of perimenopause.
• AirPods users can now enjoy custom EQ to further personalize how their AirPods sound. And with expanded Apple GymKit functionality, users with AirPods Pro 3 can sync their heart rate data through iPhone while enjoying incredible audio quality.
• Apple Maps brings an enhanced Flyover experience, which combines aerial imagery with AI, allowing users to enjoy even more detailed visuals.
• On Apple Watch, new Smart Stack widget suggestions surface when they are relevant, and users can conveniently open a widget with a new single-handed tap gesture. Workout Buddy is supported even when users don’t have their iPhone nearby, and it’s now available in Spanish in addition to English.
• Apple Vision Pro users can now turn panoramas into spatial scenes with rich depth and use them as a personal Environment, or transform their space entirely with the new Thórsmörk Environment featuring a dynamic Icelandic aurora.
• On Apple TV, users get high-resolution lossless audio support for Apple Music, a redesigned Apple Podcasts app, and broader text-size accessibility options.
The new features start rolling out today across iOS 27, iPadOS 27, macOS 27, watchOS 27, visionOS 27, and tvOS 27.
Availability
Features are subject to change. Some features may not be available in all languages or regions, and availability may vary due to local laws and regulations. For more information about availability, visit apple.com.
New Apple Intelligence capabilities across apps are available for users with supported products set to a supported language. Siri AI begins rolling out as a beta in English, with French, Japanese, Korean, Portuguese, and Spanish coming in October.
Mac and Apple Vision Pro users in the EU will be able to access Siri AI when set to a supported language. Siri AI will not be available initially in the EU in iOS, iPadOS, and watchOS.
Siri AI and the other new Apple Intelligence features will not be available in China while Apple works through regulatory requirements.
Users who enable Apple Intelligence on supported products set to a supported language will have access with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
Apple Intelligence is available with support for these languages: English, Danish, Dutch, French, German, Italian, Norwegian, Portuguese, Spanish, Swedish, Turkish, Vietnamese, Chinese (simplified), Chinese (traditional), Japanese, and Korean. Some features may not be available in all regions or languages. For feature and language availability and system requirements, see apple.com/apple-intelligence.
Apple Intelligence and Siri AI in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 are available on iPhone Duo, iPhone Air, iPhone 16 models or later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPad models with M1 or later, MacBook Neo (A18 Pro), Mac with M1 or later, Apple Vision Pro, Apple Watch Series 9 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when paired with an Apple Intelligence-enabled iPhone. Some features on Apple Watch require iPhone nearby.
Certain Apple Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Siri AI, intelligent photo editing tools, Image Playground, and AFM 3 Cloud models in Shortcuts. Daily limits may vary by feature, request complexity, system demand, system policies, and other factors. Expanded access to such features will be available for a fee in the future. Use of these features is subject to Apple Intelligence terms and conditions. Learn more at apple.com/apple-intelligence. Siri AI is not available for users under 13.
MacDailyNews Take: Hello, Siri AI! Happy updating!
Please help support MacDailyNews — and enjoy subscriber-only articles, comments, chat, and more — by subscribing to our Substack: macdailynews.substack.com. Thank you!
As previously announced, Apple has today released 2026's major annual updates for its operating systems, including iOS 27, macOS 27 Golden Gate, watchOS 27, visionOS 27, and tvOS 27.
Siri AI—a large language model-based and context-aware overhaul of the company's Siri voice and text assistant—is the flagship feature across all these releases except one (tvOS).
A espera está chegando ao fim! Já estão disponíveis as versões Releases Candidate do iOS 27 (compilação 24A435), iPadOS 27 (idem), macOS Golden Gate 27 (26A5428), watchOS 27 (24R363), tvOS 27 (24J360) e visionOS 27 (24M362).
Além deles, também estão disponíveis as quartas RCs do iOS 26.7 (compilação 23H24), do iPadOS 26.7 (idem), do macOS Tahoe 26.7 (25G229) e do macOS Sequoia 15.8 (24H23), bem como o Xcode 27 RC (27A266a) para desenvolvedores.
Como sempre, essas são as versões candidatas a serem lançadas para o público final, mas pode ser que mais versões sejam disponibilizadas até lá — caso a Apple encontre algum problema de última hora que precise ser resolvido.
Em beta desde junho, os sistemas 27 reúnem uma série de novos recursos para a Apple Intelligence, além da nova Siri AI — vale lembrar, essas funcionalidades podem não ser compatíveis com todos os dispositivos em que os sistemas 27 estão disponíveis.
Em matéria de iPhone, um diferencial relevante para as gerações mais antigas é a implementação de um novo scheduler de CPU 1Central processing unit, ou unidade central de processamento. para gerenciar melhor as demandas de cargas de trabalho em iPhones a partir do 11, algo já visto anteriormente nos modelos mais recentes — além, claro, de melhorias mais amplas, como na velocidade de envio de arquivos no AirDrop.
No caso do macOS, o maior destaque — além da otimização de desempenho — é o fim do suporte aos Macs com processadores Intel.
NOTA DE TRANSPARÊNCIA: O MacMagazine recebe uma pequena comissão sobre vendas concluídas por meio de links deste post, mas você, como consumidor, não paga nada mais pelos produtos/serviços usando os nossos links de afiliado.
Notas de rodapé
1
Central processing unit, ou unidade central de processamento.
Apple on Monday released the eighth developer betas of macOS 27, iOS 27, iPadOS 27, tvOS 27, and watchOS 27, continuing the final stretch of testing before the software is expected to ship to the public in September.
The new builds arrive one week after the seventh developer betas, which went out on August 24. At this point in the cycle, Apple is typically focused on bug fixes, performance, and stability rather than large new user-facing features. Release candidates are widely expected after Apple’s September hardware event.
Apple also issued matching eighth betas for tvOS 27 and visionOS 27.
macOS 27 continues under the Golden Gate name. It is the first macOS release limited to Apple silicon Macs.
How to install
Registered developers can install the updates over the air:
• iPhone and iPad: Settings → General → Software Update → Beta Updates, then choose the iOS 27 or iPadOS 27 Developer Beta.
• Mac: System Settings → General → Software Update.
• Apple Watch: Use the Watch app on a paired iPhone. The watch should be on the charger, on Wi-Fi, and at least 50 percent charged.
Full restore images are also available from the Apple Developer site. Public beta testers usually receive corresponding public builds shortly after the developer drop.
What these releases are building toward
The “27” operating systems were first shown at WWDC 2026 on June 8, with developer beta 1 following the same day. Public betas began in mid-July. The official fall releases are expected alongside new iPhones and other hardware.
Headline features across the platforms include:
Siri AI. Apple’s rebuilt assistant is the centerpiece. It is designed as a more conversational chatbot with general world knowledge, personal context from apps such as Messages and Mail, and on-screen awareness. iOS 27 also adds a standalone Siri app for conversation history, systemwide Write with Siri, and Visual Intelligence relocated into the Camera app with a Siri mode. On Apple Watch, Siri AI requires a paired iPhone that supports Apple Intelligence (iPhone 15 Pro and later).
Apple Intelligence elsewhere. New AI features land in Photos, Safari, Shortcuts, Wallet, and Passwords. On the Mac, Spotlight and Shortcuts pick up deeper Siri AI integration, including natural-language shortcut creation.
Liquid Glass refinements. After last year’s more aggressive glass look, Apple has improved legibility and added a transparency slider so users can dial the effect from glassy to more opaque. macOS 27 also revisits window chrome, including traffic-light controls and more consistent corner radii.
Performance. Apple has emphasized faster app launches, quicker keyboard appearance, snappier AirDrop, better Wi-Fi/cellular handoff, and improvements that are noticeable even on older supported iPhones. watchOS 27 includes battery optimizations, an updated Find My experience with Precision Finding, Workout Buddy improvements that work without a nearby iPhone, and a Dynamic app grid with Siri suggestions.
Some capabilities remain limited by region or regulation. Earlier in the cycle, Siri AI features were reported as blocked for EU developers under Digital Markets Act rules, and certain Apple Intelligence features have been unavailable in China while Apple works through local requirements.
What to expect next
Ninth-week betas this late in the summer are often the last regular developer drops before release candidates. Those RCs frequently appear after Apple’s September event, when the company also tends to reveal any remaining watch faces, health features, or hardware-tied software that was held back from earlier betas.
The finished versions of iOS 27, iPadOS 27, macOS 27 Golden Gate, watchOS 27, tvOS 27, and visionOS 27 are still expected for the public this fall.
MacDailyNews Note: As always, beta software can be unstable. A backup is strongly recommended before installing.
Please help support MacDailyNews — and enjoy subscriber-only articles, comments, chat, and more — by subscribing to our Substack: macdailynews.substack.com. Thank you!
Algumas semanas após a liberação das quartas versões de testes, a Apple enfim disponibilizou hoje as quintas betas do iOS 27 (compilação 24A5408d), iPadOS 27 (idem), macOS Golden Gate 27 (26A5406e), watchOS 27 (24R5347a), tvOS 27 (24J5346a) e visionOS 27 (24M5348b) para desenvolvedores.
Também já está disponível para desenvolvedores a quinta versão beta do Xcode 27 (compilação 27A5237l).
Os novos sistemas, anunciados na WWDC26, trarão novidades e diversas melhorias para iPhones, iPads, Macs, Apple Watches, Apple TVs e Vision Pros — conforme temos acompanhado e detalhado no apanhado de matérias abaixo.
Como de costume, nós estamos acompanhando as possíveis novidades incluídas com as novas betas e detalharemos tudo sobre elas por aqui. Continuem de olho!
Apple has finally completed its silicon transition: macOS 27 drops all Intel-based Macs, and iPadOS 27 and watchOS 27 each leave five models by the wayside, whereas the iPhone compatibility list remains unchanged.
Siri AI is an entirely new version of Siri deeply integrated into iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. It can draw on personal context understanding to search across messages, emails, photos, and more, and get things done across apps with even more systemwide app actions. Additionally, Siri AI can answer questions related to the content on a user’s screen or go out to the web to get up-to-date information using broad world knowledge and generate a helpful answer. A dedicated Siri app allows users to revisit a past conversation or kick off a new one — all in one place — and uses iCloud to privately sync conversational history across a user’s products.
Powered by the next generation of Apple Intelligence, Siri AI is a completely reimagined version of Siri that is more helpful, more capable, and more intelligent. With detailed, engaging responses and natural back-and-forth conversation, Siri AI helps users get more done than ever.
[…]
Siri has been rebuilt from the ground up with powerful AI at its core. It takes full advantage of the bold new architecture for Apple Intelligence, including the next generation of Apple Foundation Models that run on device and on servers using Private Cloud Compute. When Private Cloud Compute is handling users’ requests, their personal data is not stored nor made accessible to Apple or anyone else. Outside experts can continue to verify this privacy promise at any time. Additionally, Siri AI uses the system orchestrator to tap into core capabilities like the Spotlight index and App Toolbox, which work entirely on device to keep users in control of their data.
[…]
For products that support Apple’s most advanced on-device model ever, Siri AI offers even more expressive voices, as well as a major boost in accuracy with systemwide dictation. Users have the ability to customize the expressiveness and pace of Siri’s voice so it’s just right for them. Dictation now captures what users say as polished text with greater precision, automatically handling capitalization, punctuation, and formatting as they speak. With improved speech understanding, users can speak naturally and trust that their words will appear clearly, accurately, and as intended.
I remain uninterested in these more advanced Siri features. They matter in that Apple needs to show that they’re not “behind” and that they can actually deliver on what they announce and advertise. But I don’t find the use cases compelling and wouldn’t trust the results.
If you really care about a particular concert, would you believe Siri about how the tickets work and that it will auto-create a reminder at the right time? Why should I believe that it can figure out whether a particular irregularly shaped object can fit inside an irregularly shaped container when said shapes are probably not even published on the Web? Can it really dig into my e-mail to find the right flight info? An answer without being able to see the sources is not useful. And I certainly don’t want it to pick for itself which vacation photos to send out.
I just want the basic features—from a decade or so ago, like music controls, reminders, and access to my purchases—to work quickly, reliably, and offline to the extent possible. I did not hear anything to suggest that this was a focus. Instead, everyone is celebrating how slow the demos were because that proves they weren’t fake.
The other interesting thing to note from the keynote: watching the demos, there is ZERO doubt these are real, recorded demonstrations on live devices. There will be no confusion about what is real or fake like there was at WWDC 2024 and the initial attempt at the new Siri.
And, if your standards are the state of the art in AI circa June 2024, when Apple took their first crack at answering the question, they did quite well.
[…]
What’s fascinating about this specific demo is that it also showed just how far behind Apple is.
[…]
Still, the bubble was strong enough to convince OpenAI to make the exact same mistake Dropbox did: the company somehow convinced itself that it could make enough money selling subscriptions to consumers; Anthropic, meanwhile, realized that it was enterprises who were willing to pay for AI’s massive productivity benefits, even as OpenAI failed to capitalize on their consumer market penetration by refusing to build an advertising product.
This is a long-winded way of saying that I don’t think that Apple’s agentic shortcomings are a big deal, at least for now. Agents help you do work and be more productive, and consumers don’t want to work or care about being productive. What they do want to do is watch short-form video, and an iPhone is simply much better at that than any other device ever will be; in that context, Siri being good enough is enough, and it appears that Apple crossed that bar.
They need to execute, they need to prove this can scale, and most of all, they need to get third-party apps on board with App Intents and App Schemas. But it seems like they’re doing all of that. This is not a done deal but it is very realistic.
Siri doesn’t have access to the filesystem or tool-calling, so it’s completely unable to do the kinds of tasks you might easily do with Codex or Claude. It’s a good start, but the state of the art has already dramatically shifted over the past year. The question is will Siri move in this direction, or stick to providing answers from the web?
Will Apple introduce its own distinct Codex-style agentic programming model that can do all this, and work with Xcode? You would hope so…
The revamped version of Siri that is officially named “Siri AI” will be available to test in the iOS 27, iPadOS 27, macOS 27, and visionOS 27 developer betas starting today, and it is coming to the Apple Watch in a future watchOS 27 beta. “Siri AI” will also be included in the public betas of each platform that are launching in July.
“Siri AI” requires a device that is compatible with Apple Intelligence.
Apple senior vice president of software engineering Craig Federighi has explained why the company launched a standalone Siri app in iOS 27, after previously characterizing a dedicated chatbot as contrary to its Apple Intelligence strategy.
[…]
“We see Siri not as a separate chatbot, just an unintegrated place you go and chit-chat, but rather as an integral, conversational tool that you use in the moment, deeply integrated into your experience.”
…And playlists, contacts, settings and preferences. Peel off the agentic slop bandwagon and focus on core performance, smarter caching, and resilience under adverse network conditions.
Though this is a test conducted on the very first version of Siri A.I. from a fixed point in Calgary, it seems to work quite well. So far, it is better than any version of Siri Apple has released yet and, as you can see above, it is almost as good as the original 2010 demo, before Apple acquired the company.
On the one hand, if Siri has indeed become this reliable at understanding queries like those demoed so far, it’s indeed impressive. On the other hand, I can’t help but ask myself, once again, whether people at Apple even know how regular people actually use their phones and devices.
Apple executives downplay and obfuscate the role of Google in Siri AI. The Siri AI announcement didn’t even mention Google or Gemini once! Does anyone actually believe Apple’s BS? The argument seems to be that since Google made a bespoke implementation for Apple, Google is not really involved, and it’s all Apple. Ridiculous.
It’s really odd to me that Apple is getting so much credit for Google’s work. Siri now “works” to the extent it does because Siri is to a very large extent Gemini, and Apple has wrapped that in a bow.
Apple didn’t “nail” anything. Apple failed at its own internal efforts and was forced to outsource.
This is the advantage of being a platform: you can fail and still win.
Apple’s Siri team, led by Craig Federighi, held a post-WWDC keynote tech talk with members of the press this afternoon to talk through iOS 27 and the new Siri AI.
During the talk, Federighi shared more details about Apple’s collaboration with Google.
Apple looks like it will use some combination of Google Gemini models, combined with Google’s Confidential Inference and Apple’s own Private Cloud Compute for private hosting. These systems will process both your queries and evaluate private data from your devices.
[…]
Apple has since “expanded” PCC to encompass Google’s hardware as well. I will confess that I find the details of the new “expanded” PCC just a bit vague. It sounds a lot like Apple is primarily going to rely on Google’s existing confidential compute (running in Google datacenters) to process this data, but they’re bolting on a new layer of technical security to control which models are actually running. In any case: security experts can argue about whether this is good enough to keep Cozy Bear away from your data. What I will grant is that it’s probably good enough to keep Google and Apple from accessing your stuff, which is what most people are worried about in the first place.
So why am I so nervous?
[…]
So far we’ve discussed two adversaries: the misaligned designers of private agents (such as search operators), and the possibility of remote prompt injection attacks. But of course, in any discussion of technical privacy systems we need to talk about the last elephant in the room: your government.
Desenvolvedores já podem instalar as quartas versões de teste do iOS 27 (compilação 24A5390f), iPadOS 27 (idem), macOS Golden Gate 27 (26A5388g), watchOS 27 (24R5325h), tvOS 27 (24J5325d) e visionOS 27 (24M5326g).
Além dos sistemas, também está disponível para desenvolvedores a quarta beta do Xcode 27 (compilação 27A5228h).
Os novos sistemas, anunciados na WWDC26, trarão novidades e diversas melhorias para iPhones, iPads, Macs, Apple Watches, Apple TVs e Vision Pros — conforme temos acompanhado e detalhado no apanhado de matérias abaixo.
Como de costume, nós estamos de olho para conferir as novidades incluídas com as novas betas e detalharemos tudo sobre elas por aqui, então continuem acompanhando!
Summer beta season is in full swing, with a new wave of testers coming aboard via the just-released public OS 27 betas. While visionOS hasn’t ever been included in the public beta program, now is as good a time as any to check in on visionOS 27. What’s it like living with the features Apple highlighted at WWDC, and if you’re jumping on the public betas with your other devices, is it a good time to give the visionOS 27 developer beta a try, too? Let’s dig in and find out.
Siri AI
Given the massive overhaul Siri is receiving this year and the fact that the Vision Pro has always been a little behind when it comes to Apple Intelligence features, I didn’t expect visionOS to get the full Siri AI treatment this year. Thankfully, I was wrong. Not only is Siri AI fully present in visionOS 27, but the experience of interacting with the assistant has even been adapted to fit a spatial context.
For starters, Siri is much more capable in visionOS 27 than ever before. It’s not just for opening apps anymore. With access to your personal context, Siri can handle tasks I would have never imagined prompting it for until now. Questions like, “When was the last time I ate at this restaurant?” or, “How many years in a row have I attended this local event?” used to lead me down time-intensive rabbit holes of scavenging emails, texts, calendar events, photos, and more. Now, Siri can pull all of that information for me and answer the question in just a few seconds.
That “in a few seconds” bit is important. At least this point in the beta cycle, every request I give the assistant takes some time. Even tasks like checking my calendar and opening apps have a bit of lag to them on my M2 Vision Pro. This seems to be a side effect of Siri’s new architecture: it can do more, but parsing input, coordinating resources, and performing tasks takes a little longer than you might expect.
Of course, Siri has access to world knowledge now, too. We’ve all run into the classic, “Here are some web results for you,” response when asking Siri a question it considers too complex to answer itself, but those canned responses are no more. Now, Siri can dive into its (scraped) trove of knowledge to answer questions about pretty much any topic: history, science, pop culture, and more. Siri is the all-knowing bot we’ve always wanted it to be; just be sure to double-check its answers because, as Siri will remind you, AI can get things wrong.
Interacting with Siri in visionOS 27 is a whole new experience. The purple, blue, and green sphere evocative of Siri’s previous era (before all of Apple’s other platforms switched to the rainbow outline UI that never came to visionOS) has been replaced with a semi-translucent glowing white orb matching the Siri aesthetic on iOS, iPadOS, and macOS. The circular “thinking” animation mimics what you see when you interact with Siri on other devices, too, making for a much more cohesive cross-device experience.
When you invoke Siri via voice, the orb appears with a window above it displaying the text of your conversation. You can grab the window and place it anywhere in your environment. To continue the conversation, you simply look at the Siri UI and start speaking again. It all feels very natural, and I appreciate the way you can converse with Siri while interacting with other windows in objects in visionOS, a task that doesn’t translate as well to Apple’s other platforms. For those on the M5 Vision Pro, Siri has a new, more natural voice with customizable speed and expressivity as well, though my M2 model isn’t capable of running the local model necessary to power these changes and the improved dictation system.
visionOS 27 also includes a gesture for activating Siri that’s a little nostalgic. If you hold your palm open and upward then look at it, you’re present with a Home button as before. But if you pinch and hold the Home button, a tiny Siri UI will appear above it, just like in the old days when iPhones had physical Home buttons. You have to hold your fingers together the whole time you’re speaking to Siri, which seems a bit strange to me, but once you’ve made your initial request, the standard Siri UI appears, and you can carry on as usual.
The new version of Siri also brings Visual Intelligence to the Vision Pro for the first time. You can ask Siri about the content of a virtual window or objects in your real-world environment. When Visual Intelligence is activated, the system displays a very cool animation of your environment being scanned, and then, Siri can use what it sees to answer your questions. I’ve used this to ask Siri about webpages, documents I’m working on, and items I see around me, and it’s very cool to have an always-available digital assistant who can see what I see. It did a great job identifying my water bottle and then pulling up the receipt from my email to let me know how old it was, which I found to be a great combination of Visual Intelligence with my personal context.
There’s also a new Siri app that contains a history of all your conversations with the assistant, including those synced from other devices. On visionOS, the Siri app is a horizontally-scrolling list of glassy cards that reminds me a lot of the Spatial Gallery app. It’s a handy way to pick back up on conversations started elsewhere, search for a previous answer, or simply interact with Siri via keyboard rather than voice.
At WWDC, Apple showed off a Siri mode where the orb persists in your environment, waiting for you to look at it and start a conversation. I have not been able to get that method to work yet. Once I start a conversation with Siri, I can keep the conversation window open and place it anywhere, but that’s not the same as having a small Siri UI sitting on my desk out of the way until I need it. I’ll keep my eyes peeled for it in future beta releases.
Siri AI is marked for release “later this year” (as opposed to the OS 27 updates listed as coming “this fall”), so there are still some rough edges to work out. Sometimes, conversations simply stop, with Siri telling me an error occurred. The Siri conversation UI will sporadically disappear, and I have to force quit the Siri app to get it to show up again. And Visual Intelligence sometimes struggles to understand what I’m trying to get it to look at, focusing on the wrong window or even the keyboard. But that’s beta life for you; it’s what I signed up for, and I’m trusting it will all be worked out before the public release.
Beta UI bugs aside, Siri AI is a huge upgrade for Apple’s digital assistant, and I’m happy to see visionOS getting the first-class treatment here. It isn’t simply ported over from iOS. It’s been carefully adapted for a spatial UI, and it makes for a powerful overall experience.
There is one other major way Siri differs on visionOS from other platforms: it hasn’t been integrated with Spotlight Search. For now, at least, the search feature on visionOS is dedicated to finding apps, app content, and web results, without even an ‘Ask Siri’ button in sight. With so many other ways to interact with Siri on the platform, it might make sense to keep it separate from search, but it’s certainly an oddity given the way the two features have been merged on every other platform. I’m still trying to figure out if I find this a helpful separation or a missed opportunity for cross-device cohesion.
Panoramas and Environments
There’s a lot more to visionOS 27 than just AI. Big changes are coming to panoramas, including the ability to act as persistent Environments. And, of course, Apple has to throw in a new Environment of its own, too.
Over the past couple of years, Apple has continually pushed the capabilities of its spatial photo conversion technology. Last year, that came in the form of spatial scenes across all of the company’s platforms, and this year, it’s coming to panoramas. In visionOS 27, you can convert panoramas into spatial scenes, adding layers of depth and perspective to the already stunning experience of viewing panoramas on the Vision Pro.
Being immersed in panoramic photos in visionOS was already breathtaking. This takes it to a whole new level. Experiencing memories in deeper ways than I ever thought possible is one of my favorite uses for the Vision Pro, and now, I can use it to revisit places I’ve been and feel like I’m standing there once again.
The system takes this experience one step further by allowing you to set panoramic spatial scenes as custom Environments. In the Environments view, there’s a new folder called My Environments where you can add up to 34 panoramas from your photo library and use them as immersive backgrounds for your content. You can even adjust the immersion level to make the photo wrap around you.
I love that we now have the option to use our own photos as Environments, but it does come with some tradeoffs. Panoramic photos are static, so they don’t have the subtle motion elements that make Environments feel alive. They also don’t expand as far vertically as Environments do, which means you’re likely to see your real-world surroundings if you look up or down. Still, this is the first time visionOS users have been able to set their own custom Environments using their own photos or images purchased online, so it’s a win. It’s definitely inspired me to start taking more panoramas than I did before.
The new built-in Thórsmörk Environment is gorgeous. Apple always knows how to pick the perfect spot. Between the snow, the slow-moving river, and the aurora borealis in the sky at night, it offers a beautiful, peaceful place to relax, watch a movie, or trick your mind into cooling off on a hot summer’s day.
Safari
Spatial browsing is continuing to mature in visionOS 27, this time with the help of curved windows. Safari is one of the few built-in apps – Freeform and TV being the others – that are receiving special curved window modes this year, similar to what we’ve seen in the past with Mac Virtual Display. When a window is expanded beyond a comfortable width for side-to-side viewing, it automatically starts to curve, wrapping around the user’s head to make it easier to take in the window’s contents.
To be honest, I’m not sure how useful curved windows will be for browsing normal websites. While some, such as Apple’s OS Overview page are optimized to display content like image galleries at such wide aspect ratios, most sites don’t expand beyond a certain point, displaying blank space on either side of a centered column of content. Perhaps that will change with time, but for now, I don’t foresee these ultra-wide windows catching on for single-tab browsing.
Where the curved Safari window does shine, though, is in the browser’s new multi-tab view. A new button on the right side of the tab bar activates the view, which displays all open tabs side by side in a horizontally-scrolling curved window. These aren’t previews, either. Each tab can be scrolled, navigated, interacted with, and even closed as it if it were an independent browser window.
I’ve already found numerous use cases for this view in my own workflows: editing article previews, comparing product pages, and reviewing multiple research sources at once, just to name a few. Displaying multiple tabs at once in a large, ergonomic window view makes for a fantastic interaction method that I think could apply far beyond Safari webpages and sports multiviews in TV. I imagine this feature will be used far more than last year’s spatial browsing.
Apple Intelligence can sort your bookmarks and Reading List entries based on topic if you like, though the automatic tab sorting feature present on other platforms is curiously missing. Personally, I like managing my own tabs anyway, but add that feature to the long list of strange feature parity omissions on visionOS along with Focus filters, photo editing, and – as of the current beta – Describe a Shortcut.
Platform Improvements
There’s no doubt that this is a refinement year for Apple’s platforms beyond AI. The company is taking the opportunity to revisit and optimize OS features that have long been considered mature, and that’s the case even for visionOS, a relative newcomer.
The time it takes the Vision Pro to connect to Wi-Fi upon power-up has been reduced significantly. Given the device’s short battery life and tendency to go into deep sleep when not in use, this is a quality-of-life change that you’re going to feel. When I turn my M2 Vision Pro on, I can’t log in quickly enough to open Safari or the TV before it’s connected to the Internet. That definitely was not the case before visionOS 27, and I appreciate it.
I’ve long been on the record as a critic of the notification system on visionOS, but it’s taking a big leap forward this year with expanding notifications. When an app icon appears at the top of your view to alert you to a notification, you expand it with your gaze and actually see what you’re being notified about. You can even long-press a Messages notification to reply directly without the need to open the full app, which is so convenient. And with any app, just seeing notifications in full without losing the context of what I’m doing is a major improvement.
Unlike notifications, I was a fan of the redesigned Control Center in visionOS 26. Alas, Control Center has been redesigned again, now featuring a three-column layout instead of a single window. I’m still getting used to the new look, but it does make sense conceptually to split different types of controls into separate columns, so I’m hoping this will make the feature more intuitive once I’ve adapted to it. Regardless of any other efficiency wins, though, this redesign gets my approval simply because it finally brings the AirPlay menu to the top level of Control Center, saving me an extra tap every time I want to switch sound output to my AirPods.
Sharing screenshots and videos from visionOS is going to be much easier thanks to high-quality screen recordings, which can be enabled in the Settings app. Now, the Vision Pro can take unfoveated videos of its screen for up to three minutes, as well as full-quality screenshots. In the past, on-device screen recordings were fuzzy outside of the viewer’s focus, resulting in a poor representation of the visionOS experience and requiring a Developer Strap and Xcode on a Mac as a workaround. This change alone is going to make my review process much simpler, and it’ll make it easier for all Vision Pro users to show others what using the device is like.
visionOS 27 now supports extra-small widgets, which are basically Lock Screen widgets brought to life in the user’s space. Like any other spatial widget, they can be placed on a wall or a horizontal surface such as a desk, and they are entirely customizable. Apple is introducing its own extra-small Mac Virtual Display widget for starting up a virtual connection with a Mac even if it’s asleep. Extra-small widgets take up much less space on a desk than even small ones, and there are already a bunch of them available from iPad apps running on the Vision Pro, so I think they’re going to be very useful.
Finally, there are some other Mac Virtual Display improvements included in visionOS 27. Virtual Display sessions can optionally persist even when you take your Vision Pro off, and macOS can stream spatial previews of 3D objects directly to visionOS with instant updates and two-way editing. I don’t have a Mac running Golden Gate yet, so I haven’t been able to try these features myself, but I plan to soon. If you work with 3D objects on your Mac and Vision Pro, I imagine this will speed up your workflow significantly.
And that’s visionOS 27 – so far, at least. There’s a still a lot more summer left: bugs to be squashed, refinements to be made, and third-party apps to be updated and introduced. My experience with the new version up to this point has been very positive, and I think it’ll make for a great update.
If you want to try out some of these features early, you can enroll in the Developer Beta anytime in the Software Update section of the Settings app. Whether you upgrade now or hold off for the public release, Apple’s got some great things in store with visionOS 27, and I look forward to continuing my testing over the summer in preparation for a full review this fall.
Login
