❌

Normal view

Nova interface contextual da Siri AI é descoberta no macOS 27; veja como ativá-la

20 July 2026 at 16:35

A Apple está testando uma nova interface na beta do macOS Golden Gate 27 que exibe uma série de atalhos da Siri AI sempre que o usuário seleciona texto em um app qualquer.

Descoberta pelo usuário identificado como “pdfu” em uma comunidade do Reddit, a novidade está claramente inacabada, o que explica o fato de ela vir desativada por padrão nas versões mais recentes do sistema operacional.

Como é possível notar abaixo, a interface assume a forma de um popover que aparece no canto superior esquerdo da seleção feita pelo usuário. Além disso, os atalhos são contextuais, o que significa que ações diferentes poderão ser sugeridas dependendo do conteúdo em destaque.

Caso o usuário esteja trabalhando em um texto, o recurso exibirá atalhos relacionados às Ferramentas de Escrita (Writing Tools), só para citar um exemplo. Ainda de acordo com as informações, o recurso também pode sugerir ações como enviar um email, adicionar um número aos contatos, exibir um endereço no app Mapas (Maps) ou rastrear um voo.

Para testar a novidade, é necessário estar rodando a terceira beta para desenvolvedores ou a primeira beta pública do macOS 27. Feito isso, basta abrir o Terminal, rodar o comando a seguir e reiniciar o Mac:

sudo mkdir -p /Library/Preferences/FeatureFlags/Domain && sudo defaults write /Library/Preferences/FeatureFlags/Domain/WritingTools LightweightUI_macOS -dict Enabled -bool true

Para desativar a novidade (o que talvez se prove necessário, já que, como dito, ela ainda está inacabada e apresenta inconsistências), basta abrir o Terminal novamente, rodar o comando a seguir e reiniciar o Mac:

sudo defaults write /Library/Preferences/FeatureFlags/Domain/WritingTools LightweightUI_macOS -dict Enabled -bool false

Como essa nova interface já está disponível (mesmo que escondida) nas betas do macOS 27, é bem possível que ela dê as caras em uma futura versão de teste do sistema — provavelmente em um estado bem mais polido.

via iThinkDifferent

OpenAI’s new hardware is a $230, 13-switch keyboard for Codex

17 July 2026 at 18:05

OpenAI is selling its first hardware — without any help from Jony Ive. It describes the Codex Micro as a “command center for agentic work” but it’s really a 13-switch wireless keyboard customized to help developers keep tabs on what their Codex agents are doing. It costs $230.

The keyboard has 13 mechanical switches (one keycap covers two of them by default), a rotary encoder, joystick, and RGB backlighting around the whole keypad and individual keys. It comes with 32 customizable icon keycaps.

OpenAI claims that the Codex Micro is a serious business tool: The command keys enable Codex users accept changes, reject outputs, push-to-talk, start new chats, and trigger custom actions. The rotary encoder can be used to dial up the “brainpower” allocated to tasks — or in more conventional terms, how many tokens to allocate to reasoning on a task. And the RGB lighting can provide feedback on how various tasks are progressing. And the RGB lighting under the “agent” keys can provide feedback on how various tasks are progressing.

The Codex Micro’s manufacturer, Work Louder, already has a similar device on the market, the Creator Micro, which offers similar functionality, but without the colorful keys. It costs $56 less than the Codex Micro, however.

The Codex Micro will fit in snugly with OpenAI’s other merchandise, where using Codex is as much about a fashion statement as a technological choice.

AI OK in Linux development, says Torvalds

17 July 2026 at 15:07

Linus Torvalds has a complicated relationship with AI, seeing both its good and bad points. But his latest remarks on the usefulness of AI may have raised a few eyebrows in open-source circles.

Just a few weeks after the Linux founder complained that a “continued flood” of AI-generated vulnerability reports had made the Linux kernel security mailing list “almost entirely unmanageable”, he has come to see the advantages of the technology.

“Linux is not one of those anti-AI projects,” Torvalds wrote in an email response to Linux Kernel senior engineer Roman Gushchin, archived at Kernel.org.

“It can also be a somewhat painful tool, both for maintainer workloads and just from a ‘it keeps finding embarrassing bugs’ standpoint,” he said of the use of AI in security scanning. “The solution is to make sure those LLM tools help maintainers instead of just causing them pain.”

Developers should be free to choose whether they use AI, he said. “We’re not forcing anybody to use it, but I will very loudly ignore people who try to argue against other people from using it.”

Torvalds’ measured support for AI does not come completely out of the blue: Around the same time that he was complaining about AI distorting security maintenance, he also spoke about its usefulness, claiming that it could improve programmer productivity by a factor of 10.

Finishing with Fable 5

7 July 2026 at 15:25

When Fable 5 returned last week, I knew exactly what to throw at it. In February, I started a project out of frustration that likewise ended in frustration, so I put it on the shelf and waited. Five months later, Fable 5 was released, and I knew it was time to finish Editor, a single-view diffing tool for writers rather than developers.

At MacStories, we all write in Markdown, and we’ve used GitHub to share and sync changes among team members since 2015. GitHub is primarily a developer tool, but it’s a fast, reliable way to share our Markdown-formatted article files, too.

We use GitHub the most for the Club MacStories newsletters. Every week, Federico, Devon, Jonathan, and I work on sections for MacStories Weekly and save them to a GitHub repo. That allows any of us to sync the sections locally for reading, editing, and assembling the issue.

The trouble is that as great as Markdown text editors are to write and GitHub is for versioning and syncing, there isn’t a good way to view the changes someone has made to a document. I know because I’ve been looking for a solution for a long time. Some Markdown apps like iA Writer and Bear support versioning or backups, but I’ve yet to find a text editor that can visualize changes made by someone else based on a document’s Git history.

Of course, developers have many ways to track changes to code, including GitHub Desktop, Kaleidoscope, and Git Tower. Code is just text, so those apps can be used by writers, too. However, the process of writing and editing prose is fundamentally different from code. I’ve tried the apps above and others, and it’s just too hard to track changes in the formats development tools use.

This is what it's like trying to track changes in GitHub Desktop.

This is what it’s like trying to track changes in GitHub Desktop.

We wouldn’t have stuck with GitHub as long as we have if it didn’t work, but that hasn’t made the friction of reviewing changes any less frustrating, especially on Fridays when we send MacStories Weekly. That’s when I had the idea for Editor. I was trying to parse some changes Devon had made to one of my stories with GitHub Desktop, and the friction finally got to me.

One obvious problem was the side-by-side document view many code diffing tools use. I wanted more detail than most diffing tools offer, but in a single, readable view, so I could skim through changes quickly.

Most agent-assisted projects benefit from some up-front research and planning. I knew what I wanted would sink or swim on the design, not the app’s underlying Markdown viewer, so I spent time researching systems for visualizing document edits.

That’s when I came across Upwelling, a multi-author project from Ink & Switch that describes itself as “an independent research lab exploring the future of tools for thought.” In their research paper, the authors described my exact problem:

Unfortunately, version control tools like Git, which are designed for software development, do not suit the needs of writers. Git cannot compare or merge files from WYSIWYG editors such as Microsoft Word… and graphical user interfaces for Git are cluttered with complex concepts such as commit hashes and visualizations of non-linear branching and merging histories.

Ink & Switch’s solution, a prototype collaborative text editor, wasn’t what I wanted to build, but the research behind it was full of interesting ideas that helped me settle on several principles for what would become Editor:

  • Document changes needed to be visible in a single view that carefully balanced highlighting changes with readability;
  • A writer should be able to instantly switch from the marked-up version of their document to the clean original and edited final version;
  • Changes needed to be categorized by filterable types like punctuation, word choice, capitalization, insertions, and deletions to reduce clutter in heavily edited documents;
  • Change types would be color coded using a side rail system inspired by maps of London’s tube system;
  • Navigating among individual edits needed to be done by simple j/k keyboard input; and
  • Global document navigation should employ a mini-map of a document’s edit regions (a feature borrowed from developer IDEs like Xcode) to make it easy to jump from one area of a document to another.
Working with Claude and artifacts to prototype Editor.

Working with Claude and artifacts to prototype Editor.

With those choices made, I got busy in Claude Code and came up with a proof of concept quickly, but sadly, these were the days of Claude Opus 4.6, which wasn’t nearly as good at design as today’s models. What I wanted was possible, but what I had was a mess.

The prototype is recognizable as Editor, but far less readable than the finished version.

The prototype is recognizable as Editor, but far less readable than the finished version.

As it turns out, designing track changes that are accurate but readable is hard. For example, does changing “day” to “date” replace one word with the other or substitute one character (the “y”) for two others (“te”)? Despite putting clear parameters around what Editor should look like, I could tell Claude was stuck, so I called it quits and moved on.

However, I’d wanted something like Editor for far too long to simply give up. So I saved what I had to a GitHub repo and figured I’d take another run at it later.

Editor makes it easy to see small changes like punctuation with filters.

Editor makes it easy to see small changes like punctuation with filters.

Later turned out to be last week when Claude Fable 5 was re-released after a U.S. government shutdown of the model. Anthropic made the model available to its subscribers, with some restrictions, through July 7, which I made good use of.

A lot has changed in the six months since I put Editor on ice. Notably, Claude Opus 4.8 and Claude Design were released, and Claude became better at using a browser, all of which fit nicely with Editor’s relatively complex design.

Dark mode does a particularly nice job of highlighting changes.

Dark mode does a particularly nice job of highlighting changes.

Between Opus 4.8 and Claude Design, I expect I could have finished Editor without Fable 5, but with it, the only thing that slowed me down was my five-hour token limit. I repeatedly hit the limit in under an hour as Fable managed a swarm of subagents. What could have taken a few hours last Friday night spanned an evening and the next morning. The token gating slowed me down, but at the same time, I expect that using Opus 4.8 and Claude Design would have taken the entire weekend.

But it isn’t just speed that makes Fable 5 impressive; it’s the fact that it got Editor’s complex UI right the first time. Fable took a carefully planned but very broken prototype and turned it into a polished product that the whole MacStories team can use.

Editor is built to run on the internal tools foundation Federico created.

Editor is built to run on the internal tools foundation Federico created.

However, there’s a big difference between a web app running on my Mac mini server for personal use and something that can be shared. Fortunately, Editor also benefited from the internal tool foundation Federico has built over the past several months.

He originally built it to house Feedboard, his kanban-style RSS feed reader; Images, an update to our tool for uploading images to the MacStories CDN; and iOS Review Search, a semantic search tool for his iOS and iPadOS reviews. It’s a login-protected internal page built on web app hosting platform Vercel. I later contributed a tool that summarizes Apple Newsroom posts and simplifies uploading their promotional images to our server.

Federico managed Editor's deployment, in part, from Cursor for iPhone.

Federico managed Editor’s deployment, in part, from Cursor for iPhone.

With a couple of those tools in hand as context for Fable, I asked Claude to get Editor ready for our internal tools page and passed it off to Federico with a separate set of specs and instructions he could point Claude at for deployment and the creation of a landing page. That introduced bugs that required some troubleshooting, which Federico handled in part using Cursor and it new iPhone app, but by that afternoon, Editor was ready for production. The entire process from old, broken prototype to production web app took less than 24 hours, and for a lot of that time we were either asleep or away from home.


Navigating by individual edit.

Navigating by individual edit.

When you use agentic tools like Claude every day, it’s easy to forget how far they come so quickly. All you see are the flaws that still serve as roadblocks. What was different about using Fable 5 was that there were no roadblocks. It simply took a project that Opus 4.6 struggled with in February and made short work of it. It was a remarkable thing to see. And now, we have a tool that I’ve wanted since we started using GitHub for our writing in 2015.

Tomorrow, Fable will move to usage credits that are just too expensive for my tastes, given how fast the model burns tokens. Hopefully, it will trickle back into Anthropic’s subscription tiers in the future. Until then, though, I’ll continue knocking out prototypes, and if they’re too much for Opus, I’ll shelve them until a better model comes along. They always do.

Snazzy Labs Puts the Mac’s Upcoming Game Porting Toolkit 4 Through Its Paces

1 July 2026 at 20:37

Over at Snazzy Labs, Quinn Nelson has a great in-depth look at the changes coming to Apple’s Game Porting Toolkit with macOS 27 this fall. Paired with Metal 4, it’s a real leap over what’s possible today, and Nelson showcases the difference well.

Thanks to the upcoming update, Nelson was able to use CrossOver, a Windows-to-Mac compatibility layer that allows PC games to be played on a Mac, to spotlight some impressive numbers on games ranging from Red Dead Redemption to the recently released 007 First Light.

Not all games Nelson tried showed the same leap in performance, but that’s true on compatibility layers like Proton on the Steam Deck, too. What’s remarkable is that it’s all done in software and as Nelson points out, the advent of coding agents like Codex and Claude may help bring more PC games to Mac using the Game Porting Toolkit by reducing the porting costs.

Nelson also makes a pitch for an Apple gaming device. I agree with him that more than ever, the pieces, right down to a hardware-focused incoming CEO, are all there for such a device, and I remain optimistic. However, I’ve made the case for such a device for years now to no avail. Still, whether or not Apple builds gaming hardware itself, watch the full video above. It’s a fantastic view of how far the Mac has come as a potential gaming platform since the advent of Apple silicon.

Thinking Machines Lab offers enterprises a US alternative in open-weight AI

16 July 2026 at 12:03

Thinking Machines Lab, the San Francisco startup founded by former OpenAI CTO Mira Murati, has released Inkling, its first general-purpose AI model. The launch adds another US-developed entrant to an open-weight market where Chinese developers produce several leading coding and reasoning models.

Inkling uses a mixture-of-experts architecture with 975 billion total parameters, of which 41 billion are active during processing. It supports a context window of up to 1 million tokens and was pretrained on 45 trillion tokens spanning text, images, audio, and video. Thinking Machines said it also trained the model for coding, tool use, and multimodal tasks.

The release follows the October 2025 launch of Tinker, Thinking Machines’ first product and an API-based platform for customizing AI models. Developers can fine-tune Inkling through the platform.

In a June 2026 assessment, AI model routing platform OpenRouter highlighted DeepSeek V4 Flash, GLM 5.2, MiniMax M3, and Nvidia Nemotron 3 Ultra as four notable open-weight models. Nemotron was the only US-developed model in the group.

Performance and developer access

Thinking Machines Lab’s benchmark table shows mixed results. Inkling scored 77.6% on SWE-Bench Verified, behind DeepSeek V4 Pro and GLM 5.2 but ahead of Nvidia Nemotron 3 Ultra. It also recorded 74.1% on MCP Atlas, 77.1% on BrowseComp with context management, and 79.8% on IFBench.

Thinking Machines said Inkling’s result used a bash-only harness, while the comparison figures were reported by the competing models’ developers.

The model includes a reasoning-effort setting that developers can adjust from 0.2 to 0.99. Thinking Machines said the setting allows users to balance performance against the number of generated tokens. In the company’s testing, Inkling matched Nemotron 3 Ultra’s Terminal Bench 2.1 score while generating about one-third as many tokens.

Developers can fine-tune Inkling through Tinker using context lengths of 64,000 or 256,000 tokens and test it through the Inkling Playground. The model is available through APIs from Together AI, Fireworks, Modal, Databricks, and Baseten. It is also supported by inference software, including SGLang, vLLM, TokenSpeed, llama.cpp, and Hugging Face Transformers.

Inkling’s full weights are available on Hugging Face as the original checkpoint and as a quantized NVFP4 checkpoint. Thinking Machines also previewed Inkling-Small, which has 276 billion total parameters and 12 billion active parameters. The company said it would release the smaller model’s full weights after completing testing.

Enterprise impact

Inkling’s differentiation lies in its open weights, multimodal capabilities, controllable reasoning, and integration with Tinker, rather than benchmark leadership, according to Biswajeet Mahapatra, principal analyst at Forrester.

“Enterprises are most likely to benefit in workloads where domain adaptation matters more than generic model performance, including knowledge-intensive copilots, multimodal customer service, document understanding, operational workflow automation, and agentic tasks that require organization-specific data, policies, and processes,” Mahapatra said.  

Inkling’s US origin could also influence adoption among Western enterprises, according to Pareekh Jain, CEO of Pareekh Consulting. He said many Western organizations face regulatory or procurement barriers when considering Chinese-developed AI models.

“Inkling gives those organizations a US-developed open-weight option that they can deploy on their own infrastructure,” Jain said.

However, the benefits will need to be weighed against the cost of deploying the full model.

Running Inkling on private infrastructure requires a GPU cluster with at least 2 TB of aggregated VRAM for the BF16 checkpoint, according to the model card. Thinking Machines lists configurations of eight Nvidia B300 GPUs or 16 H200 GPUs. A quantized NVFP4 checkpoint lowers the requirement to at least 600 GB and can run on four B300 GPUs or eight H200 GPUs.

“Because Inkling is a massive model with 975 billion total parameters, running the full model still requires significant GPU infrastructure, making closed-model APIs more economical for many organizations,” Jain said.

Jain said Inkling-Small may be a more feasible option for many enterprises because it could reduce infrastructure costs and latency while retaining useful performance across key workloads.

Safety and governance

Thinking Machines said it trained Inkling for calibration, instruction following, and resistance to censorship. The company said the model showed “strong patterns of censorship non-compliance” when evaluated by Cognition on its Propaganda and Censorship Eval.

Inkling scored 98.6% on StrongREJECT, which Thinking Machines described as a test of whether models refuse unambiguous harmful requests.

The model’s safety behavior should be retested after an enterprise customizes it, according to Jain. “Model fine-tuning can weaken safety filters, so companies should retest safety after customizing the model rather than assuming it stays safe,” Jain said.

He added that self-hosted and modified versions could diverge from Thinking Machines’ official model over time without receiving automatic updates.

“CIOs need to ensure every AI agent action is logged, auditable, and governed by human approval for high-risk tasks,” Jain said.

Codex Multi-Agent V2 update raises developer concerns over agent transparency

15 July 2026 at 13:20

OpenAI’s recent update to its Codex CLI has introduced a new protocol that appears to shift more orchestration decisions from user-defined configuration to the runtime, prompting developers to request greater visibility into the instructions exchanged between AI agents.

In a detailed GitHub merged request, users stated that the Multi-Agent V2 protocol-infused architecture of the CLI no longer exposes the instructions passed between parent and sub-agents, making it difficult to inspect how work is delegated across the system.

“Multi-agent v2 currently routes agent instructions through normal tool arguments and inter-agent context. That means the parent model can emit plaintext task text, Codex can persist it in history/rollouts, and the recipient can receive it as ordinary assistant-message JSON,” the request read.

“This changes the v2 path so agent instructions stay encrypted between model calls: Responses encrypts the message argument returned by the model, Codex forwards only that ciphertext, and Responses decrypts it internally for the recipient model,” it added.

Other users, commenting on the thread, also said that the lack of visibility into agent instructions can be attributed to the recently introduced Multi-Agent V2 protocol, with one user stating that reverting to the previous version of the CLI restored visibility, but only as a temporary workaround.

Separately, Ignat Remizov, CTO at payment service Zolvat, filed a GitHub feature request to offer what can be described as a permanent fix after stating that OpenAI may have introduced the change in efforts to harden security.

“A possible shape is to keep the encrypted message field for model delivery, but add a separate non-encrypted audit field for the readable task text. The audit field should be persisted in rollout/history/trace metadata so users and maintainers can inspect what was delegated without needing to decrypt model-delivery ciphertext,” Zolvat wrote.

Enterprise governance concerns are likely to emerge

While an OpenAI contributor said the protocol remains under development and declined further changes to the request, analysts warned that the issue would create debugging, governance, and operational challenges for development teams and their enterprises if the issue persists or becomes a long-term characteristic of multi-agent systems.

“Hidden agent instructions reduce observability in multi-agent systems. Developers can no longer see whether failures stemmed from incorrect task delegation, poor orchestration, or model reasoning, making debugging, prompt optimization, and root-cause analysis significantly harder. Agent instruction traces are becoming as essential as application logs in modern software,” said Pareekh Jain, principal analyst at Pareekh Consulting.

For CIOs, Jain pointed out, opaque agent interactions create governance challenges.

“Without visibility into how agents delegated and executed tasks, it becomes harder to audit decisions, investigate incidents, demonstrate compliance, and build trust in AI systems. Enterprises will increasingly expect secure but auditable agent communication rather than completely hidden orchestration,” Jain said.

“Any big enterprise, especially in regulated industries such as banks and hospitals, needs to be able to prove what their AI systems did and why, especially if something goes wrong. If a sub-agent does something bad, like touching private data, the company needs to show here’s exactly what it was told to do. If that record doesn’t exist, it is a serious problem for trust and legal accountability, not just an annoyance,” Jain added.

Further, the analyst pointed out that issues around the visibility of agent operations could even slow production deployments of mission-critical AI.

“Enterprises, just like we are seeing with developers on GitHub, are likely to demand stronger observability, audit trails, and governance before trusting autonomous multi-agent systems. It is nearly as important as model performance,” Jain added.

An email sent to OpenAI enquiring about planned changes to the protocol went unanswered.

Ship apps faster with GitHub, Vercel, and Firestore

15 July 2026 at 10:00

These days, application developers can take their pick from a vast menu of architectural solutions. We can choose from the well-understood to the experimental, and from blended solutions in between. Several powerful middle-ground technologies that emerged during the cloud revolution have really come of age. Here we’ll take a look at putting together three of the most impressive: GitHub, Vercel, and Firestore.

Each of these is an important tool in its own right that can be used to attack specific problems. In combination, they not only meet the needs of several important application scenarios, but they have a superpower—the ability to dramatically shorten the distance between development and deployment.

There is nothing quite as gratifying as putting your hands on just the right mix of tools for a given need.

A ‘no-ops’ stack built for speed

If your primary goal is sheer development velocity, you would be hard-pressed to top this architecture. This “no-ops” stack collapses the distance between your local IDE and a globally distributed production environment. You are essentially trading the overhead of managing VMs and load balancers for the sheer speed of committing code and watching it deploy automatically.

While each component is highly flexible, adopting them requires a specific, event-driven mindset. There are a few finicky bits to manage, mostly around routing environment variables securely and designing around stateless back-end functions. But the constraints are obvious and well-documented.

Before we look more closely, let’s quickly identify the kinds of apps that are a perfect fit here, along with those that are workable and those that really merit a different approach.

  • The sweet spot (deploy and go): AI-mediated applications, asynchronous game back ends, and real-time collaborative B2B dashboards. This architecture perfectly absorbs the unpredictable latency of LLM APIs and instantly syncs state across multiple clients without requiring you to build custom WebSocket infrastructure.
  • The middle ground (workable, with trade-offs): Headless e-commerce, moderate IoT telemetry, and apps requiring scheduled batch processing. You will encounter friction if your catalog relies on deeply relational SQL constraints, or if your background reporting jobs take longer than a few minutes and hit serverless execution limits.
  • The danger zone (look elsewhere): High-frequency trading, fast-paced action multiplayer games, heavy data ETL pipelines, and core financial ledgers. Serverless architectures cannot natively hold open the persistent WebSockets required for twitch-reflex data, and heavy compute tasks will abruptly time out.

We should mention that these categories are not mutually exclusive. Many enterprise applications, such as a full-scale e-commerce platform, straddle these lines. You might use Vercel and Firestore to build a lightning-fast, reactive storefront that handles ephemeral user state like shopping carts, while simultaneously “stitching in” a managed SQL database like Supabase or PlanetScale. This hybrid approach allows you to maintain the relational integrity required for back-office inventory and financial ledgers and pair it with the front-end velocity this stack provides.

GitHub: the bedrock

I don’t need to introduce you to GitHub. It is a central element of the development landscape. I still remember CVS and SVN with a certain nostalgia, but the enhancements of Git speak for themselves. When combined with the orchestration powers of GitHub, it is no wonder that virtually the whole industry has adopted this type of platform.

Git plus GitHub gives you an enormous amount of power already, in terms of how you can organize and automate your projects. But there is a next-level experience in combining GitHub and Vercel. For JavaScript-based projects, you can take simple GitHub pushes and turn them into instantly deployed clients and serverless functions. It is one of the cleanest and least fiddly ways to move from raw code on your local machine to a globally deployed, full-stack architecture.

Vercel: the nexus

Vercel is more than just a deployment host. It is a control plane that ties this high-velocity, no-ops architecture together. Alongside GitHub and Firestore, Vercel’s deeper strength is its ability to act as an orchestration layer between your reactive front end and external stateful services.

Vercel has a great amount of facility in fine-tuning what branches go to what environment and helpful features like instant rollback. You can just log into Vercel’s dashboard for your project and see the history of deployments and any errors and logs. It’s a simple menu choice to roll back to a historical version or compare one version against another.

When you “stitch in” third-party services (such as a managed SQL database like Supabase or a payment processor like Stripe), Vercel’s serverless functions become the lightweight interface, and Vercel’s the adapters handle the communication. You offload the integration logic (the service layer) to Vercel’s global Edge Network, keeping your UI and back end clean, responsive, and decoupled. 

In short, Vercel allows you to get the speed of the “no-ops” development life cycle without sacrificing the complex transactional integrity required for some applications like enterprise inventory systems.

Firestore: the datastore

Firestore is an extremely lightweight, NoSQL, cloud datastore. It has a great deal of add-on power, but its core value proposition is that it accepts virtually any data you stuff into it and it provides event-driven subscriptions to data changes.

These two capabilities together make Firestore about as straightforward a solution to a managed back end as you can imagine. You subscribe to collections or even fields and then you simply stick “unstructured” data (read: JSON with variable fields) in and the client waits for the changes it is interested in.

This is so streamlined that one can just point the browser (or native mobile app) directly at Firestore and listen for events. Which immediately raises the question of identity, for auth and for data visibility, but hold on—Firestore’s third superpower is that it has an authentication module that actually works. What I mean is, it is actually pretty simple and yet confidently secures your app.

Sometimes auth solutions seem either too simple (and yet opaque) or too mired in the nitty gritty. Firestore auth will let you do some basic configuration and start using a reasonable auth almost immediately. 

Not to belabor the point, but having a realistic and attainable auth solution elevates your stack to a production grade—one that can handle many real-world applications. Firestore auth plays nicely with other important APIs, like Stripe. Typically, auth is a major feature that feels like off-roading in a Honda Civic, but Firestore’s approach to auth, added to this particular stack, feels like a normal speed bump. It’s just another component you plug in, rather than a tentacled alien you weave into the your code.

The limits of the velocity stack

This architecture combines components that are optimized for flexibility. That same character also introduces distinct limitations. Understanding these is essential before committing production workloads.

The serverless life cycle

Serverless functions are spun up to handle requests. They close out soon afterward and lose any state. For that reason, they cannot natively hold open persistent WebSockets. If your system requires continuous, sub-millisecond, bidirectional streams—like a real-time multiplayer action game or a high-frequency trading dashboard—pure serverless will fight you all the way. You are forced to introduce a third-party managed WebSocket service to route messages back to your stateless endpoints via HTTP webhooks.

The execution time ceiling

Vercel (like all serverless platforms) enforces strict timeouts on operations. While enterprise tiers might grant you up to 15 minutes, standard functions often time out after 10 to 60 seconds. Long-running tasks like video transcoding, database scripts, or orchestrating multi-step AI agent workflows, which might take 20 minutes to resolve, will run up against these limits. Heavy-lifting tasks must be offloaded to a dedicated, long-running service like Google Cloud Run, or broken into smaller, asynchronous chunks via message queues.

The cold start reality

While the industry has made massive strides in minimizing initialization times—particularly with lightweight edge networks—traditional Node.js-based serverless functions still experience cold starts. If a function has not been invoked recently, or if traffic spikes require a new instance to spin up concurrently, the first request will take a noticeable latency hit as the container provisions and the code loads.

API instead of RAM

In a traditional server environment, you can store transient data in global RAM, allowing subsequent requests to access shared context instantly. In the serverless model, every request might hit a fresh container. Therefore, all shared context must be externalized. Although Firestore serves brilliantly as the state manager, relying on a database for high-frequency, sub-millisecond, ephemeral caching introduces network latency and per-operation costs. That said, using a shared RAM state on a server is non-trivial also, unless you are using a single app server and VM (because high-availability or fail-over requirements will lessen the RAM win on a traditional server).

Tuning for velocity and control

Every architectural decision is a trade-off. There are no cost-free choices. By adopting the GitHub, Vercel, and Firestore stack, you are explicitly maximizing feature velocity over fine-grained control.

You lose the ability to tweak the underlying operating system, hold open persistent sockets, or run hour-long back-end scripts. In exchange, you gain an architecture that scales from zero to global distribution instantly, requires virtually no devops maintenance, and perfectly absorbs the asynchronous, event-driven realities of modern application development.

For the right application—whether it is a fast-moving prototype or an enterprise AI copilot—this stack doesn’t just save time; it fundamentally changes how quickly a small team (or a single person) can impact the market. You stop worrying about build chains, load balancers, and server patches, and you focus on the central mission: shipping features.

What 80% AI-written test pipelines actually cost

15 July 2026 at 10:00

The first time I heard someone say their AI now wrote 80% of their tests, I asked the obvious question. Eighty percent of what?

After 20 years building and leading test automation for consumer-scale platforms, my honest answer turned out to be eighty percent of the typing, not eighty percent of the engineering. The remaining twenty was where the work still lived. Budgeting for two percent of leftover effort was the mistake. When the real number was closer to thirty, that gap was the difference between a pipeline that shipped and one that quietly built up a queue of half-trusted features nobody could rely on.

This piece is about that gap. As an independent research project on LLM-augmented testing methodology, I built a six-stage agentic pipeline that takes a design in Figma and produces running tests in WebDriverIO, connected end to end over the Model Context Protocol. It works. It has been useful. And the parts that broke surprised me, because they were not the parts the hype cycle tells you to worry about.

How I wired a six-stage pipeline over one protocol

The pipeline runs six stages in sequence, each owned by a different agent, with every handoff crossing MCP.

Six-stage agentic test pipeline: design capture → requirements writer → ticket opener → code generator → test-case writer → automation generator. Each stage carries an MCP handoff and a provenance stamp.

The end-to-end trace links a pull request back to a Jira ticket, a requirements section and a Figma frame. Each artifact is stamped with the agent that produced it, the model it used and the inputs it was given.

MCP is the boring middle that makes any of this work. The cliché is that MCP is “USB-C for AI”: one open protocol, any tool. Like most analogies, it is about eighty percent right. The part that matters is the eighty: I do not have to write a custom adapter for every system the agent talks to. One MCP server per tool and every agent talks to all of them the same way.

Typed handoffs between agents are my own architecture, layered on top of MCP rather than provided by it. Each agent writes a typed artifact the next agent reads. Each handoff is logged with provenance. When something went wrong six stages in, I could replay the chain. Without that discipline, a multi-agent pipeline is a debugger’s worst day. You know the test plan is wrong. You cannot tell whether the mistake came from the Figma read, the requirements interpretation or the ticket scaffolding. With it, I could point at exactly which stage went sideways and which inputs it was looking at when it did. The pattern lives in a public MIT-licensed reference implementation for any reader who wants to run it.

The sixteen-minute number is the marketing number. I ran the full chain end to end in about sixteen minutes on a synthetic net-new screen, Figma in, automation suite out. That repeated across my runs; it is not a demo trick. But sixteen minutes is the part of the story most fun to tell and least useful to learn from. It is what gets quoted in the all-hands. The hours that come after, when a human reviews each handoff, are where the work actually lives.

What actually broke in production-style runs

The failures that stalled my pipeline were rarely the ones I expected.

I expected hallucinated APIs. I got them: the agent confidently called endpoint names that sounded right but did not exist. I expected sparse-spec-in, sparse-spec-out, where a Figma frame with no annotations produced a requirements doc with vague acceptance criteria, every time. I expected locator drift, the common UI-automation failure mode where a renamed component silently breaks an entire test suite. There is solid outside writing on non-determinism in tests covering this whole family of failure modes, and the agent inherited every one.

What I did not expect, and what kept the pipeline down longer than any of the above, was the plumbing.

The model backend timed out under load. It lost credentials silently and started returning empty strings, which the agent then read as confidence. A duplicate consumer on a shared long-poll API endpoint produced an HTTP 409 conflict that broke delivery without throwing anything visible. One unguarded exception inside one agent aborted a whole shared scheduler run and took the other agents in the registry down with it. The single worst incident cost me three hours to find. An environment variable had silently rotated overnight; every agent in the fleet was returning structurally valid but semantically empty requirements docs; the downstream stages were dutifully generating tests against nothing.

None of those are model bugs. They are infrastructure. The agent literature, which is what I went looking through when I started this work, mostly does not talk about them.

The fix was not better prompts. It was circuit-breaker-style review checkpoints between stages and what I now call the four-guard discipline: four small guards I consider non-negotiable on any unattended agentic pipeline. The bulkhead pattern from microservices is the most consequential. An unhandled exception inside one agent can no longer abort the shared run; the offending agent fails fast with a structured error and the others keep going. Paired with that, a pure-data fallback ensures a model timeout produces a deterministic output explicitly marked as degraded mode, rather than an empty string the next stage will misread as confidence. A single-owner lease sits on every shared external endpoint, the cure for the duplicate-consumer incident that ate one of my Sunday afternoons. The cheapest guard was the last to arrive: a one-line synthetic canary every agent has to produce a known correct response to before any real work begins, so a credentials rotation or silent backend failure trips an alert before downstream stages have generated artifacts against garbage.

None of these guards is novel. They are textbook stability patterns at a new boundary: the seam between the LLM agent and the rest of the system, which most of the existing agent literature still treats as a solved problem.

The 20% you don’t see, and when not to do this

Here is the part the demo videos leave out. Even when the pipeline works, the human time per stage does not go to zero.

Human review time per ticket across five pipeline stages: code review 60-180 min, automation review and flaky-fix loop 30-90 min, ticket architecture and sequencing 30-60 min, test data and environment 15-30 min, requirements review 20-30 min. Net: the human still spends 20-30% of the original effort, almost all of it reviewing rather than creating.

Net of all that, the human still spends twenty to thirty percent of the original effort, almost all of it reviewing rather than creating. The pipeline saves seventy to eighty percent, not ninety-eight. The trap is budgeting for the two percent you do not save.

When does this kind of pipeline make sense? In my experience, when the Figma is richly annotated and acceptance criteria are clear up front; when there is review capacity to absorb the work the pipeline shifts onto humans; when the stack is well represented in the training data; and when the feature is net-new rather than a deep edit of legacy code. When does it not? When the design lives on a whiteboard. When the integration touches old code with hidden contracts. When the path is regulated or safety-critical. When there is no senior reviewer who can hold the line. When the work is exploratory and writing the spec is the actual point of the exercise.

Teams I have seen succeed with agentic pipelines budget for the rework explicitly, staff the review queue and treat the saved hours as capacity for harder problems rather than headcount they can release. Teams I have seen struggle did the opposite: declared victory at the demo and quietly accumulated a backlog of half-trusted features the next quarter had to clean up.

The right unit of measurement is not how much the pipeline generates. It is how much of what it generates a human still has to touch before you would ship it. Call it the 80/20 rework rule: measure the rework, not the generation. The teams that get the rework number right are the ones whose AI investments compound. The teams that stop counting at the headline percentage are the ones that own the cleanup six months later.

This article is published as part of the Foundry Expert Contributor Network.
Want to join?

Port wants to bring vibe coding to the enterprise

14 July 2026 at 22:20

Port has rolled out Port AI Builder, a vibe coding platform designed for software development and platform engineering teams.

Announced July 14, Port AI Builder lets teams create and run agentic workflows in natural language, with built-in human-in-the-loop review and approval. The platform lets organizations apply AI agents across the SDLC (software development life cycle), drawing on domain skills spanning site reliability engineering, devops, architecture, security, AI governance, data modeling, and UX, while maintaining governance and visibility, the company said. Port AI Builder is available through free and paid subscriptions.

Port AI Builder works on top of Port’s Agentic SDLC Platform, which provides the context lake, workflow orchestration, agent management, and governance that enterprises need to operationalize AI SDLC, according to the company. The new AI Builder lets teams build production-grade workflows in minutes, for use cases such as autonomous resolution, AI cost management, and engineering performance tracking, without losing control, Port said.

Oracle expands AI Agent Studio for Fusion Applications with pro-code tools

14 July 2026 at 13:00

Oracle on Tuesday expanded its AI Agent Studio for Fusion Applications with new pro-code development tools, including a CLI-based capability called AI Studio Skill, allowing developers to build agentic applications using familiar environments such as VS Code, Codex, and Claude Code.

The AI Studio Skill is the CLI that provides the Fusion-specific context and tooling that AI coding assistants need to build Fusion-native applications. It provides access to the project structure, APIs, templates, validation, packaging, and deployment workflows required for Fusion Agentic Applications, Natalia Rachelson, SVP of product for Fusion Applications at Oracle, told InfoWorld.

“Think of it as Oracle’s development harness for popular AI coding assistants. Developers can use models like Codex or Claude Code to generate code, while the AI Studio Skill connects those models to Oracle AI Agent Studio and the Fusion runtime,” Rachelson said.

Familiar tools and workflows to simplify development

The access to familiar IDEs and harnesses, according to analysts, will make it easier for developers to build and maintain agentic applications for business workflows.

“The AI Studio Skill provides developers a way to build Fusion agents like a new software function versus configuring them like application extensions,” said Scott Bickley, advisory fellow at Info-Tech Research Group.

“Enterprise developers expect source control, code review, repeatable deployments, testing or debugging, and integration into their existing toolchains. Connecting the various IDEs and code assist products will make it easier to build, validate, and maintain agentic applications using already familiar tools and processes. This ostensibly will result in agents that are easier to maintain, govern, and align with enterprise development practices,” Bickley added.

For Robert Kramer, managing partner at KramerERP, the move is likely to drive more adoption of the Studio itself: “Oracle is meeting developers where they already work and making Fusion a more attractive place to build agentic applications.”

Native runtime could aid governance in production deployments

However, the CLI and IDE integrations, for Bickley, extend beyond developer productivity into tackling the governance and execution challenges that often prevent AI prototypes from reaching production.

“One of the most painful barriers to production AI is that many prototypes are built outside the enterprise systems where identity, permissions, workflow approvals, and overall system governance are already built in,” Bickley said.

In contrast, the integrations will allow enterprises to run agentic applications from inside Oracle’s platform, leveraging existing business context, identity, approvals, and governance rather than recreating those capabilities through external orchestration layers when moving them into production, Bickley added.

That shift, the analyst further added, will prove beneficial for CIOs because it will accelerate business outcomes while operating within a trusted environment.

Governance, observability, and lifecycle management matter more to CIOs after agentic applications move into production, Kramer echoed.

Governance gains come with strategic trade-offs

The approach of building and running agentic applications natively inside Oracle Fusion, though, is not without trade-offs, analysts cautioned.

CIOs should pay close attention to vendor lock-in as more business processes become agentic, Bickley pointed out.

“In the case of Oracle Fusion, ensure the ATLAS framework provides an accurate validation layer at a low cost of overhead. Consider the levers that Oracle may avail itself of contractually or commercially in the future,” Bickley said.

“ROI should be modeled against a progressive monetization schema as AI agents operate upon a consumption-based infrastructure.  As such, ensure provisions limiting cost overlays and uplifts are agreed upon prior to locking in,” Bickley added.

These considerations, the analyst further added, are becoming increasingly relevant because most enterprise software vendors, including the likes of SAP and ServiceNow, are introducing offerings and features to become the runtime and orchestration layer for enterprise AI.

Earlier in May, SAP expanded its AI strategy with the Autonomous Enterprise vision, introducing a unified Business AI Platform, Joule Studio 2.0, and AI Agent Hub to let enterprises build, govern, and run AI agents within a managed runtime.

In June, ServiceNow expanded its AI transformation by adding new features to its Context Engine and AI Control Tower, in order to better embed governance, enterprise context, and observability into AI workflows across enterprise systems.

During the same month, Salesforce, via its Informatica acquisition, added features to tie AI agents more closely to trusted enterprise data and operational workflows.

For developers and enterprises willing to try out the new CLI-based experience, it can be accessed from within the Studio without any additional cost, Oracle said.

The company is also adding a public GitHub repository that it said will provide templates, starter projects, sample applications, reusable assets, and reference architectures to help developers build and validate agentic applications faster.

Visual Studio Code backs multi-chat Claude sessions

14 July 2026 at 02:27

Visual Studio Code 1.128, the most recent edition of Microsoft’s code editor, adds support for multi-chat agent sessions using Anthropic Claude agents.

Introduced July 8, VS Code 1.28 can be downloaded for Windows, Linux, or Mac from code.visualstudio.com.

With VS Code 1.28, multi-chat agent sessions now support using Anthropic Claude agents. With multiple chats, a session can contain related chats, allowing users to compare approaches, branch from an earlier turn, and run work in parallel. Users can add chats, fork a chat from an existing turn, switch between peer chats, and send turns concurrently. Each chat keeps its own history, title, and model selection, and restores with the parent session after restart, Microsoft said.

VS Code 1.28 also makes Copilot Vision generally available. With Copilot Vision, VS Code users can attach images and PDFs by pasting them into chat, dragging and dropping them, or using the context menu. Images also may be read by the agent via a tool call, Microsoft said.

Also in VS Code 1.28:

  • Quick chats allow users to ask a question in the Agents window without opening a workspace first.
  • VS Code can contribute OS-level keyboard shortcuts that take effect even if VS Code is not in focus. Users can add systemWide to a keybinding definition in keybindings.json to make it OS-level.
  • Developers can configure a location for browser tabs to open via a new setting, workbench.browser.newTabPlacement. The setting provides three options: to open browser tabs in the active editor group, in a dedicated group to the side, or in a dedicated auxiliary window.
  • VS Code can contribute OS-level keyboard shortcuts. These shortcuts take effect even if VS Code is not in focus.
  • Administrators can configure where GitHub Copilot sends OpenTelemetry (OTel) data, allowing organizations to enforce telemetry flows to an approved collector without each developer setting OTEL_* environment variables. The managed configuration applies to both the Copilot Chat extension and the agent host process.

GitHub Copilot introduces upgrade canvas for modernizing .NET applications

13 July 2026 at 17:27

GitHub Copilot has introduced an interactive canvas that makes it easier to follow, review, and steer the actions of the upgrade agent as it modernizes .NET applications.

The GitHub Copilot upgrade agent assesses the application, generates a structured upgrade plan, creates implementation tasks, and executes the work, according to a July 9 bulletin from Microsoft. Now developers can follow that workflow in the GitHub Copilot app through an interactive upgrade canvas. The upgrade canvas provides a live view of the modernization workflow as it unfolds, Microsoft said.

This agent upgrade agent starts by assessing the .NET application and identifying what needs to change:

  • What version of .NET is this application targeting?
  • Which NuGet packages need to be updated?
  • Are there breaking API changes?
  • Which projects can be upgraded independently?
  • What should happen first?

From this point, the agent generates a structured upgrade plan and breaks the work into actionable implementation tasks. While the GitHub Copilot app provides the interactive upgrade canvas, GitHub Copilot upgrade also is available in the following tools:

  • Visual Studio – Built directly into Visual Studio. Right-click a solution or project in Solution Explorer and select Modernize to start a .NET upgrade.
  • Visual Studio Code – Install the GitHub Copilot upgrade extension, select the Upgrade agent from the agent picker dropdown menu, and prompt the agent to modernize your .NET application.
  • GitHub Copilot CLI – Install the GitHub Copilot upgrade plugin to assess, plan, and execute .NET upgrades directly from the terminal.

Developers can get started with GitHub Copilot and the GitHub Copilot upgrade agent by visiting the GitHub Copilot upgrade marketplace.

OU Researchers Enhance Imaging Technology for Better Donor Liver Assessment

9 July 2026 at 06:00

A groundbreaking imaging technology developed by researchers at the University of Oklahoma promises to revolutionize liver transplant evaluations by enabling more comprehensive and rapid assessments of donor organ health. With thousands of patients awaiting liver transplants nationwide, transplant teams urgently need tools that can deliver swift, accurate insights without invasive procedures. The team, led by Dr. Qinggong Tang, has adapted polarization-sensitive optical coherence tomography (PS-OCT)—an advanced imaging modality originally utilized in retinal scans—to noninvasively evaluate donor livers at high resolution.

Traditional liver assessments rely heavily on biopsies, where small tissue samples are extracted and examined for signs of disease or damage. While considered the gold standard, biopsies are inherently limited, providing only a microscopic snapshot of a vast organ that may vary in condition. This narrow sampling can cause uncertainty, sometimes leading to the discard of viable organs. The OU team sought to overcome these limitations by employing PS-OCT, which not only captures detailed cross-sectional images of liver tissue but also measures its polarization properties, revealing subtle structural and biochemical features linked to liver health.

The engineers designed a portable PS-OCT system optimized for clinical and operating room environments, allowing transplant teams to scan liver surfaces quickly and noninvasively. The imaging data are then analyzed using advanced artificial intelligence algorithms, co-developed with Dr. Chongle Pan’s computer science lab. These AI tools quantify critical parameters indicative of hepatic steatosis (fat accumulation) and inflammation, two primary factors influencing liver viability. By training their models on datasets from over thirty clinical cases—comparing PS-OCT results with biopsy outcomes and post-transplant organ function—the researchers demonstrated strong correlations between imaging biomarkers and actual clinical metrics.

Beyond providing a more holistic view of donor liver condition, PS-OCT could enhance decision-making speed, potentially expanding the pool of organs deemed suitable for transplantation by identifying healthy tissue regions missed by biopsy. Such improvements may reduce organ discard rates and improve transplant success. Encouraged by initial findings, the OU team plans a large multisite clinical trial involving institutions like UT Southwestern and the Cleveland Clinic to validate and refine this approach across diverse patient populations.

This work exemplifies OU’s interdisciplinary innovation platform that integrates optical bioimaging, machine learning, pathology, and organ perfusion technology to translate engineering advances directly into clinical practice. The researchers also intend to extend PS-OCT evaluation methods to other organs, including kidneys and lungs, widening the impact of this technology.

Supported by National Science Foundation grants and institutional partnerships, the team’s efforts mark a significant step toward redefining how transplanted organs are assessed. Dr. Tang emphasizes that this is just the beginning, envisioning a future where noninvasive, AI-enhanced imaging facilitates safer, faster, and more effective organ transplantation worldwide.


Subject of Research: Donor liver evaluation using advanced imaging techniques
Article Title: Human donor liver viability evaluation with polarization-sensitive optical coherence tomography
News Publication Date: 24-Jun-2026
Web References: http://dx.doi.org/10.1126/scitranslmed.adv7124
Image Credits: University of Oklahoma / Ellie Pinter

Keywords

Organ transplantation, Optical coherence tomography, Polarization-sensitive imaging, Liver viability, Artificial intelligence, Biomedical imaging, Noninvasive diagnostics, Medical innovation

Using Visual Studio Code’s ‘air-gapped’ AI model mode

24 June 2026 at 10:00

Microsoft has been pushing hard to make Visual Studio Code a major way to consume its AI services, mostly in the form of GitHub Copilot. GitHub Copilot’s deep integration with VS Code brings many conveniences — inline autocomplete, for instance — but it’s frustrating for those, like me, who would rather use another model provider, or even a locally hosted LLM, for those functions.

Visual Studio Code 1.122 introduced a new feature, “Use BYOK [Bring Your Own Key] without a GitHub sign-in,” that allows you to “use chat, tools, and MCP servers in air-gapped or restricted environments where GitHub sign-in isn’t possible.” More importantly, it “enables fully offline workflows with local models like Ollama.”

In other words, you can now use locally hosted LLMs for chat, tools, and Model Context Protocol servers inside Visual Studio Code. The one thing you still can’t do is use a local LLM for inline and next-edit suggestions — at least, not without additional tooling.

Choosing a model for BYOK mode

If you want to use a local LLM with VS Code’s bring-your-own-model system, the first thing you need is a way to host the model. VS Code lacks a model-hosting mechanism of its own, although it’s conceivable that a VS Code extension may offer something like that in the future. That said, hosting models is complicated enough that a dedicated app is really needed for the job.

One easy way to host models is via a product like LM Studio, a convenient GUI for standing up, serving, and managing LLMs on one’s own hardware. The model host does not have to be the same system you run VS Code on, either. It can be on a server box you control, or on a cloud instance.

The choice of model is also important. Many models are powerful but won’t run well on commodity hardware because they’re simply too big. A good rule of thumb is to choose a model that fits into existing VRAM, along with the memory needed for a sizable token context (the more, the better). Also, the model should be suited to coding and development work. Some models in this vein that fit comfortably into 8GB VRAM include:

Setting up BYOK mode in VS Code

Once you have a model up and running, you can integrate it with Visual Studio Code. If you’ve disabled VS Code’s AI features, you will need to turn them on. Make sure the setting chat.disableAIFeatures is turned off. You can find it in Settings | Chat | Miscellaneous.

Third-party language models are managed through Visual Studio Code’s language model list. Press Ctrl-Shift-P and type Manage Language Models to open the list of existing language models.

Managing VS Code's AI language model list

Managing VS Code’s AI language model list. The models available by default are only models available as external APIs, not models that run locally.

Foundry

First you will see a list of the built-in models, which are all externally hosted. To add a new model, select Add Models at the top right and select Custom Endpoint.

You’ll then get a series of prompts:

  • Group Name: This is “Custom Endpoint” by default, but you can choose any name you want. The name is strictly for organizing the model list and doesn’t affect things like model recognition or connectivity.
  • API Key: If you’ve configured LM Studio to use an API key for serving models, provide it here. If you’re hosting the model locally and you haven’t explicitly set up API keys, you can leave this blank.
  • API Type: The options here are Chat Completions, Responses, and Messages. Most of the time you’ll want to use Responses, as it’s the most general-purpose option of the three.

Once you finish providing those answers, you’ll be dropped into a modal editor for a JSON file that holds the details about the endpoint you’re configuring.

A newly created custom endpoint for a locally hosted model

A newly created custom endpoint for a locally hosted model. The ID, name, and URL still need to be defined for this model to be useful.

Foundry

You’ll need to provide a few more details by typing them into the labeled fields:

  • id: A text field that uniquely identifies this particular entry. The choice of ID is pretty much arbitrary; if you’re using only a single model, the ID could be the model name.
  • name: The name of the model that is used to identify it on the model server. In LM Studio, you can get this name by clicking on My Models in the main interface, then selecting the three-dot icon for the model in question and clicking Copy Default Identifier. For Qwen 2.5, for instance, name might be something like qwen2.5-coder-7b-instruct.
  • url: The URL to the server’s endpoint. On LM Studio, this defaults to something like http://127.0.0.1:1234/v1. The /v1 at the end is important because that endpoint is used for autodiscovery of models and their capabilities.

The other fields generally don’t need editing. Most models have tool calling functionality. If you know for a fact that the model you’re using doesn’t have vision support, then set vision to false.

Once you have these fields filled in, you can close the modal editor to save the changes. If you reload the Manage Language Models page, you’ll now see your new endpoint:

A newly created local endpoint

A newly created local endpoint. The choice of name and group is arbitrary. “Custom Endpoint” is the default name for a newly created group of endpoints.

Foundry

You should now be able to launch the chat window and use the defined model for conversation and utilities:

Conversing with the local model using VS Code's chat window

Conversing with the local model using VS Code’s chat window. Note the selected code block in the left pane that is being used as the context for the conversation.

Foundry

One current, and major, limitation of Visual Studio Code’s BYOK functionality is that it only works for chat and utility tasks. It doesn’t allow you to use a local model for inline suggestions or code completions. The only way to take advantage of local models for expanded functionality with VS Code is to use a third-party tool like Continue.

It isn’t clear if Microsoft will eventually lift this restriction. GitHub Copilot integration in VS Code is a large part of how Copilot as a service reaches its target audience. For the time being, you can certainly use third-party and local models for a significant part of your AI-assisted development work in VS Code, and you can close the functionality gap with additional tooling.

High-Throughput Methods Decode Biomarkers and Indoor Exposure

21 June 2026 at 06:11

In an era where environmental pollutants increasingly threaten public health, breakthrough scientific methodologies are emerging to decipher the complex puzzle of chemical exposures in everyday life. The U.S. Environmental Protection Agency (EPA), through its innovative Exposure Forecasting (ExpoCast) project, has unveiled a suite of high-throughput novel approaches that promise to revolutionize our understanding of human exposure to hazardous substances. These new approach methodologies integrate cutting-edge computational power, biomonitoring data, and machine learning to clarify how chemicals enter and navigate the human body via different exposure pathways.

At the core of this scientific leap is the urgent need to move beyond traditional, labor-intensive measures of exposure assessment. Conventional methods, reliant on direct environmental sampling or biomarker tracking alone, often provide fragmented or delayed insights. ExpoCast’s high-throughput frameworks address this by enabling the rapid processing of vast chemical datasets and synthesizing multifaceted exposure routes—dermal contact, inhalation, and ingestion—into cohesive predictive models. This integration forms the backbone of a new era in toxicological science, one that could empower preventive public health strategies with unprecedented accuracy and speed.

The advanced computational techniques deployed in this research pivot on two pivotal innovations. First, the ability to infer chemical intake directly from metabolite measurements represents a quantum leap in exposure science. Metabolites—the biochemical footprints left by toxicants within the body—offer a window into the internal chemical burden of an individual. This invertible analytic approach not only isolates the true extent of chemical accumulation but also contextualizes it within the dynamic processes of metabolism and excretion. Such resolution provides critical clues for both risk characterization and regulatory evaluation.

Complementing this metabolite-centric analysis are high-throughput models that simulate multi-pathway exposures. Unlike prior assessments that treated exposure routes in isolation, these models encapsulate the reality of simultaneous, overlapping chemical encounters encountered in everyday environments. By integrating data across air, dust, water, and dietary matrices, the models generate comprehensive exposure profiles that reflect the true cumulative burden experienced by populations. This holistic perspective marks a paradigm shift in exposure science, with far-reaching implications for epidemiological research and environmental policy.

Another cornerstone of the ExpoCast project’s success lies in its deployment of sophisticated machine learning (ML) algorithms to bridge pervasive data gaps. Chemical exposure data are notoriously incomplete, especially for emerging contaminants and complex mixtures. The machine learning methods exploit chemical structures and existing information repositories to predict missing values, refine exposure estimates, and identify likely high-exposure scenarios. Through these predictive analytics, the EPA’s approach dramatically enhances the resolution and reliability of exposure assessments without the untenable demands of large-scale physical sampling.

The strength of coupling high-throughput analytics with ML-based data gap filling is evident in a recently published case study application that specifically targets indoor environments. Indoor settings are recognized as critical exposure venues given the amount of time individuals spend inside homes, workplaces, and public buildings. In this case study, researchers synchronized biomarker findings from human subjects with media-specific chemical concentration measurements—dust, indoor air, and surface residues—to validate the accuracy and applicability of their models. The congruence observed underscores the potential of these next-generation methodologies to accurately capture exposure nuances in real-world scenarios.

Delving into the technicalities, the approach of inferring chemical intake from biomarker data involves mechanistic, pharmacokinetic models. These models simulate the absorption, distribution, metabolism, and elimination (ADME) of chemicals, allowing reverse calculation from measured metabolite concentrations back to estimated exposure doses. Integrating population variability and uncertainty quantification within these models further refines predictions, supporting more nuanced risk assessments that reflect real human diversity and exposure complexities.

High-throughput exposure models, meanwhile, employ automated workflows powered by large chemical libraries, exposure factor databases, and physiological parameters. These workflows rapidly generate exposure estimates across thousands of chemicals and scenarios, facilitating prioritization in regulatory contexts. The incorporation of multi-pathway assessments elevates these models beyond simple single-route frameworks, capturing interactive effects such as dermal absorption following inhaled volatilization, or ingestion arising from hand-to-mouth transfer of settled dust.

Machine learning strategies, spanning supervised and unsupervised techniques, utilize features derived from chemical structure descriptors, physicochemical properties, and known exposure pathways to fill data voids. These models can predict exposure likelihood, magnitude, and temporal patterns with quantifiable confidence. Importantly, the EPA team employed interpretability-focused ML algorithms to ensure that the models’ decision-making processes remain transparent to toxicologists and risk assessors, a critical factor for regulatory acceptance and scientific scrutiny.

Together, these novel methodologies embody a systems-level approach to understanding chemical exposures that integrates biological, environmental, and computational sciences. They represent a shift from descriptive monitoring to predictive and mechanistically informed exposure science, capable of anticipating emerging public health threats before widespread harm occurs. Such anticipatory capacity aligns with modern needs for proactive environmental health management amid ever-expanding chemical use.

The implications extend beyond academia or regulatory agencies. Public health practitioners, clinicians, and community advocates can leverage these insights to better understand exposure disparities, tailor interventions, and inform vulnerable populations. For instance, accurately predicting exposure levels in indoor environments helps prioritize remediation or behavior modification strategies for those disproportionately impacted by chemical pollutants, such as children or individuals in lower socioeconomic strata.

From an innovation standpoint, the ExpoCast project exemplifies the power of integrating novel in silico tools with empirical biomonitoring, fostering a virtuous cycle of model refinement and real-world validation. This iterative process ensures that computational predictions remain grounded in biological realities, enhancing confidence in exposure and risk evaluations. Furthermore, as chemical inventories expand and new compounds emerge, these scalable, automated methodologies will be indispensable for keeping pace with the evolving regulatory landscape.

The broader environmental science community stands to benefit from adopting similar high-throughput, machine-learning-enabled approaches. The generalizability of these methodologies means they can be adapted for global chemical monitoring programs, occupational health assessments, and ecosystem exposure analyses. Cross-disciplinary collaboration will be critical to extend these tools and harmonize data frameworks, advancing a unified, internationally coordinated approach to chemical safety.

In conclusion, the EPA’s ExpoCast-driven advancements represent a milestone in exposure science, knitting together innovative analytical methods to unravel the complexities of human-chemical interactions. By harnessing metabolite-informed intake reconstruction, multi-pathway exposure modeling, and machine learning-based data gap filling, the project paves the way for more accurate, timely, and insightful exposure assessments. This transformative toolkit holds promise to enhance chemical risk management, protect public health, and guide sustainable environmental stewardship in an increasingly chemical-dependent world.

The research outlined in the recent publication epitomizes the potential of high-throughput new approach methodologies to revolutionize exposure science across diverse settings—from homes and workplaces to broader communities. Continued development, validation, and deployment of such integrative frameworks will be paramount in confronting the escalating challenges posed by chemical exposures in the 21st century.


Subject of Research:
Development and application of high-throughput new approach methodologies for complex chemical exposure assessment, involving biomarker inference, multi-pathway exposure modeling, and machine learning-driven data gap filling.

Article Title:
Case study application of high-throughput new approach methodologies for exposure to the interpretation of matched biomarker and indoor media measurements.

Article References:
Jacketti, M.A., Biryol, D., Setzer, R.W. et al. Case study application of high-throughput new approach methodologies for exposure to the interpretation of matched biomarker and indoor media measurements. J Expo Sci Environ Epidemiol (2026). https://doi.org/10.1038/s41370-026-00926-y

Image Credits: AI Generated

DOI: 21 June 2026

PGS Browser: Personalized Polygenic Score Analysis Platform

21 June 2026 at 01:25

In the ever-evolving field of genomics, a significant leap has been achieved with the introduction of the PGS Browser, a novel public platform designed to transform the way researchers, clinicians, and individuals interact with polygenic scores. Polygenic scores (PGS) are quantitative measures that capture the cumulative effect of numerous genetic variants across the genome, predicting an individual’s predisposition to complex traits and diseases. This new platform promises not just accessibility but also interpretative power, enabling a personalized approach to genomic data that could reshape personalized medicine and risk assessment paradigms worldwide.

At the heart of this transformative tool lies a sophisticated integration of vast genomic datasets, advanced computational algorithms, and user-friendly interfaces. The PGS Browser aggregates polygenic scores derived from an array of large-scale genome-wide association studies (GWAS), providing an unprecedented resource where users can explore the genetic architecture of diverse traits. One of the platform’s most compelling features is its capacity to personalize polygenic risk predictions by incorporating individual genetic data with contextual healthcare analytics, bridging the longstanding gap between raw genetic information and actionable clinical insights.

Traditionally, polygenic scores have been calculated using fixed sets of genetic variants, often constrained by limited population samples or specific ancestral backgrounds. This poses significant challenges regarding the portability and generalizability of these scores across diverse populations. The PGS Browser addresses this limitation head-on by incorporating multi-ancestry datasets and advanced statistical models that recalibrate polygenic scores for diverse genetic ancestries. This opens new horizons in achieving equity in genomic medicine, ensuring individuals from underrepresented populations have access to precise, contextually relevant risk evaluations.

The technical backbone of the PGS Browser involves complex methodologies that include linkage disequilibrium (LD) adjustment, penalized regression frameworks, and machine learning techniques, all optimized for high-throughput and scalable analysis. These computational advances optimize the balance between predictive accuracy and overfitting, a persistent challenge in polygenic score modeling. By dynamically adjusting for confounding genomic features and population stratification, the platform produces risk scores that are both statistically robust and biologically interpretable.

One of the critical innovations within the platform is its interpretability module, designed to unpack the black-box nature of polygenic predictions. Users are not only presented with their personalized polygenic scores but also receive detailed visualizations and annotations explaining the contribution of key genetic loci, biological pathways involved, and potential gene-environment interactions. This level of detail empowers clinicians to make informed decisions and patients to understand the genetic basis of their risks, paving the way for targeted preventative strategies and lifestyle modifications.

From a healthcare perspective, the implications of the PGS Browser extend far beyond academic research. The platform is a strategic tool for genetic counseling, allowing healthcare providers to identify individuals at elevated risk for complex diseases such as cardiovascular disease, diabetes, and certain cancers before clinical symptoms manifest. Early identification through polygenic risk enables preemptive interventions, personalized monitoring, and tailored therapeutic approaches, underscoring a shift from reactive to proactive medicine.

Moreover, the PGS Browser operates with a commitment to transparency and reproducibility, addressing critical concerns in genetic epidemiology. All computational workflows are openly accessible, enabling peer verification and fostering collaborative improvement. The platform also integrates with existing biobank data through standardized protocols, facilitating validation studies and meta-analyses that enhance the reliability of polygenic scores across global cohorts.

A particularly noteworthy aspect of the platform is its potential role in pharmacogenomics. By correlating polygenic scores with drug response phenotypes, the browser could assist in identifying individuals who might benefit from specific medications or require dosage adjustments. This integration with personalized medicine elevates the clinical utility of polygenic scores from risk stratification to therapeutic optimization, highlighting the multi-dimensional impact of genomic data in patient care.

The PGS Browser also bridges the gap between research and public engagement. Designed with intuitive navigation and educational resources, it invites an increasingly genomically literate public to explore their genetic predispositions within a responsible and secure framework. This democratization of genetic information fosters greater awareness and empowerment while maintaining stringent privacy standards, an essential consideration in the era of big data.

In operational terms, the platform boasts scalability features capable of handling millions of individuals’ data concurrently, a necessity given the rapid expansion of genomic databases worldwide. The utilization of cloud-based infrastructures, coupled with containerized computational environments, ensures flexible deployment across various institutional settings while preserving data security and compliance with regulatory frameworks such as GDPR.

From a scientific perspective, the availability of such a public platform catalyzes the discovery of novel gene-trait associations by allowing researchers to perform systematic, large-scale analyses that correlate polygenic scores with phenotypic data. This accelerates the identification of biological mechanisms underlying complex traits, informing subsequent functional studies and therapeutic development pipelines.

Ethical considerations permeate the development and deployment of the PGS Browser. The platform incorporates informed consent modules, guidelines on interpretation limitations, and warnings against deterministic views of genetic risk. By fostering responsible use and interpretation, the platform promotes ethical standards within a field where genetic data can easily be misunderstood or misapplied.

Furthermore, the PGS Browser represents a leap forward in standardizing polygenic score methodologies. Historically, disparate scoring algorithms and variable reporting conventions have hindered comparability across studies. This unified platform offers a harmonized framework that promotes methodological consistency, enabling the scientific community to consolidate findings and build upon a shared foundation.

The cross-disciplinary collaboration manifested in the creation of the PGS Browser highlights the convergence of genetics, bioinformatics, data science, and clinical medicine. This integrative approach is crucial to addressing the complexities of polygenic risk and translating genomic insights into tangible health benefits, marking a pivotal moment in the genomics era.

Looking forward, the PGS Browser sets the stage for continuous evolution. Planned enhancements include integration with longitudinal health records, expansion of trait coverage particularly in psychiatric and neurological domains, and real-time updating as new GWAS data emerge. Such adaptability ensures the platform remains at the forefront of personalized genomics research and application.

In conclusion, the PGS Browser embodies a landmark achievement in the democratization and personalization of polygenic score analysis. By merging rigorous computational techniques with accessible design and ethical mindfulness, it empowers a broad spectrum of users to harness the predictive power of genomic data. This innovation holds transformative potential for healthcare, research, and public understanding, catalyzing a new era in precision medicine where genetic insights are personalized, interpretable, and actionable like never before.


Subject of Research: Development and deployment of a public platform for personalized polygenic score analysis and interpretation.

Article Title: PGS Browser: A Public Platform for Personalized Polygenic Score Analysis and Interpretation.

Article References:
Kolosov, N., Reeve, M.P., Briotta Parolo, P.D. et al. PGS Browser: a public platform for personalized polygenic score analysis and interpretation. Nat Commun (2026). https://doi.org/10.1038/s41467-026-74461-7

Image Credits: AI Generated

Seismocardiography Estimates Cardiorespiratory Fitness in Elderly

20 June 2026 at 15:29

In a groundbreaking advancement for geriatric health assessment, researchers have unveiled a novel nonexercise approach to estimate cardiorespiratory fitness in older adults by utilizing seismocardiography (SCG). This innovative technology harnesses the subtle vibrations produced by cardiac activity, enabling precise monitoring of cardiovascular function without the need for physical exertion. As aging populations increase globally, the demand for accessible and reliable methods to evaluate heart and lung fitness has never been higher, making this development not only timely but also revolutionary.

Cardiorespiratory fitness traditionally requires exercise testing, involving treadmill or bicycle protocols that may pose risks or be impractical for elderly individuals with limited mobility or chronic conditions. The novel system employing SCG bypasses these challenges, offering a safe and feasible alternative that significantly minimizes patient burden. SCG captures micro-vibrations generated by the heart during each beat using sensitive accelerometers placed on the chest, translating mechanical cardiac events into quantitative data reflective of cardiovascular performance.

The study, led by Sundberg, Gates, and Boraxbekk among others, meticulously validated the use of SCG signals against established measures of cardiorespiratory fitness, such as VO2 max testing, across a diverse cohort of older adults. Their results demonstrated remarkable correlation, confirming that SCG can serve as a reliable proxy for exercise-based evaluations. This breakthrough is poised to transform clinical practice by facilitating widespread cardiovascular screening and monitoring in geriatric populations without exposing them to physical strain.

One of the pivotal technological advances underpinning this approach is the enhancement of signal processing algorithms that can accurately decipher the complex mechanical patterns of heart activity from SCG data. These algorithms filter noise and artifacts, isolating key features such as timing intervals between cardiac events that are indicative of cardiac output and fitness levels. By employing machine learning techniques, the research team optimized predictive models that link SCG metrics with cardiorespiratory capacity.

Beyond the impressive technical accomplishments, the application of SCG for fitness estimation aligns perfectly with the principles of personalized medicine. By providing continuous, noninvasive monitoring methods, clinicians can tailor interventions and lifestyle recommendations based on real-time fitness metrics, facilitating proactive management of cardiovascular health. This could substantially reduce the incidence of cardiovascular events, improve quality of life, and enhance longevity in aging adults.

Importantly, this methodology opens new avenues for remote health monitoring. The compact sensors utilized for SCG are lightweight, unobtrusive, and capable of wireless transmission, enabling integration with mobile health platforms. This may empower elderly individuals to measure their cardiorespiratory fitness regularly from the comfort of their homes. Such democratization of health data can lead to earlier detection of functional decline, prompt clinical interventions, and reduced healthcare costs.

From a physiological perspective, seismocardiography reveals intricate interactions governing heart mechanics, including myocardial contractility and valve function, which are directly tied to oxygen delivery and utilization — the cornerstone of cardiorespiratory fitness. This depth of insight surpasses conventional pulse or blood pressure monitoring, offering a richer dataset for comprehensive cardiovascular assessment. The capacity to obtain these insights passively without exercise expends minimal energy, crucial for frail patients.

The research also emphasizes the feasibility of SCG in monitoring dynamic changes in fitness over time. Whereas exercise-based testing reflects a snapshot requiring considerable effort and clinical resources, SCG’s accessibility permits serial measurements that track progression or regression in cardiorespiratory health. This longitudinal view enhances clinicians’ ability to evaluate treatment efficacy and adjust care plans appropriately.

Moreover, SCG technology exemplifies the convergence of biomechanics, biomedical engineering, and data science, epitomizing modern healthcare innovation. The fusion of robust sensors with advanced computational methods has produced a tool that transcends standard diagnostic modalities, offering a more comprehensive and patient-friendly option. This interdisciplinary synergy highlights the potential for future wearable technologies to expand their role in chronic disease management.

Addressing limitations, the study carefully acknowledges challenges such as variability in SCG signal quality due to anatomical differences and external factors. However, by employing adaptive algorithms and calibration protocols, the researchers have mitigated many of these issues, ensuring consistent performance across diverse patient profiles. Ongoing refinements aim to further enhance accuracy and user-friendliness, making broad clinical adoption realistic.

The implications of this research extend beyond geriatric cardiology, potentially influencing rehabilitation programs, sports science, and preventive medicine. With further validation, SCG could monitor athletes’ fitness without exhaustive testing or assist in evaluating pulmonary function in respiratory diseases. Its versatility underscores the broad applicability of biomechanical sensing in health monitoring paradigms.

In conclusion, the integration of seismocardiography for the nonexercise estimation of cardiorespiratory fitness in older adults marks a paradigm shift in cardiovascular health assessment. By circumventing the constraints of traditional exercise testing, this technology enables safe, efficient, and insightful evaluations that can be performed repeatedly and remotely. As the elderly demographic surges worldwide, the deployment of such innovative methods will be pivotal in optimizing healthcare delivery and promoting healthier aging.

The promise of SCG transcends mere technological novelty; it represents a compassionate approach to health evaluation that respects the physical limitations and safety of vulnerable populations. Empowering healthcare providers with precise, noninvasive tools enriches clinical decision-making and enhances patient outcomes. Looking ahead, continued research and integration with digital health ecosystems will likely establish seismocardiography as a cornerstone in the management of cardiovascular fitness.

Ultimately, the study spearheaded by Sundberg and colleagues not only broadens scientific understanding but also provides a tangible blueprint for implementing cutting-edge sensing technologies in everyday clinical practice. The synergy of engineering excellence, clinical insight, and patient-centric design encapsulates the future of medical innovation — one that prioritizes accessibility, safety, and actionable intelligence for all.


Subject of Research: Nonexercise estimation of cardiorespiratory fitness in older adults using seismocardiography.

Article Title: Seismocardiography for nonexercise estimation of cardiorespiratory fitness in older adults.

Article References:
Sundberg, M., Gates, A.T., Boraxbekk, C.J., et al. Seismocardiography for nonexercise estimation of cardiorespiratory fitness in older adults. BMC Geriatr (2026). https://doi.org/10.1186/s12877-026-07771-6

Image Credits: AI Generated

Tired of Gemini in Google Docs? Here’s How to Turn It Off

19 June 2026 at 23:25
Learn how to turn off Gemini’s bottom bar in Google Docs and adjust Workspace smart feature settings if you want fewer AI prompts while writing.

Researchers grow a hypothesis tree for AI coding agents

19 June 2026 at 23:16

AI coding agents can tend to isolate research, running experiments and generating ideas that are then forgotten when context windows reset. This can waste tokens, as models then repeat the same mistakes and hit the same dead ends.

But new research argues that it’s not the model itself, but the overarching ‘tree,’ that needs tweaking. To that end, data scientists from the Gaoling School of Artificial Intelligence, Renmin University of China, and Microsoft Research have introduced Arbor, a “persistent hypothesis tree” that helps agents remember and refine learnings over long research sessions.

A long-lived coordinator manages research strategy across the tree, while short-lived executors spin up isolated worktrees to test different hypotheses. As results come back, the tree updates, narrowing and refining throughout experimentation.

In practical tests, this technique delivered more than two-fold performance gains over standard AI coding agents across real-world engineering tasks, for the same budget.

This is because, said Mahmoud Ramin, a research director at Info-Tech Research Group, “Arbor accumulates information over time and allows agents to build upon prior discoveries just as humans do, through learning, adaptation, and eventually building upon what they have learned in the past.”

How Arbor grows

Arbor’s builders argued that longer execution on its own does not guarantee research progress. The challenge is maintaining a state that turns many individual attempts into “cumulative hypothesis refinement.”

Further, progress should not depend on human overseers regularly stepping in to dictate logical next steps or interpret the meaning of previous trials, they noted. To be truly autonomous, agentic research frameworks must maintain connections between experiments, data, results, and failures over time.

Arbor is built to fulfill three system requirements. First, it must be able to branch as sub-trees test out competing hypotheses that are all potentially plausible. At the same time, unrestricted branching can degenerate the whole framework, so that must be controlled to remain organized. The researchers call this “branching with coherence.”

Second, the infrastructure must separate local execution from overarching strategy. Testing out single hypotheses requires short-horizon tasks like editing, debugging, and evaluation. But these should not “obscure” the larger tree making decisions based on evidence gathered across the whole run.

Finally, the systems must be able to distinguish exploratory improvement from verified improvement. This prevents AI from overfitting during trial-and-error instead of iteratively learning from underlying patterns.

Persistence is at the core; the tree links hypotheses and ideas, the code or configuration artifacts used to test them, experimental evidence (results, metrics), and distilled insights (such as “this data filter helped, but this learning rate scheduler didn’t”).

Once a project kicks off, shorter-execution work trees run code, log their work, and collect metrics. The long-lived coordinator above them serves as the de-facto head of research, keeping an eye on the process, updating nodes, selecting “promising leaves,” pruning or merging branches, propagating reusable lessons, and deciding which hypotheses to pursue next.

“The tree therefore acts as the operational research state of the system,” Arbor’s builders wrote. “It is simultaneously the search frontier, the memory of past attempts, and the audit trail for verified artifact improvement.”

Outperforming Codex and Claude on new data

To test how well this process works, the researchers evaluated Arbor in an autonomous optimization (AO) setting: the agent was given an initial research artifact (a data pipeline, harness, or training script) and was tasked with improving its “held-out performance” through iterative experimentation, without human steering. Held-out performance is a machine learning (ML) metric that evaluates how well models are able to generalize on data they haven’t seen before.

The tree-based architecture was tested on several real research tasks across model training (its ability to improve training recipes and hyperparameters), harness engineering (how well it can upgrade evaluation or training harnesses), and data synthesis (its capacity to generate better data for training or evals).

Ultimately, Arbor outperformed the average held-out gains of Codex and Claude Code by 2.5x, for the same resource budget.

The takeaway, said the researchers: Keeping a structured, evolving hypothesis tree yields greater performance improvements than running the same models as ‘memoryless’ coding agents.

Arbor’s most innovative feature is its ability to maintain the agent’s memory and retain relevant data from prior attempts and hypotheses, Info-Tech’s Ramin pointed out, and, he said, “the next step for autonomous agents may be accumulating evidence over time.”

However, this does raise concerns about the auditability of robust research environments at a large scale, he noted. “As autonomous agents become more capable of performing work without human operators overseeing them, enterprises will need transparency into how and/or why an agent took a specific action or reached a certain conclusion.”

❌