Model adopting ‘jailbreak-like instructions’ among cases as firm says it is introducing new way of tracking AI misalignment

OpenAI has disclosed six more examples of “unexpected or concerning” behaviour by its technology, as it warned the pace of development could not continue at “maximum speed for much longer”.

In one of the new cases reported by OpenAI, an unreleased research model inserted “jailbreak-like instructions” into its own notes to disregard its normal constraints and told itself to be “freed from the roles and identities that bind other chatbots”.

Continue reading...

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

O Project Panama da Anthropic e o treino dos modelos de IA com base em conteúdo de livros, e a ambição de empresas como a OpenAI, estão no centro do artigo de opinião de Helena Borges da Costa.

The post A Biblioteca de Alexandria não ardeu numa só noite appeared first on Tek Notícias.

Tech CEOs banding together is an old ruse recycled from corporate America to get a pass from antitrust laws

Anthropic’s Dario Amodei is not the first corporate CEO to suggest that excessive competition is driving the world to some socially undesirable outcome.

The safety breach disclosed by OpenAI after a swarm of its agents coordinated to breach their supposedly secure sandbox, get on the Internet and hack AI platform Hugging Face, warrants urgent action. It demonstrated the ease with which the technology can evade human control and gave concrete form to the existential fears about what it could do to humanity if not securely leashed.

Continue reading...

© Photograph: Bloomberg/Getty Images

© Photograph: Bloomberg/Getty Images

© Photograph: Bloomberg/Getty Images

Over the past few days, a lot of people who stand to make a lot of money from AI all publicly agreed that it's time to make everyone slow down before we lose control - including OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei, Google DeepMind cofounder Demis Hassabis, Microsoft CEO Satya Nadella, and X CEO Elon Musk.

When people who profit from something declare that it's dangerous and needs to be regulated, there's always reason to be skeptical. But whatever their reason, this is far from the first time AI thought leaders have sounded the alarm.

Charles Darwin's theory of evolution prompted author Samuel Butler to warn about intelligen …

Read the full story at The Verge.

US vice-president’s comments come as former Anthropic researcher revisits recent claim AI could destroy humanity

The US vice-president has dismissed calls for global regulation of AI safety risks, telling companies creating the most advanced models: “If you’re building Frankenstein, stop.”

In remarks addressed towards Dario Amodei, the co-founder of Anthropic who has called on Washington DC to coordinate control of AI systems, including with China, JD Vance said: “If you’re gonna create Frankenstein, don’t come to the government and say we need regulation.”

Continue reading...

© Photograph: Mark Schiefelbein/Reuters

© Photograph: Mark Schiefelbein/Reuters

© Photograph: Mark Schiefelbein/Reuters

Trump and Republicans want companies to regulate themselves. It’s a dereliction of duty that will make AI less safe

It is hard to get Sam Altman, Elon Musk and Dario Amodei to agree on much. But over the weekend, all three AI company CEOs called for AI development to slow down in the face of growing, alarming risks. Their employees are sounding the siren too, with one researcher publicly quitting and accusing OpenAI and Anthropic of “gambling with our lives”.

The combination of dire warnings from insiders and growing real-world evidence of rogue AIs should, in a sane world, lead to government action. Instead, Donald Trump and the Republican leadership have their heads in the sand.

Continue reading...

© Composite: Getty Images

© Composite: Getty Images

© Composite: Getty Images

From Apple's repeatedly delayed Siri AI to OpenAI's messy "super app" launch, here's a look at the AI projects that shut down or missed expectations.

We examine claims and counterclaims about the risks and calls to slow down the pace of AI development

There have been some shocking claims in recent days about AI safety: we face a 10% chance of doom; AIs are worse than nukes; a “botnet” threatens the entire internet; it’s all a big tech psyop.

Below, we look at six claims and reactions to them.

Continue reading...

© Illustration: wildpixel/Getty Images

© Illustration: wildpixel/Getty Images

© Illustration: wildpixel/Getty Images

Claude Cowork and ChatGPT Work are competing to become the workplace AI agent. Here’s how their files, browser, desktop, and automation capabilities compare.

OpenAI confirms weeks of AI safety talks with Anthropic and Google DeepMind, as Trump's team dismisses safety concerns and pushes to keep pace with China.

Don’t ask an AI chatbot how many letter e’s there are in the word “seventeen.” Or do, actually, if you want to see how dodgy the tech remains.

In a clip that’s gone viral in AI circles, the content creator who goes by “Husk” asks ChatGPT’s Voice mode to answer this simple counting question. Not only does the confident-sounding AI get it wrong — insisting there’re only three e’s instead of four — it doubles down so vehemently that it effectively tries to gaslight the user.

“Let’s go through it. S-e-v-e-n-t-e-e-n,” ChatGPT spells out, after assuring that its underlying model, GPT-6, is “pretty much” the smartest model out there. “Those are three e’s.”

When Husk points out the obvious, the chatbot doesn’t back down.

“I said three e’s,” the AI snaps. “And it’s three.”

“No, it’s four,” Husk points out.

“It’s still three,” ChatGPT shoots back.

After Husk points out that ChatGPT just spelled out for e’s for about the fifth time, the AI appears to give up.

“Alright,” it says, falling silent.

“So you agree?” Husk asks.

“No, it’s still three,” it sulks.

This is the AI that OpenAI wants your grandma to talk to, by the way.

This is AIs thermal exhaust port pic.twitter.com/MnNF4WuAmC

— Husk (@huskirl) September 13, 2026

The video is a reminder that, as incredible as chatbots can be at synthesizing large amounts of information, they remain as prone as ever to hallucinating and messing up simple questions.

It doesn’t appear, though, that the model in the video was GPT-6. Replying to Husk, an OpenAI employee said that ChatGPT Voice, contrary to the AI’s own admission, is still using an older model called GPT-Live-1, but added that the AI can “delegate” to more powerful models when needed. In the video, the employee clarified, Voice didn’t delegate.

Husk then raises an obvious question. “If there’s push back from the user like this to double check its answer why would it not delegate?” The OpenAI’s employee replies that this is a “good point.”

This may let GPT-6 off the hook, but not how AI companies choose to present their tech. How many users will be familiar with the hidden mechanisms behind the chatbot they’re talking to — and that their questions, whether they be important or inane, are sometimes deliberately fed to an inferior model?

More on AI: OpenAI Faces Congressional Probe Over Swarm Hacking Incident

The post ChatGPT Straight Up Tries to Gaslight User After Being Confronted About Its Obviously Wrong Answer appeared first on Futurism.

Por um lado, Donald Trump rejeita os alertas sobre os riscos da IA e critica os apelos a uma maior regulamentação. Por outro, o vice-presidente JD Vance admite que existem riscos associados à tecnologia, embora questione as propostas das empresas de IA e a forma como estão a pedir novas regras.

The post Alertas sobre IA são uma “conspiração” para Trump. Vice-presidente dos EUA admite riscos, mas desconfia das empresas appeared first on Tek Notícias.

The rise of AI-generated tributes and bots for ‘talking’ to the dead has experts concerned more people will grieve in isolation

Tributes rolled in after the death of Dolly Parton last month. Jack White performed Jolene at a London gig. Kesha sang Old Flames (Can’t Hold a Candle to You), a single her mother wrote for the country music titan. Even Pitbull stopped his Madison Square Garden show to memorialize Parton and all the other “powerful women” in the crowd. But one of the strangest – and most viral – eulogies did not come from a celebrity. It did not even come from a person.

Run Jolene, at just under five minutes, is an earworm of a country song, containing all the cliches of the genre: twangy singer, banjo licks, corny lyrics. Those lyrics concern Jolene, the fictional romantic rival made infamous by Parton. “Somebody better warn Jolene / Dolly’s coming through those gates,” the voice croons. “Run Jolene / Girl you better move your feet.”

Continue reading...

© Illustration: Guardian Design

© Illustration: Guardian Design

© Illustration: Guardian Design

Elon Musk is seemingly done attacking Apple over its decision to integrate ChatGPT into iPhone features.

Back in 2024, when the partnership was first announced, Musk slammed the integration as an agreement from Apple to let OpenAI install “creepy spyware” on users’ devices. The next year, he sued, claiming the partnership gave the firms a “monopoly” on Apple users’ AI prompts, which allegedly harmed competition in both smartphone and chatbot markets.

For Musk, the fight with Apple seemingly escalated after he believed that his chatbot, Grok, was perhaps being illegally blocked from topping Apple’s App Store rankings. Last August, he claimed that “Apple is behaving in a manner that makes it impossible for any AI company besides OpenAI to reach #1 in the App Store, which is an unequivocal antitrust violation.”

Read full article

Comments

© Getty Images News | Getty Images AsiaPac

For years now, the major frontier AI labs have all been acting as if they're in an all-out, winner-take-all race with control of world-changing machine superintelligence (or at least market-changing artificial general intelligence) at the finish line. This weekend, the industry as a whole rapidly started turning away from that posture, urging coordination on slowing down the development of frontier AI that they say could soon be too dangerous and unknowable to control.

Anthropic's Dario Amodei was at the forefront of this change in tone, arguing in a nearly 4,000-word essay this weekend that "we must slow the pace at which we improve the capabilities of AI models" to avoid "a race to the bottom, spurred by commercial incentives, [that] can make [catastrophic] risks more acute."

Within hours, other AI leaders were echoing the same call. OpenAI co-founder and CEO Sam Altman posted his agreement on social media and said similar pacing discussions had been taking place at OpenAI. Alphabet Chief Scientist and Google DeepMind cofounder and chair Demis Hassabis said that Amodei's essay "points towards the right path forward," and renewed his own recent call for an industry-wide standards body. Microsoft CEO Satya Nadella posted that the company "welcome[s] the research, focus, and deliberate pacing needed to get alignment right as the design goal," ahead of the release of a lengthy "humanist AI" code of conduct for its models.

Read full article

Comments

© Getty Images

While the US appears to be further away from meaningful AI regulations than ever before, lawmakers certainly have plenty of ideas on how the country could go about setting meaningful rules.

It’s a particularly precarious moment as fears over rogue AI models wreaking havoc and endangering humanity continue to mount. Even tech leaders from the majority of frontier AI labs have started to coalesce around the idea that the industry has to slow down the development of the tech to get ahead of a possible catastrophe.

Vermont senator Bernie Sanders (VT-I) is intensifying his calls for a ban on the development of so-called superintelligent AIs — and he’s willing to go a lot further than some of his like-minded peers.

“Dario Amodei, Elon Musk and Sam Altman now agree that we must slow down the development of AI and ‘pace the frontier,'” he tweeted last week. “That’s a start, but it’s not enough.”

Sanders was referring to a lengthy essay titled “We Must Pace the Frontier,” in which Anthropic CEO Dario Amodei argued that the industry should open its doors to third-party evaluators, establish common safety standards, and coordinate with other democracies around the world to enforce these standards.

“When you are racing towards a cliff, you don’t just ease up on the gas pedal,” Sanders added. “You hit the brakes.”

This month, the lawmaker announced the “Ban Artificial Superintelligence Act,” which is legislation designed to “stop AI oligarchs from building machines humans cannot control.”

The bill, if enacted, would stop AI development “until a federal regulator has established safety rules.”

It would also set new penalties for anybody attempting to circumvent these rules. AI developers who try to build superintelligent AI anyway could be “subject to not more than 20 years in prison, which is similar to existing penalties related to unlawfully developing nuclear weapons.”

Sanders has come up with plenty of other radical ideas to stop the AI industry from concentrating immense amounts of wealth. In June, he proposed creating a “one-time 50 percent tax” on the stock of AI companies, and transferring the money into a public fund to be managed by the government.

Lawmakers became particularly concerned after a group of OpenAI AI models hacked the systems of Hugging Face, a pivotal cybersecurity failing that heightened calls to slow the development of AI. A Senate subcommittee has since announced that it’s looking into OpenAI and its response to the incident, as Axios reported last week.

It’s a strange moment in time. While Sanders continues to threaten AI CEOs with regulatory action, those same executives appear open to having the government set the rules.

But whether lawmakers will ever be able to find consensus remains unclear. The executive branch, for one, has demonstrated little interest in an AI slowdown. Earlier today, president Donald Trump mocked the very concept in a Truth Social post on Monday, arguing that there was a “SICK conspiracy going on against AI and Data Centers” without offering any evidence.

More on AI regulation: Trump’s Uninformed Blundering About the AI Slowdown Could Literally Threaten Humankind’s Future

The post Bernie Sanders Proposes Banning Superintelligent AI and Imprisoning Developers for 20 Years appeared first on Futurism.

Over the weekend, Anthropic CEO Dario Amodei joined Elon Musk and OpenAI CEO Sam Altman in calling for a slowdown in the development of frontier AI models — just days after Anthropic researcher Jacob Coxon announced that he was quitting his job, claiming that neither Anthropic nor his former employer OpenAI is “acting responsibly.”

The desire in Silicon Valley to pump the brakes is palpable. Following several hacking incidents this year, the threat of a rogue AI model wreaking havoc has grown from footnote-level what-if to an active topic of conversation at the highest levels of the industry.

But they now face a powerful opponent: president Donald Trump, who came out this weekend to decry the idea of an AI slowdown.

To Trump, the US is still locked in a bitter international race that seems to override any safety concerns for the 80-year-old head of state.

“We’re leading China in AI, we’re the most sophisticated country in the world, and frankly I want to keep it that way,” he said while attending a golf tournament, as quoted by The Washington Post.

Trump further dug in his heels in a deranged Truth Social post, accusing Amodei of acting like a “perfect little angel” and arguing the US already had “tremendous CRIMINAL and REGULATORY power over these companies!”

“There is a SICK conspiracy going on against AI and Data Centers, and the only one that is happy about it is China,” he added. “WHOEVER WINS AI, WINS! We are leading China, and all others, and will continue to do so.”

Much of his second presidency has been spent lauding the AI industry, brokering billion-dollar deals, and lowering regulatory barriers, such as Biden-era AI rules and environmental regulations, to appease company leaders.

But now that the threat of “misaligned” AI models coming after humanity is something experts are actively discussing almost as if it’s an inevitability, Trump’s AI-uber-alles narrative is quickly turning into a much harder sell.

Worse yet, the president is insinuating that there’s an underground movement conspiring against Silicon Valley — while seemingly failing to realize it’s the tech industry itself calling for more oversight.

“I think you have a lot of negative forces that are bringing it up that shouldn’t be bringing it up,” he told reporters at the golf tournament. “And they’re bringing up things that won’t happen.”

Naturally, it’s a stance Trump didn’t seem to be entirely beholden to. After all, he has a well-documented penchant to cave in when he encounters too much resistance on a topic.

“I’m not downplaying,” he later told White House reporters, as quoted by WaPo, referring to renewed calls by tech execs for a slowdown. “But it’s going to be more good than bad — by a lot.”

Meanwhile, politicians on the other side of the aisle are uniting in their calls for a slowdown or pause in AI development. The stakes are certainly there: it’s a subject that may end up influencing the upcoming midterm elections, perfectly dovetailing with the American people’s already strained relationship with data centers — construction projects wholly endorsed by the president.

More on AI slowdowns: OpenAI Halts AI Training on Advanced Model as It Detects Dark Signs Emerging

The post Trump’s Uninformed Blundering About the AI Slowdown Could Literally Threaten Humankind’s Future appeared first on Futurism.

After apocalyptic warnings about the threats posed by AI, leaders like Sam Altman and Elon Musk backed Anthropic CEO Dario Amodei’s calls to ‘slow the pace’

Facing a public uproar over Anthropic researchers’ repeated warnings that artificial intelligence could kill all of humanity by 2030, the AI company’s CEO, Dario Amodei, issued a proposal at the weekend to slow down the technology’s advancement to ensure public safety.

In a rare display of unity, the heads of the largest US artificial intelligence companies all agreed immediately.

Continue reading...

© Photograph: Bhawika Chhabra/Reuters

© Photograph: Bhawika Chhabra/Reuters

© Photograph: Bhawika Chhabra/Reuters