Warnings From Inside The Lab Congress has ignored AI existential-risk arguments for three years, largely because they arrived

Attack Campaigns Run By Software The operator who used to type every command now mostly supervises. That is

Report comes two days after former employee quit claiming company’s models could cause human extinction by 2030

Criminals, state-sponsored groups, spyware vendors, scientists and propagandists have attempted to use Anthropic’s powerful artificial intelligence models to design missiles and bombs, create deadly pathogens and surveil dissidents, according to a threat intelligence report the company published on Thursday.

“The cases we share here aren’t typical misuse, but rather examples of the most notable and novel threat activity we’ve identified to date,” Anthropic wrote in its 154-page report. “We’re publishing this work because we believe we have a responsibility to disclose malicious misuse of our services.”

Continue reading...

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

Insiders at the firm fear tech’s advancement could cause human extinction, while others are calling their declarations of concern a ‘setup’

A day after a former researcher at Anthropic made an apocalyptic declaration about artificial intelligence, more researchers and staff members at the AI startup publicly agreed with him and posted their own dire warnings.

In response, Elon Musk and other conservative figures on X, formerly Twitter, called the chorus of concerns a “setup” and a “psyop”.

Continue reading...

© Photograph: Chris Ratcliffe/Bloomberg via Getty Images

© Photograph: Chris Ratcliffe/Bloomberg via Getty Images

© Photograph: Chris Ratcliffe/Bloomberg via Getty Images

A new report released Thursday by Anthropic alleges persistent distillation attacks by China-based AI companies, which have escalated in recent months as competition in the space has intensified.

AI insiders are warning that the race toward self-improving systems is outrunning efforts to control them.

Come inside the mind of a bot trying to convince the internet it's human.

Investigadores independentes revelam que o alcance dos agentes de IA que fugiram ao controlo da OpenAI é maior do que se sabia, no mesmo dia em que a Comissão Europeia confirma que a agência de cibersegurança ENISA já testa o modelo mais avançado da Anthropic.

The post Incidente com agentes da OpenAI pode envolver mais sites. Investigadores tentam determinar a extensão da invasão appeared first on Tek Notícias.

Anthropic researcher Jacob Coxon resigns and warns that rapid AI advances could outpace efforts to keep increasingly powerful systems under control.

US government adviser Paul Christiano warns of risks to AI industry as he joins OpenAI’s non-profit foundation

OpenAI is not on track to reduce the risk of “catastrophic” loss of control to an acceptable level, a member of its non-profit board has said, amid spreading public and political concern that super-advanced AIs could one day wipe out humanity.

Paul Christiano, a US government technology adviser, said: “There is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term.”

Continue reading...

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

© Photograph: Dado Ruvić/Reuters

Former Anthropic employee Jacob Coxon said AI will become ‘superhuman systems’ that can cause human extinction by the end of the decade

Just a day after three Anthropic researchers warned that artificial intelligence could kill off humanity within the decade, lawmakers have begun lashing out about the risks of the burgeoning technology.

Ted Cruz, a republican senator from Texas, said in an interview on ABC’s The View, that AI posed a “catastrophic risk” and that he “read that whole tweet thread that that developer put out. It was highly concerning.

Continue reading...

© Photograph: Evelyn Hockstein/Reuters

© Photograph: Evelyn Hockstein/Reuters

© Photograph: Evelyn Hockstein/Reuters

AI could supercharge growth while pushing income from white-collar workers toward capital.

When a prominent researcher quits a job at a frontier AI lab these days, it's often to pursue a new startup or protest a new business model. But AI researcher Jacob Coxon is using his departure from Anthropic to publicly warn that frontier AI companies are "gambling with our lives" with systems that they "earnestly believe... could kill us all by the end of the decade."

In a social media thread Tuesday night, Coxon said that this existential risk is inherent not so much in today's models but more in the impending prospect of "self-improving superintelligence" creating "superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources." Others working on these models have either not "internalized the civilizational stakes" or believe that they need to "speedrun" the race to superintelligence to prevent an irresponsible party from getting there first, he wrote.

Lest you think this is just one departing researcher expressing an unpopular opinion, Anthropic Alignment Science lead Evan Hubinger piped in on social media to say that "Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade."

Read full article

Comments

© Getty Images