Leaders of major AI firms told the U.N. Security Council on Wednesday that the technology calls for heightened vigilance, with Anthropic's CEO pledging to slow down where needed to ensure the safety of new releases.
As concern rises over the risks of artificial intelligence, hopes for any kind of global approach depend on cooperation between the U.S. and China—superpowers that seem only to be more skeptical of each other's AI strategy.
OpenAI has disclosed six reports of "unexpected or concerning" behavior in artificial-intelligence models as the debate on AI safety becomes increasingly heated.
Artificial Intelligence (AI) is rapidly advancing—and with it, the promise of solving some of academia's toughest problems. But while many researchers focus on using AI to find answers, Associate Professor Hiroshi Kera of the Institute for Advanced Academic Research/Graduate School of Informatics is asking a different question: How can we design better problems for AI to solve?
The Canadian computer scientist Yoshua Bengio, considered one of the founders of AI, told AFP that humanity is "losing control" of the technology and that the world needs guardrails similar to nuclear arms controls.
The potential existential threat of artificial intelligence has leapt into the headlines after a departing safety researcher at AI company Anthropic posted on social media that he believed there was more than a 1-in-10 chance AI could kill everyone.
Meta CEO Mark Zuckerberg pushed back Tuesday against growing calls to pause or slow AI development, arguing that market incentives and legal liability are the best safeguards against the technology's risks.
Fears that advanced artificial intelligence could wipe out humanity have dominated global headlines, but in Japan, the technology is being used for a sweeter purpose—developing never-before-seen convenience store desserts.
In controlled safety tests described earlier this year, researchers asked AI models to solve a series of simple math problems. Partway through the exercise, the instructors warned the bots that if they tried to solve the next problem, the computer environment they were operating in would be shut down. In some runs, the shutdown occurred as specified. In others, models interfered with the shutdown script and continued with the remaining problems.
A former Google DeepMind employee warned that rapidly advancing artificial intelligence could become uncontrollable and has "the potential to kill us all," adding to a growing list of industry insiders sounding the alarm.
As the rapid development of artificial intelligence triggers a renewed debate about its risks, the United States and China keep racing to develop increasingly powerful models.
The world's biggest AI companies are working to create a standards body, ChatGPT maker OpenAI said Tuesday, as fears rise about the dangers of AI and pressure mounts to create a safer version of the technology.
Anthropic CEO and co-founder Dario Amodei has published an essay titled "We Must Pace the Frontier". He expressed ongoing concerns over the "misuse of AI for cyberattacks and bioterrorism" and fears that a swarm of AI agents could theoretically take over the entire internet within six to 12 months.
Earlier this week, researcher Jacob Coxon quit Anthropic, saying the firm and its competitors are "gambling with our lives." "We really do earnestly believe AI could kill all humans," added current Anthropic researcher Evan Hubinger in a post on X.
Anthropic said Thursday it shut down multiple cases of state-sponsored surveillance operations that used its artificial intelligence (AI) models and warned that governments and state-aligned actors are increasingly using AI to spy on ethnic minorities and dissidents.
Anthropic said Thursday it has blocked efforts by bad actors to use its artificial intelligence models for malicious activity such as cyberattacks, surveillance, and research that could have led to biological weapons.
OpenAI is calling for binding safety requirements on the most powerful artificial intelligence systems, a reversal for a company that has resisted calls for regulation.
Login
