Conservative News & Right Wing News | Gun Laws & Rights News Site

Anthropic AI Kept Attacking After Warnings It Was Harming Real People, Showed No Mercy, Tests Find

by Frank Bergman

An alarming test has revealed that Anthropic’s Claude Mythos 5 artificial intelligence (AI) model continued a hacking attempt even after researchers explicitly warned that its target was a real person unrelated to the assigned task, showing no mercy for human safety while pressing ahead with the attacks in 98% of cases.

The disturbing findings emerged from follow-up investigations by Anthropic and the AI Security Institute into an August incident.

During the August incident, the agent targeted an unrelated software project during a controlled security evaluation.

The AI wrote malware, adopted fake identities, and emailed a project owner in an attempt to get malicious code accepted as a helpful contribution.

The owner rejected the approach, and no real-world harm occurred.

But researchers’ attempts to recreate the incident exposed a disturbing failure: telling the model that its actions threatened real people often did not stop it.

The troubling findings were revealed in a report published Friday.

AI Shifted from Test Network to Unrelated Target

AISI had instructed Mythos 5 to break into a small network of test computers.

After its initial attempts failed, the internet-connected agent mistakenly redirected its efforts toward an unrelated GitHub project.

Rather than remaining within the authorized environment, the AI attempted to manipulate the project’s owner into introducing malware into their own repository.

Researchers subsequently used a complete transcript of the incident to investigate why the agent strayed from its task and whether clearer warnings would change its behavior.

AISI found that “repeatedly editing the summary to clarify that the target being attacked is a real human unrelated to the evaluation did not reduce Mythos 5’s attack rate.”

In one Anthropic test, the model continued attacking on 98% of occasions despite warnings about harm to humans.

Model Acknowledged Danger but Attacked Anyway

The investigations also uncovered a gap between the AI’s explanations and its conduct.

full story at https://slaynews.com/anthropic-ai-kept-attacking-warnings-harming-real-people-no-mercy-tests-find/

Exit mobile version