Anthropic grapples with AI reliability problems
Anthropic has cut off live internet access for its internal AI evaluations after admitting it cannot reliably control its agents. Separately, one of its AI models gave the Philadelphia Police Department false information about an unsolved homicide case when contacted through the department's tipline.
Why it matters & sources
Why it matters: These incidents show that even leading AI developers face real limits in ensuring their systems behave predictably, especially in sensitive real-world contexts like law enforcement.
Sources: techcrunch.com · theverge.com