← Back
SiTech Team⏱️ 1 წთ. საკითხავი

Anthropic and Accenture Partner on Embedded Evaluation of Frontier AI

Anthropic and Accenture Partner on Embedded Evaluation of Frontier AI

Anthropic will let evaluators from Accenture's Faculty work inside the lab with employee-level access to red-team models and check safety commitments. Both companies expect to invest at least $1 billion each over five years.

What happened

Anthropic announced a partnership with Accenture to run independent evaluation of frontier AI models from inside the lab. The work will be led by Faculty, Accenture's specialist AI business, and covers model evaluation and red-teaming, alignment assessments and testing of model safeguards.

Why it matters

The idea is "embedded evaluation": evaluators work inside an AI company with access comparable to an employee's. That lets them watch models take shape during training, follow the decisions that govern how models are built and deployed, and speak directly to staff. From that vantage point they can verify whether a company is keeping its safety commitments and identify blind spots.

The money and the open questions

Both companies expect to invest at least $1 billion each over the next five years. Still, no standards yet exist for what embedded evaluators should be able to see or how they should report findings. Anthropic will fund Accenture's work directly, but argues that long-term funding should come from pooled or government sources. The partnership is non-exclusive: Anthropic is also in talks with METR and other nonprofit evaluators, and more partners are expected.

📖 Source