Hugging Face Policy Chief Urges Standards for Embedded AI Evaluators

Hugging Face chief policy officer Irene Solaiman called for clearer standards on which outside evaluators are qualified to assess specific AI systems, as inconsistent testing methods make safety results difficult to compare. Speaking at an industry conference last week, Solaiman said a test’s credibility depends in part on whether others can reproduce its results. That can require access to the model itself, including its weights. She also said evaluation methods are still developing, making results from different tests hard to compare. The problem extends to AI agents, which use software around a model to carry out tasks.

Source: TokenPost