Decision Index puts new decision models to the test on speed and cost
Photo: Crypto Briefing
The new benchmark finds decision models are faster and cheaper than LLMs but trail them on knowledge and reasoning tasks Artificial Analysis, the independent AI benchmarking firm best known for its Intelligence Index, now has a scorecard for a newer kind of AI system. The Artificial Analysis Decision Index rates decision models on three things: accuracy, speed and cost. The early verdict is a familiar trade-off. Decision models are faster and cheaper, but they score worse on knowledge and reasoning tasks. It tracks three dimensions at once. The first is accuracy, meaning how often a model gets the answer right.
Source: Crypto Briefing
