AI Matters

Why it matters

Artificial Analysis updates index after GPT-6 Astra scoring backlash

The Decoder Artificial Analysis overhauls its Intelligence Index after GPT-6 Astra scoring drew skepticism

Artificial Analysis released an updated version of its index after critics argued its initial benchmarks failed to accurately evaluate OpenAI's new model.

Why it matters

It shows how difficult it is to measure the capabilities of next-generation models as standard benchmarks struggle to keep pace.