METR’s benchmark has become a bellwether of AI capability growth, but its design isn’t up to the task, argues Nathan Witkin ...

The problem: Generative AI Large Language Models (LLMs) can only answer questions or complete tasks based on what they been trained on - unless they’re given access to external knowledge, like your ...