Ai2 NoveltyBench stress-tests LLM judgments of research novelty
Ai2’s new benchmark shows that six LLM judges can reach sharply different conclusions about the novelty of scientific ideas after small changes to prompts and evaluation setup.
2 min readRead story



