Google and Mercor open PLE benchmark for physical-engineering agents
Physical-Engineering’s Last Exam evaluates production-like outputs from AI agents across 85 long-horizon tasks in mechanical, electrical, civil and structural engineering.
CHOOSE YOUR FOCUS
NEWS FEED
Physical-Engineering’s Last Exam evaluates production-like outputs from AI agents across 85 long-horizon tasks in mechanical, electrical, civil and structural engineering.
CWE-bench v2 evaluates 100 security repairs in real open-source repositories with deterministic tests; leading systems still fail on roughly one-third of the tasks.
SemiAnalysis has released GDPx, a benchmark that tests frontier models’ agentic capabilities across 11 specialist domains ranging from chip design and biology to software engineering.
Ai2’s new benchmark shows that six LLM judges can reach sharply different conclusions about the novelty of scientific ideas after small changes to prompts and evaluation setup.
BEYOND THE HEADLINE
Every story includes a concise summary, its creative workflow implications and original sources. Explore official demos and examples alongside the news.
Our editorial approach@airadarhaber
Fresh AI developments, dedicated visuals and product examples. Explore our posts and catch up in Stories.
Follow on Instagram


GRAPHIC. DIGITAL. MOTION.
Explore my graphic design, branding
and motion work.