Normal view

TechCrunch
Even some of the best AI can’t beat this new benchmark Kyle Wiggers
The nonprofit Center for AI Safety (CAIS) and Scale AI, a company that provides a number of data labeling and AI development services, have released a challenging new benchmark for frontier AI systems. The benchmark, called Humanity’s Last Exam, includes thousands of crowdsourced questions touching on subjects like mathematics, humanities, and the natural sciences. To make […] © 2024 TechCrunch. All rights reserved. For personal use only.
24 January 2025 at 07:29

Even some of the best AI can’t beat this new benchmark

24 January 2025 at 07:29

The nonprofit Center for AI Safety (CAIS) and Scale AI, a company that provides a number of data labeling and AI development services, have released a challenging new benchmark for frontier AI systems. The benchmark, called Humanity’s Last Exam, includes thousands of crowdsourced questions touching on subjects like mathematics, humanities, and the natural sciences. To make […]