a large multimodal model that can accept text and image inputs while returning text output that "exhibits human-level performance on various professional and academic benchmarks," according to OpenAI.

model has just achieved human-level results on a test designed to measure “general intelligence”. On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI benchmark, well above the ...

How close is AI to human-level intelligence ... Understanding and Reasoning Benchmark for Expert AGI (MMMU), which asks chatbots to do university-level, visual-based tasks such as interpreting ...

allowing models to surpass human-level reasoning on the ARC benchmark. The ability to adapt on the fly is a crucial component of general intelligence, bringing AI closer to human-like cognitive ...

We found that o1 surpassed the performance of those human experts, becoming the first model to do so on this benchmark,” said OpenAI in a recent blog post. GPQA (Graduate-Level Google-Proof Q&A ...

The Google spinoff’s robotaxis led to a reduction in injury-related and police-reported crashes when compared to human benchmarks ... not to report certain low-level crashes, like minor fender ...