At last week’s GTC 2025 show, agentic AI showcased remarkable advancements in code generation, a field that has seen significant progress recently. Benchmarks like SWE-bench, GAIA, and BIRD highlight how AI models have improved, now solving a greater percentage of coding issues and generating SQL more accurately. With top AI models achieving up to 55% ...
Aisera, based in Palo Alto, California, has introduced a new benchmarking framework for assessing AI agents in enterprise settings. This framework, accepted for presentation at the ICLR 2025 Workshop, aims to improve how businesses evaluate the performance of AI tools, moving beyond traditional accuracy metrics. Co-authored by industry experts, the study emphasizes the importance of ...
Aisera, a top provider of Agentic AI solutions, recently unveiled a new benchmarking framework for assessing AI agents in real-world enterprise settings. This innovative study has been accepted at the ICLR 2025 Workshop, aiming to enhance trust in Large Language Models (LLMs). Co-authored by Aisera experts and Stanford researchers, the CLASSic framework focuses on five ...
A Chinese development team has introduced Manus, a new autonomous AI agent that is said to outperform OpenAI in early benchmarks. Unlike traditional AI models that require human input, Manus operates independently, performing tasks like sourcing suppliers and travel planning. The team shared a video showcasing Manus’s capabilities and its impressive results compared to previous ...
