Filter by category, growth, license, capabilities — sort by what matters today. Indexed from GitHub and Hugging Face, refreshed every 30 minutes.
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
Self-hosted realistic web environment for evaluating autonomous agents.
Text and interactive environment for embodied/household agent tasks.
E-commerce environment with 1.18M products for grounded web interaction.
Benchmark for multimodal web agents requiring visual understanding.
GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.
CityCube-Bench is a benchmark dataset for evaluating AI models on tasks related to city cube data, intended for researchers and developers working on urban data analysis.
A benchmark dataset for evaluating agent trajectory generation using the MCP (Multi-Context Planning) protocol, hosted on Hugging Face.
Mobile‑RobustBench is a benchmark suite for assessing the robustness of AI models on mobile devices, providing standardized tests and metrics for mobile‑friendly deployments.
RVMSBench is a benchmark dataset hosted on Hugging Face for evaluating the performance of vision-language models on a range of multimodal tasks.
Mobile‑RobustBench is a benchmark suite for evaluating the robustness of mobile‑friendly machine learning models, providing standardized tests and metrics for performance under varied conditions.
GenEvolve-Data-Bench is a dataset hosted on Hugging Face for evaluating generative AI models, providing a collection of examples and tasks to benchmark model performance.
SimulCost-Bench is a benchmark dataset for evaluating cost estimation models in simulation tasks, providing standardized tasks and metrics for comparison.
RVMS-Bench is a benchmark dataset hosted on Hugging Face for evaluating the performance of vision‑language models on a variety of multimodal tasks.
VitaBench is a benchmark dataset hosted on Hugging Face for evaluating vision-language models, providing standardized tasks and metrics for performance comparison.
RVMS-Bench is a benchmark suite hosted on Hugging Face for evaluating the performance of multimodal models on a variety of vision‑language tasks.
PR-Review-Bench is a benchmark dataset for evaluating AI agents on pull request review tasks, providing examples of code changes and review feedback.