A benchmark that challenges language models to code solutions for scientific problems

Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.

This document curates open-source projects, academic papers, capability benchmarks, and commercial solutions (international & China) in AI penetration testing, LLM red teaming, autonomous offensive agents, and vulnerability discovery—aimed at helping researchers, security engineers, and enterprise decision-makers quickly form a holistic view.

AI coding models, agents, CLIs, IDEs, AI app builders, open source tooling, benchmarks

Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.

[NeurIPS 2025] AGI-Elo: How Far Are We From Mastering A Task?

A curated list of evaluation tools, benchmark datasets, leaderboards, frameworks, and resources for assessing model performance.

Live, open-source benchmark for comparing AI coding agents on real GitHub issues

Live index of LLM evaluation tools and benchmarks, refreshed every 15 minutes from GitHub

The open benchmark for measuring the reliability, reproducibility, and determinism of AI context systems. Transparent metrics, reproducible tests, vendor-neutral results. Context Trust Levels CTL 0-4.

A measurement framework for autonomous AI agency across 7 dimensions

AI Benchmark 知识库 — 全面收录各大 AI 公司用来测试模型性能的 Benchmark 题库完整集合

Qualitative benchmark suite for evaluating AI coding agents and orchestration paradigms on realistic, complex development tasks

Pluralistic human evaluation infrastructure for AI in production

119 AI models × 55 benchmarks with per-score freshness dates, auto-updated pricing, task routing. Every score has a date and source URL. Daily CI.

A curated collection of AI model benchmarks and leaderboards — covering general rankings, coding, agents, reasoning, embeddings, and more

Benchmarks AI conversations by estimated biochemical impact. Maps conversational outputs to neurochemical response profiles (oxytocin, dopamine, serotonin, endorphins, cortisol) via LLM analysis for physiological evaluation metrics.

LLM spatial reasoning evaluation suite with gradient-based scoring. CLI benchmark runner with leaderboard support, OpenRouter multi-model integration, and standardized input/output formats.

Independent benchmarks of AI capability on legal analysis tasks.