GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond
Paper • 2309.16583 • Published • 13
Evaluation
-
-
Prometheus: Inducing Fine-grained Evaluation Capability in Language Models
Paper • 2310.08491 • Published • 57 -
SO-Bench: A Structural Output Evaluation of Multimodal LLMs
Paper • 2511.21750 • Published • 6 -
LLM Swiss Round: Aggregating Multi-Benchmark Performance via Competitive Swiss-System Dynamics
Paper • 2512.21010 • Published • 4 -
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
Paper • 2602.12670 • Published • 64 -
SWE-rebench V2: Language-Agnostic SWE Task Collection at Scale
Paper • 2602.23866 • Published • 92 -
MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistants
Paper • 2603.09652 • Published • 16 -
Xpertbench: Expert Level Tasks with Rubrics-Based Evaluation
Paper • 2604.02368 • Published • 12 -
OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language World Models
Paper • 2604.10866 • Published • 69 -
A Benchmark for Interactive World Models with a Unified Action Generation Framework
Paper • 2605.03941 • Published • 5 -
π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
Paper • 2605.14678 • Published • 108 -
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
Paper • 2605.26114 • Published • 66 -
MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
Paper • 2605.27366 • Published • 30 -
ReportBench: Evaluating Deep Research Agents via Academic Survey Tasks
Paper • 2508.15804 • Published • 15 -
Behavioral Fingerprinting of Large Language Models
Paper • 2509.04504 • Published • 6 -
Statistical Methods in Generative AI
Paper • 2509.07054 • Published • 11 -
CLUE: Non-parametric Verification from Experience via Hidden-State Clustering
Paper • 2510.01591 • Published • 28 -
Decoding as Optimisation on the Probability Simplex: From Top-K to Top-P (Nucleus) to Best-of-K Samplers
Paper • 2602.18292 • Published • 13 -
K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts
Paper • 2606.02404 • Published • 59 -
A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks
Paper • 2605.28556 • Published • 75 -
Ψ-Bench: Evaluating Persona-Sensitive Influencing in Persuasive Dialogues
Paper • 2606.02754 • Published • 13 -
ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?
Paper • 2606.05553 • Published • 50 -
SoCRATES: Towards Reliable Automated Evaluation of Proactive LLM Mediation across Domains and Socio-cognitive Variations
Paper • 2606.05563 • Published • 55 -
OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamics
Paper • 2606.09826 • Published • 19 -
EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
Paper • 2606.13681 • Published • 143 -
Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks
Paper • 2606.12344 • Published • 71 -
GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
Paper • 2606.17861 • Published • 58 -
Guava: An Effective and Universal Harness for Embodied Manipulation
Paper • 2606.18363 • Published • 28 -
Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs
Paper • 2606.27378 • Published • 60 -
A Behavioural and Representational Evaluation of Goal-Directedness in Language Model Agents
Paper • 2602.08964 • Published • 1