Evaluation and benchmarks research

• RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations

  RealCompanion introduces a longitudinal benchmark derived from 27,218 real-world human-companion messages across up to 120 days, enabling systematic evaluation of an AI companion's selective memory retrieval, profile fact extraction, trait inferencing, and restraint when history is unnecessary.

  2026-10-01 · Evaluation and benchmarks · AI agents · Language models

• Raven: The Harness of Harnesses for Composable Agentic Intelligence

  Raven packages language models with domain tools into reusable worker units, using a central host agent to break user requests into workflow graphs, validate file-based handoffs before execution, and run subtasks in parallel.

  2026-09-27 · AI agents · Evaluation and benchmarks · Language models

• False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents

  CrossFit partitions source documents into separate groups called folds and scores questions using a solver trained on complementary folds, reducing same-source error feedback to lower false agreement and improve search accuracy.

  2026-09-30 · AI agents · Reinforcement learning · Evaluation and benchmarks