| |
|
|
Agent Evaluation Science
|
| With Yoav Artzi (Associate Professor of Computer Science, Cornell University/Cornell Tech), Nouha Dziri (Senior Research Scientist, Cohere Labs), Peter Henderson (Assistant Professor of Computer Science and Public Affairs, Princeton University), Olawale Salaudeen (Incoming Assistant Professor of Computer Science, University of Illinois Urbana-Champaign), Hanna Wallach (Vice President and Distinguished Scientist, Microsoft Research), Jason Weston (Research Scientist, Visiting Research Professor, Meta, NYU). |
|
Nov 20 (Fri) @ 09:00 AM
FREE
| | Venue, Downtown Manhattan
|
|
|
|
|
| |
| Register |
|
|
| |
Presented by EvalScience, Agent Evaluation Science NYC 2026 is a one-day symposium bringing together researchers & practitioners working on how AI agents should be evaluated.
Featured speakers & contributors include Hanna Wallach (Microsoft Research), Jason Weston (Meta / NYU), Yoav Artzi (Cornell Tech), Nouha Dziri (Cohere Labs), Peter Henderson (Princeton), Olawale Salaudeen (UIUC), Rachneet Kaur (J.P. Morgan), Ida Momennejad (Microsoft Research), & Saurabh Jha (IBM Research).
We will discuss what agent evaluations should measure, how reliability & validity should be established, where benchmarks & graders fail, how evaluation infrastructure should be built, & what changes when agents are evaluated in interactive & real-world settings.
The program includes invited talks, contributed research presentations, posters, a fireside conversation, & extended discussion & networking.
November 20, 2026 New York City
Registration is free & approval-based. We welcome researchers, builders, & practitioners working on evaluation methods, benchmarks, agent behavior, evaluation infrastructure, & real-world evaluation problems.
We are also accepting contributions including ongoing or published research, evaluation studies, tools, failure analyses, & lessons from evaluating deployed systems.
Learn more: https://evalscience.org/2026fall-nyc/
|
|
|
|
|
|
|
|
