| |
| [ SF Open Source AI Week ] |
AI Benchmark Club
|
| With Mark Saroufim (GPU Mode, Meta), George Cameron (Founder, Artificial Analysis), Daniel Kim (Head of Dev Relations, Cerebras Systems). |
| Venue, To Be Announced, San Francisco |
|
Oct 22 (Wed) , 2025 @ 05:30 PM
| |
FREE |
|
|
|
|
|
|
|
|
| |
| DETAILS |
|
tl;dr Come join us for technical talks focusing on AI benchmarks. We're a group of AI engineers, researchers, & academics.
Get ready for three incredible speakers / industry leaders:
Mark Saroufim from GPU Mode / Meta
George Cameron from Artificial Analysis
Daniel Kim from Cerebras
This event is part of Open Source AI Week, right next to the PyTorch Conference venue.
Details
Date & Time: Wednesday, October 22 @ 5:30 PM
Location: SF, near Moscone West.
(Food & drinks provided. )
Talk 1 by Mark will showcase BackendBench, for evaluating LLM-generated kernels with a focus on correctness
Talk 2 by George will cover Artificial Analysis's industry-shaping work in evaluating frontier models across many dimensions
Talk 3 by Daniel will discuss measuring the effects of different approaches of quantization on model accuracy
Agenda:
5:30 - 6: Arrival, Food, Networking
6 - 7: Technical Talks, Q&A
7 - 7:30: Post Talk Networking
About the Meetup
Are you an engineer or researcher interested in measuring AI systems? This is a technical meetup where we dive into the guts of AI benchmarks of all stripes.
Interested in sharing AI benchmarking work you've done at a future session? Tell us about it.
|
|
|
|
|
|
|
|
