| |
|
| |
A monthly ML research colloquium by the New York Machine Learning Research Guild - this session in collaboration with our partner, CUNY Tech Prep.
Speaker: Zayne Sprague PhD Researcher, Courant Institute of Mathematical Sciences, NYU & Google
Topic: From Chain of Thought to Agent Swarms: A Brief Story on Reasoning in LLMs
Giving language models more time to think has produced substantial gains, but in targeted domains, and the benefits appear to remain uneven across tasks. This talk explores how models can use additional computation at inference time effectively, reviewing the progression from prompt based methods to multi-agent systems. We will begin with chain-of-thought prompting, asking a model to think before giving a final answer, presenting our work showing that chain-of-thought prompting has its strongest benefits concentrated in mathematics and symbolic reasoning. These domains also share a practical advantage: answers can often be checked automatically, providing feedback that can be used to train models through reinforcement learning. This leads us to SkillFactory, where we use a model's own successful and unsuccessful attempts to construct training examples that demonstrate checking answers and retrying. Combining supervised finetuning on these examples with reinforcement learning helps models develop these behaviors and generalize to harder problems. Finally, we will discuss recent work on agent swarms, exploring how reasoning can scale in parallel and what role verification can play in making that additional computation useful.
This session is a close-quarters look at that work, with plenty of room to push back and dig in.
# Who this is for
NY-MLR colloquia are small by design. The room is capped, and we keep it that way so the discussion stays substantive and everyone in it can contribute.
We'd love to see you if you're:
- A practitioner working seriously on ML, in industry or in a lab
- A researcher or graduate student in ML, NLP, or an adjacent field
- A highly motivated student or self-directed learner of any age or background, with real depth of interest
# Schedule
5:00 - 5:30 PM - Doors open, arrivals, mingling
5:30 - 6:30 PM - Speaker Lecture
6:30 - 7:00 PM - Moderated Q&A
7:00 - 8:00 PM - After hours, mingling, wind-down
8:00 PM - Lights out
Venue: Amazon JFK27 ("Hank") 12 W 39th St, New York, NY 10018
|
|
|
|
|
|
|
|
