Machine learning researcher @JaneStreetGroup. PhD @NYUDataScience in AI & CogSci, specifically in goals and their representations in minds & machines (he/him).
New preprint alert! We often prompt ICL tasks using either demonstrations or instructions. How much does the form of the prompt matter to the task representation formed by a language model? Stick around to find out 1/N
If “getting started with agents” feels like setup hell — same.
So we made a starter tutorial:
First agent running in <14 minutes, no Docker/AWS.
Laptop API key only.
👇 youtube.com/watch?v=gzNW_LXE…
Like ~everyone, I'll also be at #NeurIPS this week! Please reach out to chat about past (goal representations, cognitive science, intrep) or current interests (LLM mental state inference, social environments for RL). Also if you have leads on great coffee, craft beer, or tacos.
New preprint alert! We often prompt ICL tasks using either demonstrations or instructions. How much does the form of the prompt matter to the task representation formed by a language model? Stick around to find out 1/N
@jcyhc_ai will present SAGE-Eval, our (w/ @LakeBrenden) systematic generalization safety benchmark at poster #1104 on Friday AM (11-2).
John does fantastic work and he's open to RE/RS roles or PhD positions in AI Safety. If you're hiring, talk to him!
x.com/jcyhc_ai/status/192811…
Do LLMs show systematic generalization of safety facts to novel scenarios?
Introducing our work SAGE-Eval, a benchmark consisting of 100 safety facts and 10k scenarios to test this!
- Claude-3.7-Sonnet passes only 57% of facts evaluated
- o1 and o3-mini passed <45%! 🧵
Stop by the Meta booth tomorrow, Wednesday Dec 3rd at #NeurIPS in San Diego! 🤖📱
We demo our new research environment, OpenApps, for digital agents. Generate thousands of app versions to train and evaluate multimodal agents to use apps like humans do.
Not attending? Stay tuned
In San Diego for #NeurIPS
Happy to chat about open-endedness, self goal-generation, intrinsic motivations, self-improvement, human-machine collective intelligence
Open to hear about research scientist opportunities too
Don't hesitate to reach out!
My team at FAIR at Meta is recruiting interns for next summer! If you're a PhD student interested in questions around theory of mind in language models for social, multi-agent settings, and have relevant background and/or experience: metacareers.com/jobs/1821713…
Other great humans you might end up working with include @bvp22294, @AnsongNi, and @real_asli (in addition to several twitter-less folks).
Feel free to reach out with any questions! (though it may take me a bit to reply)
Belated update #2: my year at FAIR @AIatMeta through the AIM program was so nice that I’m sticking around for the long haul.
I’m excited to stay at FAIR and work with @real_asli and friends on fun LLM questions; I’ll be working from the New York office so we’re sticking around.
Belated update #1: I defended my PhD about a month ago! I appreciate the warm reception from everyone who made it in-person and virtually. Thanks to my committee, @LerrelPinto, @togelius, and Mark Ho for your feedback and fun questions.
I owe tremendous thanks to many other people, all (or, hopefully, at least most) of whom I mentioned in my acknowledgments. I’m also so grateful my dad could represent my family, and for my wife, Sarah, for, well, everything.
do you use Letterboxd?
would you be willing to participate in a 30-min research study where you use movie recommenders based on your Letterboxd ratings? DM me!
(you will receive $20 for participating)
Friends and virtual acquaintances! I’m defending my PhD tomorrow morning at 11:30 AM ET. If anyone would like to watch, let me know and I’ll send you the Zoom link (and if you’re in NYC and feel compelled to join in person, that works, too!)
#CogSci2025 friends! I'm here all week and would love to chat. I'd particularly love to talk to anyone thinking about Theory of Mind and how to evaluate it better (in both minds and machines, in different settings/contexts), and about goals and their representations. Find me at:
Saturday's poster session (P3-D-44) to talk about our goal inference work, in a new, physics-based environment we developed: escholarship.org/uc/item/6tb…
Wherever good coffee is to be found, the rest of the time. Don't hesitate to reach out!
(also happy to talk about job search in industry and what that looks and feels like these days)
Compositionality and planning: maybe not quite solved yet
(g.co/gemini/share/3d33f49bb4… if anyone is curious about the actual prompt, in which there was no attempt to trick the model or anything)