It’s deployment time! You’ve done the pre-deployment evals. You THINK your model is safe, so you ship it 🚀 🚨 After deployment, reports of misbehavior start trickling in What happened?? How could you have caught it?? 🤔 @icmlconf 2026 Spotlight! 🧵

Life update: I'm starting as faculty at Boston University in 2026! BU has SCHEMES for LM interpretability & analysis, so I couldn't be more pumped to join a burgeoning supergroup w/ @najoungkim @amuuueller. Looking for my first students, so apply and reach out!

What prompt generated the image on the right? Come find out today at our tutorial on OOD generalization: Shortcuts, Spuriousness, and Stability @Maggiemakar @aahladpuli Panel: @ElanRosenfeld @AdtRaghunathan Danica Sutherland

I'm recruiting PhD students for Fall 2025! CS PhD Deadline: Dec. 15th. I work on safe/reliable ML and causal inference, motivated by healthcare applications. Beyond myself, Johns Hopkins has a rich community of folks doing similar work! Come join us!

Unpacking what's going on in our paper on Med-* foundation models & their failure to improve over their generic counterparts (think Med-{LLaMa, LLaVa} vs {LLaMa, LLaVa}. A familiar tale of motivated reasoning, sloppy eval, & hidden hyper-optimization. arxiv.org/abs/2411.04118

I'm recruiting PhD students this cycle! My lab works at the intersection of information theory, cognition, language, and AI. Wanna hear more? I asked notebookLM to generate a podcast just for you (but pls take it with a big grain of salt...) youtu.be/9L04S4jvspI

Multimodal representation learning works for 2 modalities, but what if you're working with 3 modalities, like in healthcare, robotics, or video? 📢 Meet Symile: a model-agnostic contrastive loss for any number of modalities with CLIP's simplicity and superior performance✨ 1/n

Will your LLM model generalize over time or across sites? How do we improve robustness? This is a key issue LLMs struggle with and especially critical as we apply these models to healthcare applications. 👇 New clever technique to improve LLM robustness and generalization. Published @NeurIPSConf w/ wonderful postdoctoral fellow @wald_yoav & superb co-authors from Columbia. engineering.jhu.edu/news/in-… arxiv.org/abs/2310.12803

a very interesting observation: all you need is perceptron 🤣 arxiv.org/abs/2308.12553 by @aahladpuli @lilyhzhang Yoav Wald & Rajesh Ranganath

Thank you @ERC_Research for this amazing grant- I will work hard (with and without the algorithms’ help) on these topics for the next few years and would love to update you with exciting results soon.

Once more, in verbose mode: as of today I am an Assistant Professor @WaterlooENG (ECE dept), and faculty affiliate @VectorInst and @TorontoSRI. Please help me get the word out - I will be hiring motivated students who want to study machine learning and its societal implications

Excited to be moderating panel on generalization, scaling and safety at #icml2023 with great panelists @sleepinyourhat @zacharylipton and @Maggiemakar. Look forward to seeing folks at 15:30 room 316 at Workshop on Spurious Correlations, Invariance and Stability.

Coming up next!

Our lab is hiring an ML in health PhD/postdoc! This is for an applied causal ML project, with very close collaboration with our university hospital - see details here*: technionmail-my.sharepoint.c… *due to the specific requirements of this position we need a fluent Hebrew speaker