🔥 Autonomous AI Assistants (e.g., #googleio2024, #WWDC24) and coding agents (e.g., #Devin, #SWEAgent) have garnered a lot of attention recently. We can envision coding agents autonomously completing complex day-to-day tasks across apps using APIs on our behalf. But how can we develop & benchmark them in a rigorous & reproducible manner? 🚀 Introducing AppWorld: 🌎a simulated world environment where agents can write code to interact with many apps via APIs on behalf of people 📊a benchmark of complex tasks defined on it, and 🧪a robust evaluation framework for assessing agent’s goal completion. 📢 To appear as an #ACL2024 paper 🌎💻🧑‍🤝‍🧑 “AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents” #NLProc #ai #AIagents 📜 arxiv.org/abs/2407.18901 (paper) 🌐 appworld.dev for code, blog, data (tasks, APIs, trajectories) explorer, interactive playground, leaderboard & more!

@SemEvalWorkshop 2026 Task2 Live!! Go participate #NLProc @aclmeeting Build personalized, ecologically valid, emotionally intelligent systems! Rare opportunity to study lived emotions via self-reported & longitudinal experiences Evaluation begins Jan 10 tinyurl.com/semeval26task2

Pursue a fully-funded and personalized PhD in #computerscience with world-class faculty as mentors, a 4:1 student-to-faculty ratio, and in the vibrant city of Chicago. Learn more and apply by Dec. 9 (NO FEE): buff.ly/Qw8njWB

🚨 Late Life update 🎓 I defended my thesis (AppWorld, IRCoT, MuSiQue, DiRe, TeaBReaC) & joined @allen_ai as a research scientist earlier this year 🙏 Deeply grateful to my awesome advisor @b_niranjan mentors @tusharkhot @Ashish_S_AI, committee members @HAndySchwartz @OwenRambow @sameer_, many collaborators, @stonybrooknlp labmates, friends & family 🤝If you want to collaborate, DMs are open! I’m interested in (tool-use, coding, web) agents and environments 🌎 We've many exciting releases on the AppWorld front coming up. Stay tuned! Or DM if you can help! 🙂

Very excited to have @gregd_nlp chat about LLM Reasoning beyond scale at @sbucompsc #NLProc

Have that eerie feeling of déjà vu when reading model-generated text 👀, but can’t pinpoint the specific words or phrases 👀? ✨We introduce QUDsim, to quantify discourse similarities beyond lexical, syntactic, and content overlap.