I am an Associate Professor at Oregon State working on problems in embodied AI that combine perception, control, and natural language.

Joined September 2018
1 Photos and videos
Stefan Lee retweeted
New preprint 🤖 RL policies that switch between position and force control per-axis for precision assembly. 1,600 real Franka FR3 trials, zero-shot sim-to-real. 35% higher success and 30% less force than VICES. 1/5
1
1
2
137
Stefan Lee retweeted
1/ Introducing Humanoid Hanoi — a distribution over “Tower of Hanoi” box rearrangement problems for humanoids. osudrl.github.io/Humanoid_Ha…
2
11
44
4,934
2 Dec 2025
RT @fuxinli2: Are you passionate about connecting 3D perception / world modeling with learning-based control for humanoid mobile manipulati…

1
57
Stefan Lee retweeted
We are excited to announce the 2026 Artificial Intelligence Application Support Program (AIASP) for prospective students in #ArtificialIntelligence applying to AI graduate degree programs at @OregonState! More info in the thread. 🧵1/5
1
2
1
212
Stefan Lee retweeted
27 Mar 2025
Excited to share our work to appear at #CVPR2025! This work in collaboration with @jacob__krantz and @stefmlee investigates if visual representations (imaginations) of natural language instructions can improve performance of vision-and-language navigation (VLN) agents. TL;DR-yes
1
1
3
371
Stefan Lee retweeted
We are excited to announce the 2024 Artificial Intelligence Application Support Program (AIASP) for prospective students in #ArtificialIntelligence applying to AI graduate degree programs at @OregonState! More info in the thread. 🧵1/5
1
5
5
1,129
Stefan Lee retweeted
15 May 2024
I'm happy to present our work titled "Point Cloud Models Improve Visual Robustness in Robotic Learners" tomorrow, May 16 (Thu). Paper: arxiv.org/abs/2404.18926 Project Page: pvskand.github.io/projects/P… Poster session: 10:30 - 12:00 pm (JST) Oral talk: 16:30 - 18:00 (JST) @ AX-F206

1
2
2
1,332
Stefan Lee retweeted
🚨 We have postdoc openings at UNC 🙂 Exciting diverse NLP/CV/ML topics**, freedom to create research agenda, competitive funding, very strong students, many collabs w/ other faculty & universities companies, superb quality of life/weather. Please apply  help spread the word 🙏 Ping me for any questions! **multimodal generative models, grounded embodied semantics, LLM reasoning planning agents/multi-agent interaction collaboration, faithfulness hallucination, interpretability model editing, efficiency model merging, generalizability/OOD, etc. (more details of our publications/talks students/postdocs labpage, etc. in links below👇)
4
65
191
72,371
Stefan Lee retweeted
I'm happy to present "VLSlice: Interactive Vision-and-Language Slice Discovery" at @ICCVConference this Thursday! Find me 2:30pm - 4:30pm in room "Foyer Sud" - 121. See ericslyman.com/vlslice/ for the paper, code, and presentations. TL;DR in the thread🧵1/8
1
3
14
782
Stefan Lee retweeted
We are excited to announce the 2023 Artificial Intelligence Application Support Program (AIASP) for prospective students in #ArtificialIntelligence applying to AI graduate degree programs at @OregonState! More info in the thread. 🧵1/5 aigsa.club/aiasp/
1
5
5
827
Stefan Lee retweeted
31 May 2023
🚨Excited to share: “𝗣𝗮𝗻𝗼𝗚𝗲𝗻: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation”!🚨 PanoGen creates diverse 360-degree panorama via recursive outpainting, achieving SotA on R2R, R4R, CVDN. pano-gen.github.io @mohitban47 @uncnlp 🧵
2
34
91
31,958
Stefan Lee retweeted
The Embodied AI team @MetaAI is looking for postdocs! We're looking for researchers that are interested in advancing foundation models for Embodied AI and robotics. If interested, apply here: metacareers.com/jobs/1506294…

17
64
21,243
Stefan Lee retweeted
Oregon State EECS is recruiting (including in AI/ML). We will soon have the most powerful academic computing facility in the US thanks to a gift from Jen-Hsun and Lori Huang. eecs.oregonstate.edu/prospec…

1
8
76
Stefan Lee retweeted
Language-guided navigators shouldn’t be carted off to a new environment with each new instruction. Instead, they should persist & improve over time. We present Iterative Vision-and-Language Navigation to evaluate exactly this! arxiv.org/abs/2210.03087 jacobkrantz.github.io/ivln
2
9
50
Stefan Lee retweeted
Rebuttal period is coming in a few days! Check these resources to make the most out of your rebuttal: @Awfidius at CVPR20: - slides: bit.ly/3utzSmp - video: bit.ly/3IgBlSJ @deviparikh, @DhruvBatraDB and @stefmlee blog post: bit.ly/3OPx0YS
1
7
17
Stefan Lee retweeted
To the V&L community: should we rethink current evaluation practices in VQA? We conducted a systematic study of recent pretrained V&L models for OOD generalization in VQA. Check out the findings!
Is your V&L model learning to solve a task or just a dataset? 🕵️‍♀️ “Rethinking Evaluation Practices in VQA: A Case Study on Out-of-Distribution Generalization” 📄 arxiv.org/abs/2205.12191 w/ @aagrawalAA, Ivana Kajić, Elnaz Davoodi, Anita Gergely, Phil Blunsom and @aidanematzadeh
1
6
32
Stefan Lee retweeted
Thrilled to announce the 2nd RxR-Habitat Challenge at the #CVPR2022 Embodied AI Workshop! Agents must navigate indoor environments following human instructions. The environments are realistic, the instructions multilingual. Is your agent up for the task? ai.google.com/research/rxr/h…
14 Feb 2022
Happy to announce that the 3rd Embodied AI Workshop is happening on June 19th at #CVPR2022. Lots of exciting speakers and 13 (!!!) challenges. Check out our website (embodied-ai.org), dive into a challenge, and save the date!
1
6
21
Stefan Lee retweeted
I welcome PhD applications from students interested in working with me on topics at the intersection of Artificial Intelligence and Causal Inference. Application deadline: 15th Dec 2021. Link: gradschool.oregonstate.edu/p…
4
67
226
Stefan Lee retweeted
I will be recruiting graduate students for Fall'22. Interested in working on vision-language research? Apply here mila.quebec/en/cours/admissi…. Deadline Dec 1st, 2021. More details on my research: iro.umontreal.ca/~agrawal/.
5
55
241