PI of the CLVR lab. Associate Professor @KAIST_ai. Prev: assist. prof. @USC, postdoc @Stanford, CS PhD @MIT, BA @UCBerkeley. AI, Robotics, Vision, ML.

Joined July 2017
7 Photos and videos
Pinned Tweet
We are finally releasing a new benchmark!! #RSS2023 Main highlights are: * For real-world * Reproducible (3D printing) * 9 furniture assembly long-horizon tasks * 200 hrs of demonstrations This apparently is my 3rd furniture-related benchmark.๐Ÿฅน clvrai.github.io/furniture-bโ€ฆ
5 Jul 2023
Looking for a challenging manipulation benchmark? Introducing FurnitureBench ๐Ÿช‘๐Ÿ› ๏ธ, a reproducible real-world furniture assembly benchmark (#RSS2023 @RoboticsSciSys)! It features * 8 furniture models * 200 hours of expert demonstrations * FurnitureSim: Isaac Gym simulator ๐Ÿงต๐Ÿ‘‡
16
90
26,917
Joseph Lim retweeted
1 Oct 2025
Very excited to start sharing some of the work we have been doing at Amazon FAR. In this work we present OmniRetarget, which can generate high-quality interaction-preserving data from human motions for learning complex humanoid skills. High-quality re-targeting really helps the reinforcement learning. Why? The control policy optimization landscape is much nicer for (near)feasible trajectories than for trajectories with artifacts like (e.g.) foot skating or ground penetration.
Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing ๐—ข๐—บ๐—ป๐—ถ๐—ฅ๐—ฒ๐˜๐—ฎ๐—ฟ๐—ด๐—ฒ๐˜๐ŸŽฏ, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with ๐—บ๐—ถ๐—ป๐—ถ๐—บ๐—ฎ๐—น RL: - 5 rewards, - 4 DR terms, - Proprio. ONLY, - NO history/curriculum. Ready for agile, human-like ๐Ÿค–? (Best with ๐ŸŽง) ๐Ÿ”— omniretarget.github.io ๐ŸŽฅ 1/9
21
42
343
93,051
Joseph Lim retweeted
24 Sep 2025
It's almost time for #CoRL 2025! A reminder that we're hosting the Data in Robotics workshop this Saturday Sept 27th. We have a packed schedule and are also attempting to livestream the event for those who can't attend in person.
4
9
68
40,227
Joseph Lim retweeted
We have our speakers: @JosephLim_AI @KarlPertsch @mayacakmak , Serena Booth, @JasonMa2020 @shahdhruv_ @MashaItkina We also have a great panel lined up from 3-3:40pm! @svlevine @yukez @MashaItkina @SudeepDasari @ashwinb96 @JasonMa2020 @shahdhruv_
1
2
6
2,301
Joseph Lim retweeted
Honored that our @RL_Conference paper won the Outstanding Paper Award on Empirical Reinforcement Learning Research! ๐Ÿ“œMitigating Suboptimality of Deterministic Policy Gradients in Complex Q-Functions ๐Ÿ“Žopenreview.net/forum?id=H3jcโ€ฆ Grateful to my advisors @JosephLim_AI and @ebiyik_!
At @RL_Conference๐Ÿ, I'm presenting a talk and a poster on Aug 6, Track 1: Reinforcement Learning Algorithms. We find that Deterministic Policy Gradient methods like TD3 often get stuck at local optima under complex Q-functions, and propose a novel actor architecture! ๐Ÿงต
9
11
72
8,085
corl.org/home CoRL 2025 schedule is released now! Please note that the whole schedule is earlier than other times. The submission deadline: 4/28 The conference: 9/27-9/30 @corl_conf #corl2025
9
49
5,178
Do you work on robotics? Do you like robots? Then, visit Korea next year! We (@ryoo_michael @gupta_abhinav_ @SongShuran Haewon and more) are organizing CoRL 2025 in Seoul, Korea!! #CoRL @corl_conf #robotics
I am extremely pleased to announce that CoRL 2025 will be in Seoul, Korea! The organizing team includes myself and @gupta_abhinav_ as general chairs, and @JosephLim_AI, @songshuran, and Hae-Won Park (KAIST) as program chairs.
4
4
82
7,811
Joseph Lim retweeted
I've been historically bearish on skill-based RL and @Jesse_Y_Zhang consistently shows me I'm probably wrong. Come check out EXTRACT at 1600 at @corl_conf (poster #11) to see him yank semantically meaningful skills out offline data by leveraging PTLMs. arxiv.org/abs/2406.17768
1
5
36
3,133
Joseph Lim retweeted
This work was guided by Jesse's co-advisor's @ebiyik_ and @JosephLim_AI, but I think we all agree that Jesse is effectively running his own little lab. If you're thinking about hiring a postdoc in the area of RL for robotics, Jesse comes a ton of insight and mentoring experience!
5
14
2,489
Well.. we won the best system paper award #RSS2023 @RoboticsSciSys !! @MinhoHeoโ€™s talk can be found at: youtu.be/QXmcu9fVnak?t=7631 We (@MinhoHeo @doohyun22 @YoungwoonLee & I) gave quite a bit of effort into this talk. So, we hope you enjoy the talk and, of course, the project :)
5 Jul 2023
Looking for a challenging manipulation benchmark? Introducing FurnitureBench ๐Ÿช‘๐Ÿ› ๏ธ, a reproducible real-world furniture assembly benchmark (#RSS2023 @RoboticsSciSys)! It features * 8 furniture models * 200 hours of expert demonstrations * FurnitureSim: Isaac Gym simulator ๐Ÿงต๐Ÿ‘‡
6
6
129
21,961
And this will be my last tweet for the time being!
1
4
1,214
My student @MinhoHeo will be giving a talk in 2hrs (11am KST today). #RSS2023 This work is also one of the best system paper finalists too! Come and check it out :)
We are finally releasing a new benchmark!! #RSS2023 Main highlights are: * For real-world * Reproducible (3D printing) * 9 furniture assembly long-horizon tasks * 200 hrs of demonstrations This apparently is my 3rd furniture-related benchmark.๐Ÿฅน clvrai.github.io/furniture-bโ€ฆ
2
13
3,622
At #RSS2023 this week w/ some of my (ex-)students from CLVR (@YoungwoonLee @MinhoHeo @doohyun22 @sungj1026 ). Excited to meet about topics on robot learning, RL, physical reasoning, long-horizon manipulation, etc. Recruiting (intโ€™l & domestic) students. Plz come and say hi!
1
1
17
3,859
Then, on Wednesday, we have FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation. Talk (Wednesday 11am) & Poster (Wednesday 3pm) By @MinhoHeo @YoungwoonLee @doohyun22 clvrai.github.io/furniture-bโ€ฆ
1
1
7
1,087
Joseph Lim retweeted
Having humans annotate data to pre-train robots is expensive and time-consuming! Introducing SPRINT: A pre-training approach using LLMs and offline RL to equip robots w/ many language-annotated skills while minimizing human annotation effort! URL: clvrai.github.io/sprint/ ๐Ÿงต๐Ÿ‘‡
2
28
117
24,662
Joseph Lim retweeted
Excited to present PATO: Policy Assisted TeleOperation, our recent work on scaling robot data collection! PATO uses a policy trained on prior data to assist the user during data collection, making teleop easier and even allows to teleop multiple robots simultaneously. ๐Ÿงต๐Ÿ‘‡
1
10
46
8,579
Check out our #CoRL2022 paper on learning skill dynamics for model-based RL! We present a sample efficient RL algorithms by temporal abstraction (skills). @YoungwoonLee @lucy_x_shi (an undergrad who will graduate soon!)
18 Jul 2022
Can robots be farsighted? We introduce SkiMo (Skill Model-based RL), which allows more accurate and efficient long-horizon planning through temporal abstraction. SkiMo learns temporally-extended, sparse-reward tasks with 5x fewer samples! ๐Ÿงต๐Ÿ‘‡
2
10
2,474