Researcher at @Waymo Research; ML/Embodied AI; PhD @Princeton ECE
Joined August 2018
- Tweets 47
- Following 281
- Followers 360
- Likes 115
10 Photos and videos
Jimmy (Tsung-Yen) Yang retweeted
May 25
š¢ Accepted to TMLR, with reproducibility certification š
v2 of our JEPA-WM study (arXiv:2512.24497) is out, with new data-scaling experiments, a Lipschitz analysis of multistep rollout training, and extended discussions.
Recap what's new š
w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun
Jan 12
My first PhD paper is out! š
"What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?"
tl:dr: JEPA-WMs for robotics: learn dynamics on top of visual encoders, optimize actions towards goal š
w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun
15
31
237
63,726
1
218
It was great to work with @BasileTerv987 on this project! The JEPA world model works well on unseen robot tasks. Thanks Basile for the amazing work!
Jan 12
My first PhD paper is out! š
"What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?"
tl:dr: JEPA-WMs for robotics: learn dynamics on top of visual encoders, optimize actions towards goal š
w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun
1
4
461
18 Dec 2025
It is my pleasure to work with Raktim! A concrete example of how to use human videos to learn robot policies
18 Dec 2025
Introducing DexWM: Dexterous Manipulation World Model
tl;dr: train on human videos; fine-grained actions; hand-consistency loss; DexWM MPC -> zero-shot dexterous manipulation
w/ @_amirbar, @DavidJFan, @JimmyTYYang1, @GaoyueZhou, P. Krishnamurthy, M. Rabbat, F. Khorrami, @ylecun
6
431
2 May 2024
It was so much fun to work on this: llama3 sim2real skills, all are open-sourced!
26 Apr 2024
FAIR researchers (@AIatMeta) presented SegmentAnything and our robotics work at the White House correspondentsā weekend.
Llama3 Sim2Real skills (trained with @ai_habitat) = a robot assistant
1
4
23
4,101
Jimmy (Tsung-Yen) Yang retweeted
26 Apr 2024
FAIR researchers (@AIatMeta) presented SegmentAnything and our robotics work at the White House correspondentsā weekend.
Llama3 Sim2Real skills (trained with @ai_habitat) = a robot assistant
Washingtonians delved into the world of artificial intelligence (AI) at the Washington AI Networkās inaugural weekend TGAIFriday Lunch for White House correspondents. trib.al/FwHF9Um
3
19
218
103,265
20 Oct 2023
Very excited to see that Habitat 3.0 is finally out! Please also check out our paper here: ai.meta.com/static-resource/ā¦
20 Oct 2023
Announcing Habitat 3.0, simulating humanoid avatars and robots collaborating!
- Humanoid sim: diverse skinned avatars
- Human-in-the-loop control: mouse/keyboard or VR
- Tasks: social navigation and rearrangement
Over 1,000 steps per second on 1 GPU for large-scale learning!
5
18
2,814
2 Aug 2023
Please check out our Spot Sim2Real repo! github.com/facebookresearch/ā¦
It aims to reproduce the demos of ASC and LSC. We open-source the weights of the navigation, picking, and place skills, and the infrastructure to use Large Language Models (LLMs) to interact with those skills!
2 Aug 2023
Habitat stable version v0.2.5 released!
-- š¤ Hardware bridge for BD Spot
-- š· Improved PBR rendering for better synthetic scene visuals
-- š¤ ai-habitat on HuggingFace
-- š Habitat Synthetic Scenes Dataset (HSSD)
and more...
github.com/facebookresearch/ā¦
github.com/facebookresearch/ā¦
1
3
16
2,191
2 Aug 2023
1
148
Jimmy (Tsung-Yen) Yang retweeted
19 Jul 2023
āWe were very interested in testing out high-level reasoning and planning. We wanted to see...if the robot could figure out the steps it needed to take to solve the problem.ā - Discover why @MetaAI chose Spot for their research. bit.ly/44ILlhG
8
35
178
70,658
21 Jun 2023
This is our recent work building toward "reproducible" robotic research. Thanks @chris_j_paxton for leading such an amazing project!
21 Jun 2023
The future of robot butlers starts with mobile manipulation.
Weāre announcing the NeurIPS 2023 Open-Vocabulary Mobile Manipulation Challenge!
- Full robot stack ā
- Parallel sim and real evaluation ā
- No robot required ā
š
aihabitat.org/challenge/2023ā¦
2
10
1,337
20 Jun 2023
our demo @CVPR!
20 Jun 2023
FAIR and ā¦@gtcomputingā© researchers demoing our sim2real work on ā¦@BostonDynamicsā© Spot at ā¦@MetaAIā© booth at #CVPR23.
1
2
17
1,743
18 Jun 2023
Check our work at Meta AI #CVPR23 ! Spot is able to understand natural language instructions and complete the task for you!
18 Jun 2023
Weāll also be showcasing a handful of demos on the showfloor. We brought Spotty to demo some of our exciting recent work towards general-purpose embodied AI agents.
More on this research ā”ļø bit.ly/3N8LeVg
5/6
5
22
2,981
Jimmy (Tsung-Yen) Yang retweeted
18 Jun 2023
Weāll also be showcasing a handful of demos on the showfloor. We brought Spotty to demo some of our exciting recent work towards general-purpose embodied AI agents.
More on this research ā”ļø bit.ly/3N8LeVg
5/6
3
35
152
56,513
18 Jun 2023
Come join us for an instruction-following robot assistant demo at #CVPR2023 Meta Booth by the FAIR Embodied AI team.
Give Spot a free-form natural language instruction for object fetching.
Details: languageguidedskillcoordinatā¦
š§µ
6
51
251
105,249
18 Jun 2023
We will be running the LSC demo at two locations at #CVPR2023:
Meta AI booth: Tuesday to Thursday 10:00 AM to 6:00PM.
CVPR Demo track booth: Thursday 10:00 AM to 6:00PM
Details: languageguidedskillcoordinatā¦
Come join us!
1
1
10
3,941
18 Jun 2023
This is the joint work of my amazing colleague: Sergio Arnaud, Kavit Shah, @naokiyokoyama0 , Alex Clegg, @joannetruong , Eric Undersander, Oleksandr Maksymets, @sehoonha , Mrinal Kalakrishnan, Roozbeh Mottaghi, @DhruvBatraDB , and Akshara Rai
1
5
594