Joined October 2019
- Tweets 31
- Following 285
- Followers 140
- Likes 506
Photos and videos
Mark Van der Merwe retweeted
Feb 17
Dexterous hands vary widely—so do tactile modalities. 🖐️🌈
Our vision on tactile human-to-robot transfer:
🔓 Not tied to specific hardware
♻️ Reuse human tactile demos across embodiments
Presenting TactAlign, a cross-sensor tactile alignment for cross-embodiment policy transfer.
4
34
172
33,906
Mark Van der Merwe retweeted
18 Nov 2024
Earlier this year, @NimaFazeli7 recieved a @NSF CAREER Award.
We took the chance to catch up with Professor Fazeli to learn a bit more about the fascinating research on "intelligent and dexterous robots that seamlessly integrate vision and touch.”
1
3
47
3,599
Mark Van der Merwe retweeted
24 Oct 2024
Is dynamics model mismatch breaking your robotic safety guarantees? We used Conformal Prediction to construct probabilistically safe trajectories given approximate Gaussian dynamics models.
Learn more at um-arm-lab.github.io/lucca
Presented @wafr_conf & @michigan_AI's Symposium
1
3
17
1,109
Mark Van der Merwe retweeted
18 Oct 2024
Our This&That: Language-Gesture Controlled Video Generation for Robot Planning testing code of Video Diffusion Model is released at github:
github.com/Kiteretsu77/This_…
The rest will be coming soon (working hard to organizing the code😆)
1
7
341
Mark Van der Merwe retweeted
9 Jul 2024
Verry happy to share our new paper, This&That, an dynamic robot video generation model with language and simple gestures conditioning! Moreover, we also propose Diffusion Video to Action (DiVA) model to transfer generated videos to robot actions in the rollout environment.
4
20
98
21,911
Mark Van der Merwe retweeted
9 Jul 2024
Imagine controlling robots with simple gestures! We've developed a system that lets you point at objects and tell robots to 'move this' or 'close that,' with language-gesture-controlled video generation! Check out our project dubbed "this&that": cfeng16.github.io/this-and-t…
1
19
107
15,807
Mark Van der Merwe retweeted
15 May 2024
MPC is powerful but doesn’t work well for long-horizon tasks without reference trajectories, which are usually expensive to compute online
Introducing Subgoal Diffuser to generate subgoals at appropriate temporal resolution dynamically to guide MPC
sites.google.com/view/subgoa…
🧵↓
1
18
111
12,317
Mark Van der Merwe retweeted
25 Mar 2024
Zixuan Huang et. al's new #ICRA2024 paper uses diffusion to guide MPC for complex manipulation tasks! Subgoal-Diffuser breaks the task down into reachable subgoals to guide MPC, thus avoiding local minima. Paper: arxiv.org/abs/2403.13085 Video: youtube.com/watch?v=M0gmBtzZ…
1
1
6
403
Mark Van der Merwe retweeted
4 Dec 2023
I successfully defended my PhD! Thank you to my advisor Dmitry Berenson, and my lab mates in the @umicharmlab ! 🎓🔬🤖
If you're interested in hiring me to work on learning & planning for robotic manipulation, send me a message!
14
8
100
6,897
Mark Van der Merwe retweeted
7 Nov 2023
How can a 🤖 plan and control tools (e.g., 🧽 🧹) for contact-rich tasks given visual-language inputs? CALAMARI 🦑 shows how we can handle this problem in a very generalizable and data-efficient way via a spatial-action map representation! (1/n)
@corl_conf
1
12
96
8,046
Mark Van der Merwe retweeted
📢A new way to look at motion planning as online learning in Marco Faroni's RA-L paper! *Key idea*: Bias sampling in a Kinodynamic RRT via a non-stationary multi-armed bandit, where arms are clusters of transitions.
Paper: ieeexplore.ieee.org/document… . Video: youtube.com/watch?v=JUfL7I4i…
1
8
638
7 Jul 2023
Check out our work on detecting contact between a deforming tool and its (unknown) environment! #RSS2023
7 Jul 2023
Home robots need to learn how to use our compliant tools (e.g., sponges). @MarkVanderMerwe's #RSS2023 paper enables simultaneous deformation and contact estimation via implicit representations, paving the way for next-gen dexterous tool-use @umicharmlab @UMRobotics @WiYoungsun
14
551
Mark Van der Merwe retweeted
26 Jun 2023
Robots can slide objects on flat surfaces when they are too big/heavy to lift. But what if they cannot push on the side of the object? Xili Yi shows how robots can use top contact to certifiably push the object to any desired configuration #RSS2023 arxiv.org/abs/2305.14289
4
21
2,229
Mark Van der Merwe retweeted
15 Jun 2023
Close your eyes and pick up two objects, one in each hand. Can you guess their poses just from poking them against each other? Our robots can! Check out MultisSCOPE, Andrea Sipos' paper accepted at RSS 2023: arxiv.org/abs/2305.14204 #RSS2023 @UMRobotics @UMengineering
8
31
3,179
Mark Van der Merwe retweeted
12 Jun 2023
Tactile pose estimation is difficult when we have only a few contacts on the object. Johnson Zhong's CHSEL uses a Quality-Diversity alg. to produce diverse plausible poses from contact and free space info, outperforming previous work. @NimaFazeli7 #RSS2023 johnsonzhong.me/projects/chs…
4
12
3,259
Mark Van der Merwe retweeted
30 May 2023
I'll be presenting our paper on FOCUS tomorrow in the morning #ICRA2023 Come see how a clever tweak to the fine tuning process can improve data efficiency for sim2real transfer!
1
4
247
Mark Van der Merwe retweeted
16 Dec 2022
@MarkVanderMerwe presenting his work at #CoRL2022! Way to go Mark!
1
2
363
Mark Van der Merwe retweeted
13 Dec 2022
📢 How can robots use compliant tools in contact-rich tasks without explicitly modeling their complex mechanics? @MarkVanderMerwe shows a novel multimodal contact-centric approach #CoRL2022! Paper: arxiv.org/abs/2210.03836 & Page: tinyurl.com/2688pv28 @umicharmlab @UMRobotics
1
4
15
Mark Van der Merwe retweeted
10 Dec 2022
📢 How can we enable robots to dexterously manipulate tools with high resolution and high deformation tactile sensors? Check out our paper arxiv.org/abs/2209.13432 at CoRL 2022! Project Page: mmintlab.com/manipulation-vi… @UMRobotics @umicharmlab
1
3
8
Mark Van der Merwe retweeted
9 Dec 2022
📢 Interested in learning to use sight and touch to model deformable objects? Check out our paper VIRDO arxiv.org/abs/2210.03701 #CoRL2022 to see how implicit representations seamlessly integrate multimodal sensing in the real-world. @WiYoungsun @andyzengtweets @peteflorence
1
8
30