co-founder of prox | cs @mit

Joined March 2012
13 Photos and videos
Dima Yanovsky retweeted
Prox (@try_prox) builds digital co-workers for 3PLs and fulfillment centers - companies that store, pack, and ship for brands. They automate the back-office operations layer that burns billions of labor hours across the industry.
11
11
73
15,862
1/4 We recreated a $200k teleoperation setup in VR for just ~$2k. Now we can collect more dextrous manipulation data in a single day (40 hrs/day) than any existing open dataset has ever collected.
7
8
40
2,820
3/4 Not having those kinds of resources, we built an interface to teleoperate bimanual Shadow Hands in Apple Vision Pro. Robotics always starts with failure, so we spent weeks failing over and over again until we got the setup running smoothly at 30Hz.
1
10
795
4/4 We currently have 5 Apple Vision Pros, which means our throughput is roughly 40 hours of teleoperation data per day. This means we can collect more data per day than any existing open dataset in this category has ever collected. Here's how we did it: proxrobotics.com/projects/sh…
1
11
1,254
we outta here 🫡 @MIT
11
2
185
10,763
1/Robotics foundation models need internet-scale data to train, and we bet simulation datasets will help reach this scale. It's time to build tools enabling this. So, we're releasing first public app for robot data collection in Vision Pro and a platform to curate datasets
1
3
25
2,908
4/ dartplayground.com runs beautifully on mobile devices as well, since it is powered by MuJoCo compiled to WebAssembly. And this isn’t just a video recording!! It’s the actual physics engine running in your browser, replaying the demonstrations in real time.
1
9
1,128
5/ App Store: apps.apple.com/app/id6741334… Project website: dexhub.ai/project The DART project was developed at the Improbable AI Lab at MIT CSAIL, under @younghyo_park and @pulkitology. DM me if you want to try in-person teleoperation in Vision Pro. I’ll be in SF this summer
7
714
🤝
22 Mar 2025
i got to teleoperate robot hands with my hands using the vision pro. @yanovskyd is literally the coolest roboticst ever. crazy new robotics foundation models will be made with this data. we're so back.
19
2,986
Dima Yanovsky retweeted
1/ Built an open-source version of @Neuralink demos with @yanovskyd using the brain of a monkey named Jenkins! Leader moves → Transformer generates synthetic spikes → MLP decodes it back → Follower mirrors movement. How hard is this as an ML problem? Let’s find out! 👉
24
27
100
15,439
1/ We figured out how to use monkey brain data to operate robotic arms. We then trained a model to generate synthetic brain data from robotic arm movements and made the first-ever synthetic brain data generation browser game. Project Jenkins (open-source) by @anzahorodnii & me
33
98
682
79,566
6/ One big hurdle on the robotics side was working with inverse kinematics. The robots received coordinates to move to, then inverse kinematics solvers calculated servo angle positions to reach that point.
1
13
2,063
7/ The challenge was that default solvers have no awareness of the robot's surroundings, sometimes creating trajectories through the table that caused the arm to slam into it. We used the ikpy library to create kinematics chains for both Koch V1.1 (@taurobotics) robotic arms.
1
21
2,014