Joined January 2021
3 Photos and videos
Such a great task choice @kylieyying ! Teaching robots to be confident in their movements and promote fair allocation of limited resources šŸ˜Ž
In my first week at @GeneralistAI, I trained a robot to pour liquids using GEN-1 šŸ¤–šŸ’§ I wanted to challenge the robot with a non-rigid manipulation task, so liquid felt like the perfect choice. The task involved: - unscrewing the bottle cap - pouring liquid into espresso glasses - rebalancing uneven pours Best of all, the robot was able to complete the task fully autonomously 3 times in a row (out of 3)! Pour-fect šŸ˜‰ Excited for the journey ahead and grateful to be building alongside such an incredible team!
1
1
12
2,815
Coline Devin retweeted
Gen-1 ties zipties Read more about Gen-1 in our blog posts in the comments below ↓
6
28
217
36,135
Coline Devin retweeted
Today marks the end of my first full week @GeneralistAI Last Monday, I was given a challenge: use our GEN-1 model to teach a robot a task of my choosing, using the same no-code platform our customers use. I picked the ball-and-vase magic trick. It was one of my favorites as a kid, and it felt like the right mix of fun and surprisingly hard. A few days later, GEN-1 pulled it off. I left Friday having watched the robot nail it 14 times in a row. What’s wild is that even 4 months ago, if you told me you could go from idea to on-robot skill in a couple of days, I probably wouldn’t have believed you. Really excited to be building with an incredible team. Can’t wait to see what week two brings šŸ¤–
14
31
319
38,930
Coline Devin retweeted
GEN-1 cleans white board Read more about GEN-1 in our blog post in the comments below ↓
7
17
245
62,972
Coline Devin retweeted
This was the first take for ā€œI bet it would work with an arbitrary objectā€ šŸ™ƒ
GEN-1 plays the 🐚 shell game, trained on just 1 hr of robot data. It also generalizes to unseen objects, like @BerkayAntmen 's car keys. Physical AI models should be capable of benchmark tasks like this one. It's interesting for the all the reasons @RhodaAI calls out -- requires visual memory, and the model must track the cups from the very start, at high frame rates. Interestingly, GEN-1 appears to exhibit a degree of "active perception." It's subtle; the hands can sometimes appear to "follow" the cups, using its own movements to help attend to where it thinks the object should be. Read more about GEN-1 in our blog post in the comments below ↓
1
14
2,526
Memory is fundamental to robot intelligence. How can you know what to do next if you don't know what happened before?
GEN-1 plays the 🐚 shell game, trained on just 1 hr of robot data. It also generalizes to unseen objects, like @BerkayAntmen 's car keys. Physical AI models should be capable of benchmark tasks like this one. It's interesting for the all the reasons @RhodaAI calls out -- requires visual memory, and the model must track the cups from the very start, at high frame rates. Interestingly, GEN-1 appears to exhibit a degree of "active perception." It's subtle; the hands can sometimes appear to "follow" the cups, using its own movements to help attend to where it thinks the object should be. Read more about GEN-1 in our blog post in the comments below ↓
4
22
3,369
Our robots have been busy lately!
Everyday for the past 2 weeks, we've been sharing something new from GEN-1, our latest milestone in scaling robot learning. This has never been done before. Going from ideas to skills in days (or faster) is what physical AI models should deliver. More coming. Stay tuned. Read more about it in our blog post in the comments below ↓
2
27
3,987
Coline Devin retweeted
GEN-1 plays with fidget toy. Other tasks GEN-1 can do: youtube.com/playlist?list=PL… Read more about GEN-1, our latest foundation model for the physical world: generalistai.com/blog/apr-02…
6
21
133
17,812
I love the little clicks when the pins are placed into the bowl <3
GEN-1 removes thumbtacks and papers from corkboard. Other tasks GEN-1 can do: youtube.com/playlist?list=PL… Read more about GEN-1, our latest foundation model for the physical world: generalistai.com/blog/apr-02…
1
1
16
1,448
Coline Devin retweeted
GEN-1 puts plushies into polybags, in a warehouse outside the lab in New Hampshire.
14
60
441
102,094
An orange a day keeps the ...robot repairman away?
Orange you glad our robot can stack? Other tasks GEN-1 can do: youtube.com/playlist?list=PL… Read more about GEN-1, our latest foundation model for the physical world: generalistai.com/blog/apr-02…
1
10
1,340
Coline Devin retweeted
I love this one, because deploying a robot then ā€œintegrating with customer APIsā€ is not fun. But a lot simpler when your robot can push the same buttons as a human šŸ‘†or use a touch screen. Also, GEN-1 has memory too — it learns to ā€œrememberā€ which sock it put away, then taps.
GEN-1 sorts socks and uses a touchscreen stylus. Done in collaboration with a partner on the Generalist platform. More on this soon.
5
8
58
8,805
You shouldn't need a PhD to teach a robot new tasks. Using our platform, partners can do this without a writing a single line of code.
GEN-1 sorts socks and uses a touchscreen stylus. Done in collaboration with a partner on the Generalist platform. More on this soon.
2
2
45
5,527
Zip-zip
GEN-1 puts pens into zipper bag. Robot’s view, pixels into the model.
12
1,211
Coline Devin retweeted
GEN-1 puts pens into zipper bag. Robot’s view, pixels into the model.
6
12
181
27,404
Coline Devin retweeted
As a PhD student, I worked on methods to generalize across motion, objects, lighting, backgrounds, etc. Each is hard, and there’s always a long tail. (E.g. my robot still can’t handle new camera views—hence the ā€œDon’t move! Thx :)ā€ sign.) But if you have enough data to train from scratch, many of these generalization problems start to disappear. You get them almost ā€œfor free.ā€ What’s powerful is the clarity you get when you start from the goal, not from a favored method: data is a key bottleneck to remove on the path to physical AGI. And working backwards from first principles, there may be ways to solve the data problem that aren’t actually that expensive. That unlocks the freedom to train from scratch with simple methods, not crutches.
goals are more powerful than methods
5
55
4,366
don't need a robot to teach a robot
0 robot data. Less than 2hrs of human data. Model opens its eyes and suddenly sees it’s become a robot.
1
2
20
2,871
Coline Devin retweeted
This is GEN-1 putting paper bills into a wallet. Paper has always been deceptively hard for robots. Thin, deformable, and unforgiving—it bends, folds, and slips. Not precise, you miss. Too much force, you crumple. Easy for humans. But for robots, it’s a full-stack challenge.
37
117
745
219,086
Coline Devin retweeted
Hear more about GEN-1 and improvisational intelligence from our own researchers @coolboi95 and @felixwyw
6
12
94
20,498