Animation ๐ค Robotics
ProtoMotions GTC 2026 release โ bridging the gap between digital humans and real humanoid robots.
Train in simulation. Deploy on hardware. One framework, one codebase.
nvlabs.github.io/ProtoMotionโฆ
Just arrived at San Diego for #Neurips2025 โ๏ธ
If you're interested in
- Tactile sensing ๐ซฐ
- Uncertain decision making โ๏ธ
- Medical robotics ๐ฉบ
Reach out or come see if you process touch better than AI at our poster on Fri 16:30-19:30 #2206.
@NeurIPSConf
1. Train a behavior foundation model with a rich token-based representation (eg, MaskedMimic).
2. Fine tune a state-based tokenizer using RL, leveraging the BFM for meaningful gradients.
=> Converge 6x faster, 50x less params, dramatically improved robustness.
Behavior models are great โ but getting them to do *exactly* what you want takes *tons* of prompt hacking (just like vision-language models) ๐ช
No more, with our new work ๐ฐ -
Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models
As our base BFM we use the great work MaskedMimic by Tessler et al. x.com/ChenTessler/status/183โฆ, although our approach can be extended to other BFMs with a transformer-based architecture
9/10
โจThe potential of Task Tokens is truly exciting! Imagine seamlessly adapting behavior models to various tasks with just a few learned params - 5 tasks using just ~1M vs standard HRL using ~125M.
This is a promising step towards more flexible and generalizable AI behavior๐
10/10
Parallels between AI and #LK99:
- Both are modern-day alchemy. Just try more recipes until eureka.
- The holy grail is simpler than we expected.
- Lots of hyperparameters to tune.
- Random seeds matter.
- Arxiv is the new battlefield.
- Scaling up is the key.
- Tend to break the internet with every update.
- Fastest growth in Twitter experts.
- Democratization: there will be GPT-4's from big corps, and Alpaca's from grassroots.
Some of my early experiments with @runwayml GEN-1
Itโs still early days of AI video - this tech will only get better. A whole new generation of filmmakers is gonna be able to make whatever they want on zero budget
See below for my process
"Pyrallis, a year has passed
And your library's made coding a blast
Configuring projects is now so swift
And it's all thanks to your magical gift"
- ChatGPT
Pyrallis is celebrating its first birthday with 20K installs ๐๐
Join the configvolution ๐github.com/eladrich/pyrallis