Computer Vision Researcher.

Joined April 2022
9 Photos and videos
Pinned Tweet
Super excited to share our work "NeRN" where we create neural representations for the weights of a specific neural network!
Iโ€™m very excited to share our new work titled โ€œNeRN - Learning Neural Representations for Neural Networksโ€. Preprint and code are available now๐Ÿ˜Š๐Ÿงต @ZoharRimon @ronvain @levishir667 @EladRichardson @PinkyMintz Paper: arxiv.org/abs/2212.13554 Code: github.com/maorash/NeRN/ [1/9]
1
4
362
Ron Vainshtein retweeted
Animation ๐Ÿค Robotics ProtoMotions GTC 2026 release โ€” bridging the gap between digital humans and real humanoid robots. Train in simulation. Deploy on hardware. One framework, one codebase. nvlabs.github.io/ProtoMotionโ€ฆ
6
35
130
8,255
Ron Vainshtein retweeted
Just arrived at San Diego for #Neurips2025 โœˆ๏ธ If you're interested in - Tactile sensing ๐Ÿซฐ - Uncertain decision making โ†”๏ธ - Medical robotics ๐Ÿฉบ Reach out or come see if you process touch better than AI at our poster on Fri 16:30-19:30 #2206. @NeurIPSConf
25 Nov 2025
Can we use tactile sensors for soft object imaging?๐Ÿค” YES! Toward Artificial Palpation: Representation Learning of Touch on Soft Bodies. @shafer_eli , @talt80, @Efrat_Shimron, @AvivTamar1. Paper, videos, data: zoharri.github.io/artificialโ€ฆ Check us out at @NeurIPSConf #neurips2025!
3
11
629
Ron Vainshtein retweeted
1. Train a behavior foundation model with a rich token-based representation (eg, MaskedMimic). 2. Fine tune a state-based tokenizer using RL, leveraging the BFM for meaningful gradients. => Converge 6x faster, 50x less params, dramatically improved robustness.
๐Ÿš€Using BFMs to learn a new task with less than 0.1% additional params while still enabling user input??๐Ÿš€ Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models ๐Ÿ“„: arxiv.org/abs/2503.22886 ๐Ÿ’ป: github.com/rvainshtein/task-โ€ฆ w/@ZoharRimon @shiemannor @ChenTessler ๐Ÿงต1/10
1
8
58
6,764
Ron Vainshtein retweeted
14 Apr 2025
Behavior models are great โ€” but getting them to do *exactly* what you want takes *tons* of prompt hacking (just like vision-language models) ๐Ÿ˜ช No more, with our new work ๐Ÿ“ฐ - Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models
๐Ÿš€Using BFMs to learn a new task with less than 0.1% additional params while still enabling user input??๐Ÿš€ Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models ๐Ÿ“„: arxiv.org/abs/2503.22886 ๐Ÿ’ป: github.com/rvainshtein/task-โ€ฆ w/@ZoharRimon @shiemannor @ChenTessler ๐Ÿงต1/10
1
1
6
312
๐Ÿš€Using BFMs to learn a new task with less than 0.1% additional params while still enabling user input??๐Ÿš€ Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models ๐Ÿ“„: arxiv.org/abs/2503.22886 ๐Ÿ’ป: github.com/rvainshtein/task-โ€ฆ w/@ZoharRimon @shiemannor @ChenTessler ๐Ÿงต1/10
2
14
60
8,727
As our base BFM we use the great work MaskedMimic by Tessler et al. x.com/ChenTessler/status/183โ€ฆ, although our approach can be extended to other BFMs with a transformer-based architecture 9/10

Excited to share our latest work! ๐Ÿคฉ Masked Mimic ๐Ÿฅท: Unified Physics-Based Character Control Through Masked Motion Inpainting Project page: research.nvidia.com/labs/parโ€ฆ with: Yunrong (Kelly) Guo, @ofirnabati, @GalChechik and @xbpeng4. @SIGGRAPHAsia (ACM TOG). 1/ Read along! ๐Ÿ˜ƒ
1
184
โœจThe potential of Task Tokens is truly exciting! Imagine seamlessly adapting behavior models to various tasks with just a few learned params - 5 tasks using just ~1M vs standard HRL using ~125M. This is a promising step towards more flexible and generalizable AI behavior๐Ÿ˜Š 10/10
1
110
Ron Vainshtein retweeted
2 Aug 2023
Parallels between AI and #LK99: - Both are modern-day alchemy. Just try more recipes until eureka. - The holy grail is simpler than we expected. - Lots of hyperparameters to tune. - Random seeds matter. - Arxiv is the new battlefield. - Scaling up is the key. - Tend to break the internet with every update. - Fastest growth in Twitter experts. - Democratization: there will be GPT-4's from big corps, and Alpaca's from grassroots.
32
138
955
309,435
Ron Vainshtein retweeted
ืœื™ื™ื‘ื˜ื•ื™ื˜ ืžื”ืฉื™ื—ื” ืฉืœ ืกืื ืืœื˜ืžืŸ ื‘ืื•ื ' ืชืœ ืื‘ื™ื‘. ืœื ื‘ืœื™ื™ื‘, ื›ื™ ืœื ื”ื™ื™ืชื™ ืฉื. ืจื•ืื” ืืช ื”ื”ืงืœื˜ื” ื•ื–ื•ืจืง ื›ืืŸ ืืช ื›ืœ ื”ืžื—ืฉื‘ื•ืช ืฉืœื™ ืคืœื•ืก ืชืžืœื•ืœ. ืื–: ืกื ืืœื˜ืžืŸ, ืžื ื›"ืœ OpenAI ื•ื”ืฉื ืฉื—ืœืงื›ื ืคื—ื•ืช ืžื›ื™ืจื™ื - ืื™ืœื™ื” ืกื•ืฆืงื‘ืจ, ื”ืžื“ืขืŸ ื”ืจืืฉื™ ืฉืœ OpenAI ืฉื”ื•ื ื™ืฉืจืืœื™ ืœืฉืขื‘ืจ ืฉืœืžื“ ืคื” ื‘ืืจืฅ. >> youtube.com/watch?v=mC-0XqTAโ€ฆ
9
4
98
25,848
Bard's draft 2 is almost always better
2
47
Ron Vainshtein retweeted
Nice, love the concept ๐Ÿ“ฆ
Some of my early experiments with @runwayml GEN-1 Itโ€™s still early days of AI video - this tech will only get better. A whole new generation of filmmakers is gonna be able to make whatever they want on zero budget See below for my process
1
2
352
Hands down the best way to handle configs in your python code. Definitely give this a try, I'm a huge fan ๐Ÿ‰
"Pyrallis, a year has passed And your library's made coding a blast Configuring projects is now so swift And it's all thanks to your magical gift" - ChatGPT Pyrallis is celebrating its first birthday with 20K installs ๐Ÿ˜Š๐ŸŽ‚ Join the configvolution ๐Ÿ‰github.com/eladrich/pyrallis
3
151
Ron Vainshtein retweeted
Really excited to see this paper released! Great work by the authors! Hoping to see it integrated into diffusers soon ๐Ÿคฉ @huggingface
1 Feb 2023
Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models abs: arxiv.org/abs/2301.13826 project page: attendandexcite.github.io/Atโ€ฆ github: github.com/AttendAndExcite/Aโ€ฆ
1
3
34
13,354