Head of AI @ Wayve; ex-Research Manager @ TRI; ex-Amazon; ex Apple. CMU / MIT

Joined October 2008
Photos and videos
Thomas Kollar retweeted
Meet LA-Pose. Our latest model taking Wayve another step towards generalization at scale. LA-Pose employs large-scale self-supervised learning, building strong motion representations for 3D perception from 10.2 million unlabeled driving video snippets, unlike today's strongest approaches that often depend on expensive, carefully curated 3D supervision. With only a lightweight pose head and limited labelled data, LA-Pose achieves: πŸ“· State-of-the-art camera pose estimation 🌎 Strong zero-shot generalization across diverse driving scenarios 🏷️ Orders of magnitude less labelled data than fully supervised 3D approaches Our full blog post: wayve.ai/thinking/la-pose/ Explore the full paper here: la-pose.github.io/
1
37
146
36,451
Thomas Kollar retweeted
Nissan and #Wayve have signed a partnership agreement that will bring our next-gen #ProPILOT driver assistance tech powered by Wayve #AI to a broad range of #Nissan vehicles. Nissan aims to first launch the next-gen tech in Japan in fiscal year 2027. global.nissannews.com/en/rel…
4
32
132
23,837
Thomas Kollar retweeted
2 Dec 2025
GAIA 3 introduces four powerful new capabilities that unlock richer and more scalable evaluation of autonomous driving systems. 🌍 🧡 Follow the thread below to see examples of; 1. Long perturb generations πŸš— 2. Safety augmentations ⚠️ 3. Semantic augmentations πŸŒ€οΈπŸŒ…πŸŒ™ 4. Embodiment transfer πŸš˜πŸ“· GAIA 3 re-generates the same scenario as if observed from different vehicles with different camera positions. One scene, three embodiments, consistent dynamics. Ideal for testing models across different hardware setups. These advances show how GAIA-3 brings new realism, diversity, and scale to the evaluation of end-to-end driving systems. πŸš€ Dive into the full blog: wayve.ai/thinking/gaia-3/ Every clip you see below is generated by GAIA-3.πŸ‘‡ #GAIA3 #EmbodiedAI #AISafety #GenerativeAI #AutonomousVehicles
1
8
37
3,871
Thomas Kollar retweeted
Big things cooking in Tahoe... πŸš€
1
1
20
1,716
Thomas Kollar retweeted
It's awesome to be back in the Bay Area this week at @wayve_ai's other North American office. I can't wait to test the massive progress the team's been making on rides around the Bay Area and city while I'm here, and to meet with our science leaders @vijaycivs @tkollar @gianlucacorrado and others to galvanise the groups at the start of an incredibly exciting #YearOfEmbodiedAI ahead! #Science #Team #EmbodiedAI
1
1
32
1,274
19 Jun 2024
Building language models is difficult and requires high quality preprocessing, modeling, evaluation and large scale training. As significant collaborators in this project at TRI, the resulting 7B model DCLM-7B is a significant achievement. It is a competitor to Mistral 7B and LLaMA-7B, even though trained on less data. And it’s fully open. And that’s just the start of the competition. Excited to see how others leverage these results to build even more capable language models and improve dataset quality.
I am really excited to introduce DataComp for Language Models (DCLM), our new testbed for controlled dataset experiments aimed at improving language models. 1/x
1
1
3
885
19 Jun 2024

18 Jun 2024
Check out DataComp for language models! Open data, open code, open training recipe, and close to Llama3-8B performance. This has been a labor of love over the last year, a huge thanks to all the collaborators for helping make this happen!
1
323
13 Feb 2024
Excited to release Prismatic! Cutting through the noise of vision-language modeling, Prismatic is a release of 42 pre-trained VLMs from the 7B to 13B scale, a codebase for rigorous evaluation and a myriad of insights for what matters for performance.
What design choices matter when developing a visually-conditioned language model (VLM)? Check out our paper – Prismatic VLMs – and open-source training code, evaluation suite, and 42 pretrained VLMs at the 7B-13B scale! πŸ“œ arxiv.org/abs/2402.07865 βš™οΈ πŸ€— github.com/TRI-ML/prismatic-…
2
1
10
1,609
15 Jun 2024
x.com/siddkaramcheti/status/… More info on Prismatic here.

What design choices matter when developing a visually-conditioned language model (VLM)? Check out our paper – Prismatic VLMs – and open-source training code, evaluation suite, and 42 pretrained VLMs at the 7B-13B scale! πŸ“œ arxiv.org/abs/2402.07865 βš™οΈ πŸ€— github.com/TRI-ML/prismatic-…
160
15 Jun 2024
By first developing some of the best Vision-Language Models with Prismatic at TRI: github.com/TRI-ML/prismatic-… OpenVLA was able to quickly build some of the best generalist policies for robotics. Code, data and weights are all open-source: openvla.github.io This is a great achievement! Congrats @moo_jin_kim @siddkaramcheti @KarlPertsch @ashwinb96 @SurajNair_1 and all collaborators.
✨ Introducing πŽπ©πžπ§π•π‹π€ β€” an open-source vision-language-action model for robotics! πŸ‘ - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset πŸ€– - fully open: model/code/data all online πŸ€— πŸ§΅πŸ‘‡
2
8
1,497
Thomas Kollar retweeted
Recurrent models like RWKV and Mamba have gained attention recently, but these can be costly to train and iterate on. What if we could simply... turn Mistral/Llama/Gemma into an RNN? 🎩πŸͺ„ Presenting our work, Linearizing Large Language Models! arxiv.org/abs/2405.06640
4
32
165
19,569
22 Apr 2024
Over the last year at TRI we’ve been training Large Language Models, including results in the following areas: Scaling: arxiv.org/abs/2403.08540 Alignment: arxiv.org/abs/2402.12366 As a part of upcoming work, we are sharing back with the open source community and releasing a performant Mamba model that we’ve trained at the 7B parameter scale. More results on linear transformers upcoming.
πŸ“’ Releasing TRI's open-source Mamba-7B trained on 1.2T tokens of RefinedWeb! Mamba-7B is the largest fully recurrent Mamba model trained and is a state-of-the-art recurrent LLM. πŸš€πŸš€πŸš€ huggingface.co/TRI-ML/mamba-…
1
3
12
2,996
22 Apr 2024
Additional collaborators include @archit_sharma97 @lschmidt3 @ericmitchellai and many more.
1
296
27 Mar 2024
At TRI, we are looking to build Robotics Foundation Models, or what we call Large Behavior Models (LBMs). Large scale robotics datasets, such as DROID are a part of the strategy to enable broadly capable LBMs that include language, vision and action: droid-dataset.github.io When we started this project through our university collaborations nearly 2 years ago, I was amazed the amount of community interest in contributing to the project. TRI has been deeply involved in all stages of dataset collection and release. Looking forward to seeing what the community does with it! cc @MashaItkina @siddkaramcheti @MercatJean @SurajNair_1 and the rest of the TRI DROID team

Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents droid-dataset.github.io A short 🧡 on the backstory
2
2
52
10,340
27 Mar 2024
1
502
27 Mar 2024
319