GPU Software @ NVIDIA - Creator of PyG (PyTorch Geometric) - Founding Engineer @ Kumo - PhD @ TU Dortmund University - Graph Representation Learning

Joined November 2017
17 Photos and videos
Matthias Fey retweeted
TGM is accepted to #ICLR2026 🚀 We are also releasing TGM Beta 2, continue to build efficient, open library for temporal graph ML. Thanks to my team: Jacob Chmura, @ntgbaoo87, @aliparviza, Farimah Poursafaei, @jure, @mmbronstein, Guillaume Rabusseau, @rusty1s, Reihaneh Rabbany.
1
2
14
6,284
Matthias Fey retweeted
🚀 Announcing RelBench V2, a major update to our benchmark for foundation models on relational data! With V2, we are significantly expanding the benchmark’s scope to catalyze further research in Relational Deep Learning (RDL) and Relational Foundation Models (RFMs). Key features: 🍺 4 new databases, spanning domains like e-commerce and beer reviews to scientific research and clinical healthcare. 🧩 40 new predictive tasks, including 28 autocomplete tasks, across new and existing databases. 🔌 External data integrations: 70 datasets from CTU, 7 datasets from 4DBInfer, and your own data via SQL connector, all in RelBench format. 🛠️ Bug fixes and performance improvements. 🔥 Introducing autocomplete tasks: As opposed to forecasting tasks, autocomplete tasks predict existing columns in the database. We found that models need to deeply understand the relational context to autocomplete database fields, a critical capability that expands the scope of real-world RDL applications. Learn more: 🌐 Website: relbench.stanford.edu 💻 GitHub: github.com/snap-stanford/rel… Huge thanks to @justingu32 @_rishabhranjan_ @jakub_peleska @VHudovernik @CKanatsoulis @fengyuli607, Tang Haiming, Alistiq and everyone else who contributed to our GitHub for making this possible!
24
41
4,928
Matthias Fey retweeted
Although relational databases are everywhere, there is no equivalent of the public internet for pretraining Relational Foundation Models (RFMs). Excited to see RelBench bridging that gap, growing from 7 datasets in v1 to 88 datasets in v2. Deeply grateful to the numerous community contributions for helping RelBench serve as the central data repository for RFM research. ❤️
🚀 Announcing RelBench V2, a major update to our benchmark for foundation models on relational data! With V2, we are significantly expanding the benchmark’s scope to catalyze further research in Relational Deep Learning (RDL) and Relational Foundation Models (RFMs). Key features: 🍺 4 new databases, spanning domains like e-commerce and beer reviews to scientific research and clinical healthcare. 🧩 40 new predictive tasks, including 28 autocomplete tasks, across new and existing databases. 🔌 External data integrations: 70 datasets from CTU, 7 datasets from 4DBInfer, and your own data via SQL connector, all in RelBench format. 🛠️ Bug fixes and performance improvements. 🔥 Introducing autocomplete tasks: As opposed to forecasting tasks, autocomplete tasks predict existing columns in the database. We found that models need to deeply understand the relational context to autocomplete database fields, a critical capability that expands the scope of real-world RDL applications. Learn more: 🌐 Website: relbench.stanford.edu 💻 GitHub: github.com/snap-stanford/rel… Huge thanks to @justingu32 @_rishabhranjan_ @jakub_peleska @VHudovernik @CKanatsoulis @fengyuli607, Tang Haiming, Alistiq and everyone else who contributed to our GitHub for making this possible!
3
9
729
Matthias Fey retweeted
Transformers are great for sequences, but most business-critical predictions (e.g. product sales, customer churn, ad CTR, in-hospital mortality) rely on highly-structured relational data where signal is scattered across rows, columns, linked tables and time. Excited to finally share what I have been working on over the last year: a Foundation Model architecture which brings the power of Transformers to relational domains, enabling large-scale pretraining and zero-shot generalization in enterprise settings. 🧵1/n
5
40
152
60,526
20 May 2025
Excited to announce Relational Foundation Models, moving supervised Relational Deep Learning into the in-context learning setting: ✅On-the-fly training-free predictions ✅Impressive out-of-the-box performance Paper: shorturl.at/M6ciN Try For Free: kumorfm.ai
2
13
58
9,677
Matthias Fey retweeted
20 May 2025
🚀 Introducing KumoRFM — the world’s first Relational Foundation Model purpose-built for enterprise prediction tasks! KumoRFM reasons over complex relational data to deliver instant, accurate, in-context predictions — no task-specific model training required. A true game-changer for solving key business problems like: ✅ Product recommendations ✅ Fraud detection ✅ Customer retention 🔗 Explore KumoRFM: kumorfm.ai 📄 Read the paper: kumo.ai/research/kumo_relati… 💡 Learn more: kumo.ai/company/news/kumo-re… #AI #EnterpriseAI #RelationalAI #FoundationModels #MachineLearning #KumoRFM #PredictiveAI4o
2
14
84
63,669
Matthias Fey retweeted
6 Feb 2025
Introducing the new Kumo platform: Build predictive and embedding models directly on your relational data — without feature engineering. Go from predictive modeling to predictive AI. hubs.ly/Q035xfgP0
2
5
35
12,393
Matthias Fey retweeted
🎉 Excited to announce the release of ContextGNN, our state-of-art and scalable recommendation model from Kumo! 🔗 ContextGNN paper: arxiv.org/abs/2411.19513 What makes ContextGNN unique? It combines pair-wise and two-tower representations into a single architecture, enabling GNN-based recommendation systems to capture both repeated patterns and exploratory user preferences. 💻 Source Code on GitHub: github.com/kumo-ai/ContextGN… This milestone wouldn’t have been possible without the incredible collaboration of my amazing colleagues. Thank you all for being part of this journey! 🙌 (Shoutout to: @zechengzh Xinwei He @aki_bayes @weihua916 @yaoyaowd @manans99 @shenyangHuang @BlazStojanovic Alan Krumholz @janericlenssen @jure @rusty1s @Kumo_ai_team)
4
19
6,108
Matthias Fey retweeted
7 Oct 2024
💠 Stanford Graph Learning Workshop 2024! Join leaders from academia and industry to explore the latest in Machine Learning and AI. Topics include Relational domains, Foundation Models, Agents and more. Save the date: Tuesday, Nov 5, 2024, 09:00 - 18:00 PT. The event will be held at Stanford University and live-streamed online. Register and/or submit a talk/poster: snap.stanford.edu/graphlearn…
3
46
166
19,489
19 Sep 2024
PyG 2.6 is here, including new models and examples on how to combine GNNs with LLMs! Thanks to many contributors who have made this release possible. Full release notes👇 github.com/pyg-team/pytorch_…
25
131
5,250
Matthias Fey retweeted
29 Aug 2024
What an exciting week it has been at the #KDD conference in Barcelona! We were thrilled to be here and to have two of our very own, Hema Raghavan and Matthias Fey, speak on graph learning for enterprise and responsible graph neural networks.
1
14
875
Matthias Fey retweeted
30 Jul 2024
🚀 Announcing RelBench: an open benchmark for deep learning on relational databases! RelBench is the foundational infrastructure for research in Relational Deep Learning (RDL), which brings modern AI to structured data. RelBench has databases, tasks, loaders, evaluators, and leaderboards to catalyze research in the field! Key features: 🌍 7 datasets spanning diverse domains: e-commerce, social, medical, and sports. 🧩 30 carefully curated predictive tasks: including entity classification/regression and recommendation. 📊 Wide data size range: ranging from 74K to 41M rows, 15 to 140 columns, 3 to 15 tables. ⏳ Wide time spans: from 2 weeks to 55 years of training data. 🏅 Comprehensive benchmarks: SOTA tabular learning and GNN baselines for every task. 🔥We hired a data scientist with 5 years of industry experience to solve RelBench tasks using traditional machine learning (feature engineering, model training). The RDL outperforms the data scientist in accuracy while reducing the time/code by 20x (12.3 hors -> 0.5 hours) !!! 🤯 Learn more: 🌐 Website: relbench.stanford.edu 📄 Paper: arxiv.org/abs/2407.20060 💻GitHub: github.com/snap-stanford/rel… Follow @RelBench for the latest updates Shoutout to the amazing team: @Josh_d_robinson @_rishabhranjan_ @weihua916 @KexinHuang5 @jiaqihan99 @adobles96 @rusty1s @janericlenssen @yiwenyuan98 @zechengzh @xhe1997 @Kumo_ai_team @PyG_Team @StanfordAILab
4
56
205
21,950
Matthias Fey retweeted
3 Apr 2024
Check out our PyTorch Frame tech report arxiv.org/abs/2404.00776 We aim to push tabular deep learning to handle complex multi-modal, multi-tabular data, beyond conventional single-tabular data. We do so by seamlessly integrating PyTorch Frame with LLMs and Graph Neural Nets!
18 Dec 2023
🚀🎉 Excited to announce 🌟 PyTorch Frame 🌟 - our new open-source initiative in PyTorch! Dive into multi-modal tabular deep learning like never before! Link: github.com/pyg-team/pytorch-… #PyTorch #OpenSource (1/6)
1
25
128
20,640
28 Feb 2024
📢 We are hosting a webinar on March 6th 8am PT/5pm CET on the latest PyG release. The webinar covers everything you need to know about PyG 2.5, including a live demo on how set up and use our new distributed GNN training solution. Register for free 👇 eventbrite.com/e/webinar-pyg…
1
8
50
3,346
16 Feb 2024
📢 Excited to release PyG (PyTorch Geometric) v2.5, including distributed training, a dedicated graph tensor representation, RecSys support, PyTorch 2.2 and native compilation support 🎉 Release Notes 👇 github.com/pyg-team/pytorch_… 🧵 A thread [1/6]
5
35
246
15,737
16 Feb 2024
[5/6] PyG 2.5 introduces a full re-implementation of its message passing interface, which makes it natively applicable to torch.compile and TorchScript.
2
5
667
16 Feb 2024
[6/6] As always, PyG brings full support for the latest PyTorch version. Special thanks to all contributors who have made this release possible 🤗
1
4
572