Finally, my fav result: it's possible to train models on disjoint and biased datasets, then merge them together in weight space.
Eg, you have some data in US, some in EU. Can't mix data due to GDPR etc. Train separate models, merge weights -> generalize to the combined dataset!