All closed-source frontier labs use tons of open-source all over the stack, starting from python,
@PyTorch,
@huggingface all the way down to RoPE, GQA, flash-attention, or any tiny improvements released by open-source players.
The whole transformers architecture (the T in gpT) comes from an open research paper and open-source model from 2017:
huggingface.co/papers/1706.0…
This is ok but would be much nicer if they would acknowledge the contributions & contribute back more!