Fastest exponential growth of any technology, ever?
2017- Initial paper ("Attention is all you need")
2018- First transformer, GPT, 100M parameters
May 2020- GPT3 100 Billion (10^11)
2021- Google Switch 1.6 Trillion (10^12) parameters.
2023- GPT4?
RT @xamat: My Transformers Catalog has become one of my most popular posts ever. Some of you told me that you turned into a pdf for easier reading. I thought I should make it into an arXiv preprint. Here you go: 60 …
🐦🔗: https://n.respublicae.eu/lugaricano/status/1626368620388286465