Fastest exponential growth of any technology, ever?

2017- Initial paper ("Attention is all you need")

2018- First transformer, GPT, 100M parameters

May 2020- GPT3 100 Billion (10^11)

2021- Google Switch 1.6 Trillion (10^12) parameters.

2023- GPT4?
RT @xamat: My Transformers Catalog has become one of my most popular posts ever. Some of you told me that you turned into a pdf for easier reading. I thought I should make it into an arXiv preprint. Here you go: 60 …

🐦🔗: https://n.respublicae.eu/lugaricano/status/1626368620388286465