Tweet by Siméon:

I have this theory that we are in a period of increasing marginal utility of capabilities. GPT-2 to GPT-3 jump was a bigger jump than 3 to 4, which was bigger than 4 to 5. But the utility jumps have been increasing. 

My core thesis for why is that most use cases are bottlenecked… https://t.co/K3cPuA4tus