Tweet by vitrupo:

Sam Altman asks: why are scaling laws a property of the universe?

Daniel Selsam says intelligence emerges from compression—and the universe’s knowledge is a fractal you can keep mining.

In other words, scaling laws keep working because important concepts are sparse but… pic.twitter.com/uAHid8PNFd