Tweet by Dan Hendrycks:

I think the case for an intelligence explosion rests on suspicious algorithmic efficiency estimates.

It's claimed that every year we get 10^0.5 algorithmic efficiency improvements, or 10x every two years. It's been 2 years since GPT-4, which was trained on ~20K A100s for 3…