Tweet by Martin:

I think we've known for a while that LLMs can only replay data that is in-distribution. That doesn't mean that reasoning queries aren't solving problems, it just means that you have to manage your expectations.

If a model is trained to understand A and B, it still needs an… https://t.co/aYobBI5qfr