The Degradation of GPT-4

An explanation for why GPT-4 is degrading:

"... we find that on datasets released before the LLM
training data creation date, LLMs perform surprisingly better than on datasets released after"

New tasks are difting away from what GPT-4 was trained on. pic.twitter.com/k4i7nv0ULz

— Chomba Bupe (@ChombaBupe) December 31, 2023