Understanding Emergent Abilities of Language Models from the Loss Perspective

Discussed in 1 episode

Episodes

#5442: When Do LLMs Suddenly Get Good at Things?

New capabilities seem to appear out of nowhere as models scale. Whether that's real — or just how we measure — is still an open fight.

Main topic Sep 22