A new study suggests that so-called emergent abilities actually develop gradually and predictably, depending on how you measure them.

So-called “emergent” behavior in LLMs may not be the breakthrough that researchers think.

  • UraniumBlazer@lemm.eeEnglish
    0·
    9 months ago

    TLDR: Let’s say you want to teach an LLM a new skill. You give them training data pertaining to that skill. Currently, researchers believe that this skill development shows up suddenly in a breakthrough fashion. They think so because they measure this skill using some methods. The skill levels remain very low until they unpredictably jump up like crazy. This is the “breakthrough”.

    BUT, the paper that this article references points at flaws in the methods of measuring skills. This paper suggests that breakthrough behavior doesn’t really exist and skill development is actually quite predictable.

    Also, uhhh I’m not AI (I see that TLDR bot lurking everywhere, which is what made me specify this).

  • spujb@lemmy.cafeEnglish
    01·
    9 months ago

    what material benefit does having a cutesy representation of phrenology, a pseudoscience used to justify systematic racism, bring to this article or discussion?