• huginn
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    2
    ·
    edit-2
    1 year ago

    Here’s a white paper explicitly proving:

    1. No emergent properties (illusory due to bad measures)
    2. Predictable linear progress with model size

    https://arxiv.org/abs/2304.15004

    The field changes fast, I understand it is hard to keep up

    • Kogasa@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      Sure, if you define “emergent abilities” just so. It’s obvious from context that this is not what I described.

      • huginn
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        1 year ago

        Their paper uses industry standard definitions

        • Kogasa@programming.dev
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Their paper uses terminology that makes sense in context. It’s not a definition of “emergent behavior.”