• Kogasa@programming.dev
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    No such thing has been “mathematically proven.” The emergent behavior of ML models is their notable characteristic. The whole point is that their ability to do anything is emergent behavior.

    • huginn
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      edit-2
      1 year ago

      Here’s a white paper explicitly proving:

      1. No emergent properties (illusory due to bad measures)
      2. Predictable linear progress with model size

      https://arxiv.org/abs/2304.15004

      The field changes fast, I understand it is hard to keep up

      • Kogasa@programming.dev
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        1 year ago

        Sure, if you define “emergent abilities” just so. It’s obvious from context that this is not what I described.

        • huginn
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          1 year ago

          Their paper uses industry standard definitions

          • Kogasa@programming.dev
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Their paper uses terminology that makes sense in context. It’s not a definition of “emergent behavior.”