• Kogasa
    link
    fedilink
    English
    46 months ago

    No such thing has been “mathematically proven.” The emergent behavior of ML models is their notable characteristic. The whole point is that their ability to do anything is emergent behavior.

    • @huginn
      link
      English
      0
      edit-2
      6 months ago

      Here’s a white paper explicitly proving:

      1. No emergent properties (illusory due to bad measures)
      2. Predictable linear progress with model size

      https://arxiv.org/abs/2304.15004

      The field changes fast, I understand it is hard to keep up

      • Kogasa
        link
        fedilink
        English
        26 months ago

        Sure, if you define “emergent abilities” just so. It’s obvious from context that this is not what I described.

        • @huginn
          link
          English
          -16 months ago

          Their paper uses industry standard definitions

          • Kogasa
            link
            fedilink
            English
            26 months ago

            Their paper uses terminology that makes sense in context. It’s not a definition of “emergent behavior.”