Despite being primarily trained on text, these models achieved remarkable compression rates on image and audio data.
  • Hexagon
    132·
    9 months ago

    We’re likely talking about lossy compression here

    • enkers@sh.itjust.works
      15·
      9 months ago

      That was my first thought as well, but it doesn’t seem to be the case:

      In their study, the Google DeepMind researchers repurposed open-source LLMs to perform arithmetic coding, a type of lossless compression algorithm.

      • Hexagon
        5·
        9 months ago

        … and this is why I should actually read the articles before commenting lol