• HarkMahlberg@kbin.social
    link
    fedilink
    arrow-up
    6
    ·
    1 year ago

    Hikaru Nakamura tried to play ChatGPT in a game of chess, and it started making illegal moves after 10 moves. When he tried to correct it, it apologized and gave the wrong reason for why the move was illegal, and then it followed up another illegal move. That’s when I knew that LLM’s were just fragile toys.

    • exscape@kbin.social
      link
      fedilink
      arrow-up
      4
      ·
      1 year ago

      It is after all a Large LANGUAGE Model. There’s no real reason to expect it to play chess.

      • Pons_Aelius@kbin.social
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        1 year ago

        There’s no real reason to expect it to play chess.

        There is. All the general media is calling these LLMs AI and AIs have been playing chess and winning for decades.

    • FaceDeer@kbin.social
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      You can get ChatGPT to play a much better game by telling it to display a representation of the current state of the board after each move, that way it doesn’t lose track of where the pieces are as easily. But still, given that these LLMs were never specifically trained to play chess in the first place it’s amazing how well they do. It’d be like if I set up a chessboard for my dog and 90% of the moves she made were actually valid, rather than simply knocking over all the pieces and then wagging her tail in expectation of the treat she thinks she’s earned by doing so.