• exanime@lemmy.today
    link
    fedilink
    English
    arrow-up
    11
    ·
    7 months ago

    Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

    • EatATaco@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      5
      ·
      7 months ago

      Chat GPT had the book entirely memorized

      I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

      • TachyonTele@lemm.ee
        link
        fedilink
        English
        arrow-up
        12
        ·
        7 months ago

        They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.