• sudneo@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    5 days ago

    That is a technical detail, not a fundamental change. By fundamental mechanism I mean what the machine is designed to do. Of course techniques and implementations evolve, refine and improve in 60 years, but the idea behind the technology did not evolve much (NLP).

    • areyouevenreal@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      3 days ago

      Did back propagation even exist in the 60s? That was a pretty fundamental change in what they do.

      If we are arguing about really fundamental changes then arguably any neural network is the same and humans are the same as ChatGPT or a mouse, or even something simpler like a single layer perceptron.