• Kazumara@discuss.tchncs.de
    link
    fedilink
    arrow-up
    2
    ·
    5 hours ago

    That’s why explainable/interpretable machine learning is a legitimate research field.

    We touched on them a little during my studies. This would have been about 2018-2019 before the whole field of machine learning got swallowed up by these damn LLMs and turbocapitalists

  • son_of_darkness@lemmy.world
    link
    fedilink
    arrow-up
    29
    arrow-down
    3
    ·
    1 day ago

    Stop attributing thinking and reasoning characteristics to these things. They are non-deterministic fuzzers, that’s all. There’s no capabbility of actual human behaviour

    • Quailman@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      18 hours ago

      The only intelligence related to LLMs was in creating them, it’s been all downhill ever since.

  • cybervegan@lemmy.world
    link
    fedilink
    arrow-up
    20
    arrow-down
    2
    ·
    1 day ago

    That’s because there IS NO EXPLANATION other than it’s just spicy auto-complete. Even the explanation is just a plausible answer to the question “why did you do that?”. There is NO REASON so there’s NO REASONING.

  • Smoogs@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    1
    ·
    1 day ago

    yeah so the ai doesnt have any motivation for not fucking up. so youre telling me we are now in a world where ai randomly shooting people will just come with ‘sorry i dont have a reason’

    even terminator had a reason. ai turned out to be more aimless than terminator and prone to doing literally anything wreckless. just cuz…

    without want.

    without desire.

    without a goal.

    let that sink in.

    • acchariya@lemmy.world
      link
      fedilink
      arrow-up
      7
      arrow-down
      1
      ·
      1 day ago

      Because what we have is not AI, and will never be “achieving self awareness” in the sense of the machines in the terminator universe. We have conversational text generators, essentially high order Markov chain machines. LLMs today are ai in the sense that a dozen monkeys throwing rocks at and shitting on a typewriter for a thousand years are Shakespeare.

      Its not that they are not useful for textual problems though, because most problems have been solved already in the corpus.

  • nonentity@sh.itjust.works
    link
    fedilink
    arrow-up
    19
    arrow-down
    1
    ·
    2 days ago

    Why would a LLM, an explosively imprecise, statistically luke warm sphincter that extrudes grey goo, and is uniquely incapable of comprehension, be able to explain why something was done when a LLM was involved in the process?

    Anyone who is impressed by the function or output of a LLM, to a level they believe it is in any way adjacent to intelligence, needs to be explicitly quarantined from any decision making process which affects anyone not similarly cognitively impaired.

  • canttakeitwithyou@lemmy.zip
    link
    fedilink
    arrow-up
    8
    arrow-down
    3
    ·
    1 day ago

    Look the whole title is meaningless. You just have s***** software that uses statistical methods that sometimes are beneficial but often generate b*******. That’s it.

    • Strider@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      3 hours ago

      That’s the thing. You’re correct and it’s missing so many parts to really be a reasonable human.

      But it seems so similar. Even though it’s clear as day, people are repeatedly fooled.

    • red_tomato@lemmy.world
      link
      fedilink
      arrow-up
      27
      arrow-down
      3
      ·
      2 days ago

      It’s difficult to avoid using anthropomorphizing language when describing the output of AI agents.

      • Zachariah@lemmy.world
        link
        fedilink
        arrow-up
        27
        arrow-down
        1
        ·
        edit-2
        22 hours ago

        I can’t find it now, but I read a great guide to help you translate from anthropomorphized language. I think the key is to always be clear about what the machine is doing.

        These articles are close to what the guide was saying:

        https://www.nature.com/articles/s42254-023-00584-1

        https://buttondown.com/maiht3k/archive/how-to-talk-about-ai-without-adding-to-the/

        https://www.john.maloney.org/Editing/anthropomorphization.htm

        And I stumbled across instructions to send to the llm so it won’t respond with anthropomorphizing language:

        https://github.com/bmeyers/deanthro

        I love this. At work, we’re encouraged to find ways to use llms, and I always start by sending instructions to not use the words “I” or “understand” etc because it was unnerving to get outputs that isn’t just the info but decorated with cute little phrases.

        Oh, and this article is long but very in depth on this topic:
        https://dl.acm.org/doi/full/10.1145/3706598.3714038

        • Albbi@piefed.ca
          link
          fedilink
          English
          arrow-up
          2
          ·
          22 hours ago

          I don’t star comments very often, but this one deserves one. Great resources here.

          By the way, there’s a character at the beginning of the GitHub link preventing automatic hyperlinking.

      • RichardDegenne@lemmy.zip
        link
        fedilink
        arrow-up
        11
        arrow-down
        2
        ·
        2 days ago

        AI agents

        Start by not calling them agents. Then use “generate” instead of “say”, “think”, “explain” and by that point you’ll be on a roll.

        It’s only difficult because everyone around us started using the AI vendor marketing newspeak.

        • red_tomato@lemmy.world
          link
          fedilink
          arrow-up
          6
          arrow-down
          5
          ·
          2 days ago

          Start by not calling them agents

          What should we call them instead? “Agents” is more or less the accepted name for chat bots with access to tools (like writing files and running commands).

          Then use “generate” instead of “say”, “think”, “explain” and by that point you’ll be on a roll.

          “Generate” is too general. We need a way to characterize the text output. “Explanation” is our characterization of the generated text. We humans interpret it as an explanation.

          The idea of letting the LLM “think” before it “responds” is inspired by how humans generally think before we respond. It was quickly discovered after GPT 3.5 that the quality of answers improves if it has a “thinking” phase before it produces an answer.

          The English language is unfortunately not made for describing LLMs in an non-anthropomorphic way - at least not without sounding like a dork.

          • RichardDegenne@lemmy.zip
            link
            fedilink
            arrow-up
            8
            arrow-down
            3
            ·
            2 days ago

            You’re literally parroting AI booster propaganda.

            We have a name for computer programs that do things. It’s “program”.

            You don’t have AI agents thinking before they explain something. You have AI programs processing before generating an output.

            If your input was to ask for an explanation, then sure, you can call the output an explanation. But don’t say that an agent explained something.

      • MangoCat@lemmy.sdf.org
        link
        fedilink
        arrow-up
        8
        arrow-down
        1
        ·
        2 days ago

        difficult to avoid using anthropomorphizing language when describing the output of AI agents.

        Precisely because the underlying LLMs are trained on human writing patterns and mostly reproduce the words that humans would most likely respond with.

  • likebudda@reddthat.com
    link
    fedilink
    arrow-up
    16
    ·
    2 days ago

    As someone who doesn’t code, I struggle to find a use for AI in my life. I’m the laziest person I know but I will go to the grocery store if I need groceries. If I need to know something I trust the google-fu skills I’ve developed over the last 25+ years. If I need to know what an e-mail or article says I will read it.

  • eicker@lemmy.worldOP
    link
    fedilink
    arrow-up
    107
    arrow-down
    8
    ·
    2 days ago

    The scary part isn’t the 72 eggs. It’s that the AI agent confidently invented a reason, then another reason, before admitting eggs weren’t even on the shopping list. Imagine giving this thing access to your bank account. Today it’s breakfast for a small hotel: tomorrow it’s explaining why you own a jet ski.

  • Etterra@discuss.online
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 day ago

    So the AI is now as smart as a toddler. Except that the toddler had better taste and will grab a box of Lucky Charms, 2 bags of candy, and a knock-off transformer instead of 72 eggs.

        • Tobberone@feddit.nu
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          18 hours ago

          Yes, absolutely. But kids can be… resourceful. Anything can look like coins, afterall. Although nowadays I guess coins wouldn’t be recognized.