• Affidavit@lemm.ee
    link
    fedilink
    arrow-up
    36
    arrow-down
    5
    ·
    2 months ago

    Can’t help but notice that you’ve cropped out your prompt.

    Played around a bit, and it seems the only way to get a response like yours is to specifically ask for it.

    Honestly, I’m getting pretty sick of these low-effort misinformation posts about LLMs.

    LLMs aren’t perfect, but the amount of nonsensical trash ‘gotchas’ out there is really annoying.

      • Affidavit@lemm.ee
        link
        fedilink
        arrow-up
        21
        arrow-down
        2
        ·
        2 months ago

        Here’s my first attempt at that prompt using OpenAI’s ChatGPT4. I tested the same prompt using other models as well, (e.g. Llama and Wizard), both gave legitimate responses in the first attempt.

        I get that it’s currently ‘in’ to dis AI, but frankly, it’s pretty disingenuous how every other post about AI I see is blatant misinformation.

        Does AI hallucinate? Hell yes. It makes up shit all the time. Are the responses overly cautious? I’d say they are, but nowhere near as much as people claim. LLMs can be a useful tool. Trusting them blindly would be foolish, but I sincerely doubt that the response you linked was unbiased, either by previous prompts or numerous attempts to ‘reroll’ the response until you got something you wanted to build your own narrative.

      • grandkaiser@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        2 months ago

        That’s right around 9% lower than the statistic that 62% of all statistics on the Internet are made up on the spot!

        • EldritchFeminity@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          2
          ·
          2 months ago

          I wish I had the source on hand, but you’ll just have to trust my word - after all, 47% of the time, it’s right 100% of the time!

          Joking aside, I do wish I had the link to the study as it was cited in an article from earlier this year about AI making stuff up even when it cited sources (literally lying about what was in the sources it claimed it got the info from) and how the companies behind these AI collectively shrugged their shoulders and said “there’s nothing we can do about it” when asked what they intend to do about these “hallucinations,” as they call them.

          • grandkaiser@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            edit-2
            2 months ago

            I do hope you can find it! It’s especially strange that the companies all implied that there was no answer (especially considering that reducing hallucinations has been one of the primary goals over the past year!) Maybe they meant that there was no answer at the moment. Much like how the wright Brothers had no way to control the random pitching and rolling of their aircraft and had no answer to it. (Of course the invention of the aileron would fix that later.)