Probably should’ve just asked Wolfram Alpha

  • skuzz@discuss.tchncs.de
    link
    fedilink
    arrow-up
    15
    arrow-down
    1
    ·
    6 days ago

    LLMs are really fucking bad at math. They’re trying to find the statistical close answer, not doing computation. It’s rather mind-numbingly dumb.

    • kahnclusions@programming.dev
      link
      fedilink
      arrow-up
      6
      ·
      5 days ago

      Unfortunately a shockingly large number of people don’t get this… including my old boss who was running an AI-based startup 💀

  • notfromhere@lemmy.ml
    link
    fedilink
    arrow-up
    4
    ·
    6 days ago

    I read it as “A third of a third plus a third is a half.” Which makes sense to me. What an I missing?

    • Something Burger 🍔@jlai.lu
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      6 days ago

      It’s wrong. 1/3 + (1/3 * 1/3) = 3/9 + 1/9 = 4/9. It’s close though.

      However, one third plus one half of a third is correct. 1/3 + (1/2 * 1/3) = 1/3 + (1.5/3 * 1/3) = 1/3 + 0.5/3 = 1.5/3 = 1/2

      • mister_flibble@lemm.ee
        link
        fedilink
        arrow-up
        2
        ·
        6 days ago

        I’m guessing whatever it scraped to generate this was intended for divvying up food rather than doing actual math. 1/3 plus a third of a third is close enough to a half if you’re talking about portioning out pizza or leftovers or what have you.

        • mojofrododojo@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 days ago

          divvying up food rather than doing actual math.

          divvying up - dividing food into equal proportions - is math.

        • Revan343@lemmy.ca
          link
          fedilink
          arrow-up
          1
          ·
          5 days ago

          Yep, the difference between .444… And .5 is only .0555…

          Who notices 5 nintieths of something? That’s going to be within the error of sloppy measuring anyways

    • Pyro@programming.dev
      link
      fedilink
      arrow-up
      76
      ·
      8 days ago

      What, your printer doesn’t have a full keyboard under its battery? You’ve gotta get with the times my man.

    • Otter@lemmy.ca
      link
      fedilink
      English
      arrow-up
      47
      ·
      edit-2
      7 days ago

      It sounds like some weird ritual that someone scratched into a notebook.

      𝗯𝗮𝗰𝗸 𝗼𝗳 𝗽𝗿𝗶𝗻𝘁𝗲𝗿?? under battery, m͟u͟s͟t͟ f͟i͟n͟d͟ k͟e͟y͟s͟

  • Deebster@programming.dev
    link
    fedilink
    English
    arrow-up
    57
    arrow-down
    4
    ·
    edit-2
    7 days ago

    Google’s AI seems dumber than the rest, for example here’s Kagi answering the same (using Claude):


    edit: typoed question originally

    Perhaps Google’s tried to make it run too cheaply - Kagi’s one doesn’t run unless you ask for it, and as a paid product it’ll have different priorities.

    • Swedneck@discuss.tchncs.de
      link
      fedilink
      arrow-up
      2
      ·
      23 hours ago

      this is why i like the DDG approach: don’t have the LLM try to reason, just have it pull information from sources you’ve checked aren’t completely insane, and summarize an answer from there.

    • jbrains@sh.itjust.works
      link
      fedilink
      arrow-up
      25
      arrow-down
      1
      ·
      edit-2
      7 days ago

      There are two meanings being conflated here.

      “1/3 more” can mean “+ 1/3” or "* (1 + 1/3)“.

      So “1/3 more than 1/3” could be 2/3 or 4/9, but not 1/2.

      Instead 1/2 is 1/2 more than 1/3, not 1/3 more. That’s the meme I’ve seen go around recently.

      • Deebster@programming.dev
        link
        fedilink
        English
        arrow-up
        6
        ·
        edit-2
        7 days ago

        Yes, and the Google AI response is correct (and quite clear) in what it says. edit: Thanks Batman. I mean that Google’s understanding of the question is logical (although still the maths is wrong as you say (now I’ve re-read you)) and its answer explained the angle it was answering from.

        However, I think the reasonable assumption for the intention behind the question is relative to a whole. I had third of a pizza, and now I have an extra sixth of a pizza. It’s subtle, but that’s the kind of thing AI falls down on.

        • jbrains@sh.itjust.works
          link
          fedilink
          arrow-up
          5
          ·
          edit-2
          7 days ago

          I agree with your assessment regarding the intention of the phrase. We’re back at the silly arithmetic meme that hinges on not grouping terms explicitly and watching people yell at each other in the mistaken belief that there’s one authoritative interpretation of an ambiguous string of symbols.

          Still, the actual mistake remains. Why an extra 1/6 of the pizza? 1/3 of 1/3 is 1/9, not 1/6. That’s 1/2 of 1/3.

          • Deebster@programming.dev
            link
            fedilink
            English
            arrow-up
            4
            ·
            7 days ago

            I thought we were finally agreeing fully! My understanding of the question is “what is the difference between a third (of a pizza, say) and a half?”

            1/2 - 1/3 = 1/6
            1/2 = 1/3 + 1/6
            a half is one sixth more than a third.

            btw, I fixed my Kagi screenshot since I’d missed a word from the question (reading comprehension’s clearly not my strong point today)

        • BatmanAoD@programming.dev
          link
          fedilink
          arrow-up
          2
          ·
          8 days ago

          You are saying “yes” to a comment explaining why the Google AI response cannot possibly be correct, so what do you mean “and [it’s] correct”?

          • Deebster@programming.dev
            link
            fedilink
            English
            arrow-up
            3
            ·
            7 days ago

            Ah, you’re right - I misunderstood jbrain’s point to just be about the “relative to the original” understanding. Guess I’m no smarter than Google’s AI.

    • bulwark@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      8 days ago

      Kagi has Claude built in? I’ve been using it for a year and didn’t know that.

      • xigoi@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        7 days ago

        It tries to auto-determine when to trigger, but you can explicitly trigger it by putting a question mark after your query.

      • stetech@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        7 days ago

        This is why Kagi is a great company.

        Nobody is getting LLM functionality shoved in their faces unless they wanted to.

  • elbucho@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    2
    ·
    7 days ago

    This is very clearly an example of bad AI, but maybe it was trying (and failing) to convey this?

    Basically, 1/3 + 1/9 + 1/27 + 1/81 + … + 1/3^n = 1/2.

    Probably not. But maybe.

    • FuglyDuck@lemmy.world
      link
      fedilink
      English
      arrow-up
      18
      arrow-down
      2
      ·
      7 days ago

      I’m thinking it’s trying to say:

      (2/6) + (1/6) = (3/6) = (4/6) - (1/6)

      But either in “colloquial English for those who want to give other people aneurysms” or “colloquial English for those trying to sound smarter but aren’t”

      Basically that the degree of difference between a half and a third is the same degree of difference between a half and two thirds- and that degree of difference is “one part”.

    • Zagorath@aussie.zone
      link
      fedilink
      arrow-up
      30
      arrow-down
      2
      ·
      8 days ago

      “a half is one-third more than a third” should mean either

      1/3 + 1/3 = 1/2

      Or

      1/3 + (1/3 × 1/3) = 1/2

      Neither of which is true.

      • lad@programming.dev
        link
        fedilink
        English
        arrow-up
        3
        ·
        7 days ago

        I feel like ‘a half is one-third more than a third’ is ambiguous and same as in ‘X is N% more than Y’ one may use X or Y as 100%

        I’m sure that one interpretation is more common, but I don’t think that it is exclusively correct

        • Zagorath@aussie.zone
          link
          fedilink
          arrow-up
          2
          arrow-down
          1
          ·
          7 days ago

          Basically, “X is one-third more than Y” means either X = (4/3) × Y or X = Y + 1/3. I’m fine with either interpretation.

          The problem is that with the values of X and Y in this example, neither interpretation produces a valid equation.

  • deadbeef79000@lemmy.nz
    link
    fedilink
    arrow-up
    17
    arrow-down
    1
    ·
    7 days ago

    “42”

    “The answer to life the universe and everything is 42!?”

    “Yes, I checked it quite thoroughly.”

    “But what was the actual question?”


    Alternatively, garbage in, garbage out.

      • deadbeef79000@lemmy.nz
        link
        fedilink
        arrow-up
        3
        ·
        7 days ago

        That’s like having google make a pizza with everything in my fridge then they complain that I also keep the dog’s food in there.

    • YarHarSuperstar@lemmy.world
      link
      fedilink
      arrow-up
      6
      arrow-down
      1
      ·
      7 days ago

      Wouldn’t even be surprised at this point. It seems the system is intentionally designed to discourage critical thinking and apparently knowing how to do math properly is too close for comfort now.

      • orca@orcas.enjoying.yachts
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        7 days ago

        Someone I know had an old friend on their Facebook timeline say that schools should be reformed and don’t need classes like algebra. Then they proceeded to list fields kids could receive training for instead… and all of them required math of some sort.

  • jbrains@sh.itjust.works
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    edit-2
    7 days ago

    Oh. I just noticed the extraneous word in the search, which might be throwing off the LLM trying to understand it.

    • jbrains@sh.itjust.works
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      7 days ago

      I asked ChatGPT these questions and got sensible answers.

      How much more is one half than one third?

      [subtraction answer: 1/6 more]

      That’s one possibility, but what about the other way to interpret that question?

      [ratio answer, but expressed as “1.5 times as much” rather than “1/2 more”]

  • Xavienth@lemmygrad.ml
    link
    fedilink
    arrow-up
    6
    arrow-down
    2
    ·
    7 days ago

    I don’t even look at the AI result. I scroll right past. That’s the thing, if it’s bullshit 50% of the time, and you can’t always tell like you can here, then it’s bullshit 100% of the time, and it’s useless, just taking up screen real estate.