• treefrog@lemm.ee
    link
    fedilink
    English
    arrow-up
    70
    ·
    edit-2
    5 months ago

    I thought the main issue was that AI don’t really know how to say I don’t know or second guess themselves, as it would take a lot more robust architecture with multiple feedback loops. Like a brain.

    Anyway, LLM’s aren’t the only AI that do this. So them being trained on Facebook data certainly isn’t the whole issue.

    • dan1101@lemm.ee
      link
      fedilink
      English
      arrow-up
      44
      ·
      5 months ago

      Yeah it’s the old garbage in, garbage out problem, the AI algorithms don’t really understand what they are outputting.

      I think at this point voice recognition and text generation AI would be more useful as something like a phone assistant. You could tell it complex things like “Mute my phone for the next 2 hours” or “Notify me if I receive an email from John Smith.” Those sort of things could be easily done by AI algorithms that A) Understand your voice and B) Are programmed to know all the features of the OS. Hopefully with a known dataset like a phone OS there shouldn’t be hallucination problems, the AI could just act as an OS concierge.

      • Rhaedas@fedia.io
        link
        fedilink
        arrow-up
        24
        ·
        5 months ago

        The narrow purpose models seem to be the most successful, so this would support the idea that a general AI isn’t going to happen from LLMs alone. It’s interesting that hallucinations are seen as a problem yet are probably part of why LLMs can be creative (much like humans). We shouldn’t want to stop them, but just control when they happen and be aware of when the AI is off the tracks. A group of different models working together and checking each other might work (and probably has already been tried, it’s hard to keep up).

        • dan1101@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          Yeah the hallucinations could be very useful for art and creative stepping stones. But not as much for factual information.

      • jaybone@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 months ago

        Seems Siri and Alexa could already do things like that without needing LLMs trained on Facebook shit.