• CeeBee@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    There’s a huge gap between “playing with prompts” and “writing the underlying models” and they entire gap is all coding.

    • Phoenix@programming.dev
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      It really is big. From baby’s first prompting on big corpo model learning how tokens work, to setting up your own environment to run models locally (Because hey, not everyone knows how to use git), to soft prompting, to training your own weights.

      Nobody is realistically writing fundamental models unless they work with Google or whatever though.