• ShakingMyHead@awful.systems
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 month ago

      Probably would have been easier when the context window wasn’t 128k.

      Though what the point would be should someone actually achieve that eludes me a bit.

      • bitfucker@programming.dev
        link
        fedilink
        English
        arrow-up
        10
        ·
        1 month ago

        I don’t know man. Maybe a chat bot for help center that forgot they shouldn’t give refund or non existent promotion?

      • nfultz@awful.systems
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I have LLMs translate novels, I can tell when they run over the window because they forget characters’ gender half way through, things like that. Lots of legal documents are even longer, maybe.