• Sanctus@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 days ago

      Anyone planning to make a profit by billing this as metered is dreaming when agents suck down 40k tokens in a single prompt. I did the math, at like 0.2 cents a token that would still be 8k. No one is paying 8k for a single prompt. At 0.015, thats still 600 dollars. Its never going to make sense.

        • Sanctus@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          4 days ago

          Yeah I guess I did twenty cents, I realized this earlier when I paid for shipping at work. 80 dollars is still a lot for a single session. I think I’ve easily seen 100k+ sessions too, but Idk how many of those were just people burning tokens.

          Edit: two cents is 0.02, 800 dollars. Just quadruple checked.

          • elephantium@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            4 days ago

            80 bucks for a session could be a lot, but if it saves you 4 hours of work, I’d say it’s worth it.

            OTOH, I’ve seen some articles claim that using AI tools actually slows you down. In that case, it’s a giant boondoggle.

            • Sanctus@anarchist.nexus
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 days ago

              In the frame of a company, yes. For individuals, not really imo. What’s going to happen is the big models will probably move to being only accessible by corporations and rich while the public moves more towards open weights and self host able options.

              • elephantium@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                4 days ago

                True, I’m very much looking at it in terms of work tooling. I don’t have much use for the ELIZA-with-delusions-of-grandeur models in my personal life.