• adb@lemmy.ml
      link
      fedilink
      English
      arrow-up
      17
      arrow-down
      1
      ·
      edit-2
      3 months ago

      Yes, and let’s also not count all the investments in infrastructure because you know… like training and staff it’s not a real cost that’s essential to the business.

      Anyways, you wouldn’t happened to have heard that from Anthropic or OpenAI?

      Somehow we don’t have any actual indisputable numbers (I wonder why) but it is actually quite controversial and some of those who have done deep research on the subject are saying inference IS run at a loss and it might not get profitable ever.

      https://www.ft.com/content/fce77ba4-6231-4920-9e99-693a6c38e7d5?syn-25a6b1a6=1

    • akwd169@sh.itjust.works
      link
      fedilink
      arrow-up
      8
      ·
      3 months ago

      “Inference is not typically run at a loss”

      Bro thats called cherry picking

      Businesses work on cash in cash out

      Right now AI companies make way less cash than they spend overall when you dont include investments

      Furthermore, most people use a free version of AI and would stop using it if it cost them anything

      Explain how to pivot to profit when the investments dry up, were all waiting

      • rambling4491@feddit.online
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        Furthermore, most people use a free version of AI and would stop using it if it cost them anything

        Do companies tend to use the free version too?

          • rambling4491@feddit.online
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 months ago

            It’s not a rhetorical question or a “gotcha” moment. I’m simply asking you to clarify your point. Could AI companies survive on their subscription model alone if they increased their prices?

    • Rentlar@lemmy.ca
      link
      fedilink
      arrow-up
      4
      ·
      3 months ago

      You know that wouldn’t happen. Which AI company wants to be the one that says, “we’re happy with where the model is at right now” and stops throwing cash into the boiler of the investor hype train and let their competitors exceed them in real or imagined metrics? Clearly firms like Anthropic have to rely on circus marketing tricks like “This model is too dangerous for the general public to see! Ooooh scary! Coming Soon!”, and they can’t do that without continuous training.

      For you and I, the offline models aren’t too bad for getting little side projects started, but for major AI firms, the ongoing training cost for the next model and the one after that has become ingrained into the operating model.