Elektrine lite

← Feed

@mirth@mastodon.sdf.org

2026-04-08 21:27 UTC

@MichaelTBacon @alienghic I'm not sure I understand, what about the current cost is unsustainable? If to use some round numbers $100k of server hardware that costs about $40k a year to operate can serve subscribers paying a total of $7k a month then that's about a break even investment (assuming a 10% discount rate). Of course the big AI companies are spending a lot of money, but if they fire all the people outside a core product operations, engineering, and some research, the math is different.

Replies (1)

  • @MichaelTBacon@social.coop 2026-04-08 21:36

    @mirth @alienghic Can a $100k server cover $7k/month of subscribers though? I'm not at all sure of that, even for just servicing requests, particularly since you're going to have very spiky and uneven utilization and if those models are slow to respond, you're going to lose customers, fast. Beyond that, a huge amount of the cost of the models is in the training. You can say, oh, sure, but once the training is done, they're good, but that means that your old model knows nothing about anything that's happened since it was trained. I go back to Anthropic saying last August that its $200/month Max users were costing it $50k/month, each. 20-30% increases in performance are totally insufficient to scratch that problem. Some of it could be achieved by making Claude Code less of a shambolic train wreck of code, but that's not cheap either.

    Open ##1969908