2026-04-08 21:36 UTC
@mirth @alienghic
Can a $100k server cover $7k/month of subscribers though? I'm not at all sure of that, even for just servicing requests, particularly since you're going to have very spiky and uneven utilization and if those models are slow to respond, you're going to lose customers, fast.
Beyond that, a huge amount of the cost of the models is in the training. You can say, oh, sure, but once the training is done, they're good, but that means that your old model knows nothing about anything that's happened since it was trained.
I go back to Anthropic saying last August that its $200/month Max users were costing it $50k/month, each. 20-30% increases in performance are totally insufficient to scratch that problem. Some of it could be achieved by making Claude Code less of a shambolic train wreck of code, but that's not cheap either.
Replies (1)
-
@mirth@mastodon.sdf.org 2026-04-08 21:41
@MichaelTBacon @alienghic Do you have a source for that figure? I have access to some developer usage data for a customer and I don't see anything close to the token usage it would take to get there. Maybe $200 a month.