Elektrine lite

← Feed

@mirth@mastodon.sdf.org

2026-04-08 14:44 UTC

@MichaelTBacon @alienghic @cwebber It's a bit like looking at the trajectory of broadband and batteries in 2005 and projecting forward that people would be streaming movies to their pockets for nearly free. The technology isn't there now but it seems like that's where it will go.

Replies (1)

  • @MichaelTBacon@social.coop 2026-04-08 15:18

    @mirth @alienghic @cwebber That's the thing, though, I don't think even the smallest trend is there. It's not that "it's early yet, but it's pointing in the right direction." I haven't seen anything that suggests there's any downward trend at all, no matter how small. To get anything like equivalent performance out of the discount models like Deepseek, you have to run multiple instances in parallel or run a bunch of agents along with it. The big breakthroughs in capability in the last year or two have all been about ramping *up* the power usage, model size, and GPU capacity, either by using bigger token windows or adding secondary agents. That's kind of some cool engineering, but power consumption or operating costs are just going up. The main advantage of the discount models is that they have a much lower cost of training, mostly because (we suspect) they were trained off of responses from the bigger models.

    Open ##1732747