Elektrine lite

← Feed

@lina@vt.social

2026-04-30 05:24 UTC

@ben @krutonium LLMs have terrible scaling, and it's especially bad when you're trying to pretend it's an all knowing intelligent entity you can just prompt to do your bidding (which it isn't, but it takes a huge LLM to fake it well enough it sounds like one). Small scale LLMs actually have many uses and can run on consumer hardware (and train on prosumer hardware, much less than that VAC rack), but you have to give up that fallacy that you just train one giant model and prompt it to do things. You're supposed to train/fine tune them for specific, narrow use cases (which nobody does...).

Replies (0)

No replies.