Elektrine lite

← Feed

@zenkat@sfba.social

2026-05-13 23:39 UTC

@simon_brooke@mastodon.scot Heh. Having spent the better part of a decade working on the Semantic Web (Metaweb's Freebase) and building what is quite literally the biggest and most comprehensive encoding of semantic knowledge in the world (Google's Knowledge Graph), I'm pretty confident I have some idea of what "semantic" means. But sure, let's debate the semantics of "semantic", as a LISPer I'm sure you'll find it fun as well. 😸 If I'm understanding your argument, you're saying that since LLMs lack any referent to the real world, they don't have true semantics, at last in the classical philosophical sense of the term. They can encode knowledge, but they can't "know" what it means because they don't experience the world, and so can't map those terms to real-world objects. If that's the case, sure ... no argument from me. I don't believe LLMs are conscious entities. They have no lived experience, and so by definition can't map embeddings to the "real world". They are simply statistical encodings of human knowledge.

Replies (1)

  • @zenkat@sfba.social 2026-05-13 23:52

    @simon_brooke@mastodon.scot But from a pragmatic and/or functional perspective, does it matter? We call a knowledge graph a "semantic layer", but it's also just a computer program without lived experience of the world (and a much simpler one at that). And modern multi-modal LLMs encode so much more than just textual information. They're co-trained with all the audio, video, and image information available out on the interwebs. So their embeddings don't just encode the association between "black" and "queen" and "chess", they also encode the visual representation of those pieces across a multitude of chess sets. They "know" what a black queen looks like, how it's shaped, the colors it may be. (This is how NanoBanana and other image plagiarizers are able to work). You can feed a picture into an LLM, and the LLM can trivially describe it. You can feed a piece of music in, and it will describe the key, timbre, and emotional tone. If that's not "semantics" (ie, having a referent to the real world), what is?

    Open ##2702404