@antoinechambertloir@mathstodon.xyz
2026-09-10 18:45 UTC
Replies (1)
-
@antoinechambertloir@mathstodon.xyz 2026-09-10 18:55
#Math #AI 12/n This software, Claude Fable 5, is a fairly sophisticated program that belongs to the class of “large language models” (LLM). Basically, this means that it generates text (language) according to probabilistic rules that are sufficiently well crafted that the outcome looks very well written, but still, at the heart, this is a randomly generated text. Of course, there is no hope that a purely random text would be of any use for anybody, so the heart of the work of the LLM engineers was first to make these probabilistic rules particularly well chosen. On can already see this as a remarkable achievement of that kind of technology, but it is important to make two additional observations: - The crafting of these probabilistic rules is obtained by a recent technique in machine learning (reinforcement learning and transformers), that requires, to work properly, an extremly large number of data. To that aim, the AI companies basically scanned every possible literature, and used human workers (in particular from the Global south) to “train” the software. It is for this reason that researchers in artificial intelligence and linguistics coined the term “stochastic parrots”: this software randomly repeats what it has read. - This random text generation does not entail any notion of truth, and even any relation to the actual world. To reach the possibility of doing math, this software now combines text generation with proof verification in the sense discussed earlier. The reason that makes it workable in mathematics is precisely that the mathematical language is well specified, and we have means to assert the validity of a mathematical argument, combined with the performance of proof assistants.