@antoinechambertloir@mathstodon.xyz
2026-09-10 19:51 UTC
Replies (2)
-
@antoinechambertloir@mathstodon.xyz 2026-09-10 19:52
#Math #AI 17/n For example, the existence of non-sofic groups is presented as “addressing a central open question in group theory”, while it is certainly not central. Moreover, the solution to this question seems to have benefited from AI-work by mathematician Andreas Thom (on this network) who had used Chat-GPT (OpenAI's LLM) to investigate that question. The answers he gets are really puzzling, and I can join him on one point, “can we trust OpenAI with unpublished mathematics”? Indeed, if it happens that private discussions on Chat-GPT help train the model, people using this technology would basically have all OpenAI mathematicians spying what they do behind their back. Of course, OpenAI says that no such thing happens, but how can we know? https://mathstodon.xyz/@andreasthom/117240535270608201
-
@michaelmaex@mastodon.online 2026-09-10 21:07
@antoinechambertloir@mathstodon.xyz It is almost tautological that if a mathematical work is in the training data, the LLM will reproduce it. The entire point is to imitate the training data. Worse is that it happens by nature without attribution. After all, if the training data claims to invent a new technique so will the output. This is fundamentally different to a text that is in the context, where the LLM is at least “aware” it is using something else, and it did not “reason” itself to that point.