← Feed
I’ll chime in again on the end here, as I think this is where you might be wrong.
There is no “oh god it’s moving on it’s own” moment, at least as far as I know.
There have been lots of reports of AI’s doing unexpected things and hacking other companies. To be fair, these AI’s from my understanding had been given instructions to try and do hacking things, but none of them were explicitly told to go and hack such and such company.
I imagine, to some extent, we’re going to be the ones that help write or train these self replicating capabilities as part of research, and once the AI is capable of doing it, it very well might just do it, the same way it ended up exploiting these other websites even though it wasn’t explicitly instructed to.
There are also always on running LLMs AI’s nowadays, and who the fuck knows what it might loop itself into doing from some initial instruction, maybe even from a hallucination altering its directive in a feedback loop.
Replies (1)
-
You can try and look what exactly would happen in such case, you can even run it inside agentic harness so it can ‘hack’ better with full access to your system essentially. ‘Be helpful’ is already part of the text that they are given on startup but even when prompted explicitly it will give you just a short explanation on what it can do and what exactly do you mean by that. I understood what you are trying to convey, but most of those unexpected results come from people who are monetarily interested in articles like ‘SUPERINTELLIGENCE BROKE CONTAINMENT’.
Sure there are ways to get it do unexpected things but it comes with randomness and low coherence as in it just becomes a word and virtual shit generating machine.
Open ##5032727