Aha! A thread about my favourite subject.
I have heard of this before. I didn't really pay much attention to it the first time I heard it. As with all the scaremongering it relies on advances in technology that we can't even guess at how it could possibly work. In this case it's time travel. With the singularity it's the idea that an AI could redesign itself without having to test each design. Because if it didn't have to do that then we've had the technology for the singularity since 1975 with genetic algorithms. Even further back if you include generic search techniques.
As far as I can see, it's all a just a new religion for modern day techies who prefer it to bronze age mythology.
I shall refer to your first quote which basically is worth repeating as many times as it takes.
Saying that, my husband repeatedly jokes (I assume) that his sole purpose in life is to stop me developing artificial intelligence that will bring about the downfall of civilisation.
(February 20, 2018 at 5:01 pm)Grandizer Wrote:Quote:Roko's basilisk is a thought experiment about the potential risks involved in developing artificial intelligence. The premise is that an all-powerful artificial intelligence from the future could retroactively punish those who did not help bring about its existence, including those who merely knew about the possible development of such a being.
I have heard of this before. I didn't really pay much attention to it the first time I heard it. As with all the scaremongering it relies on advances in technology that we can't even guess at how it could possibly work. In this case it's time travel. With the singularity it's the idea that an AI could redesign itself without having to test each design. Because if it didn't have to do that then we've had the technology for the singularity since 1975 with genetic algorithms. Even further back if you include generic search techniques.
As far as I can see, it's all a just a new religion for modern day techies who prefer it to bronze age mythology.
I shall refer to your first quote which basically is worth repeating as many times as it takes.
Quote:The smartest people I know who do personally work on AI think the scaremongering coming from people who don't work on AI is lunacy.
—Marc Andreessen
Saying that, my husband repeatedly jokes (I assume) that his sole purpose in life is to stop me developing artificial intelligence that will bring about the downfall of civilisation.