AI requires the following:
1) goals
2) trial behaviors
3) an algorithm for "punishing" or "rewarding" trials
In order for AI to really evolve, it will also need some inbuilt capacity for variability-- say, the ability to arbitrarily weight various goals without outside hard programming. There will need to be replication, so that successful goals and behaviors will be able to persist and come to dominate.
If AI devices become capable of self-replication and establishing their own goals, we as humans are, naturally, fucked, since we will be in competition for the device populations for resources.
1) goals
2) trial behaviors
3) an algorithm for "punishing" or "rewarding" trials
In order for AI to really evolve, it will also need some inbuilt capacity for variability-- say, the ability to arbitrarily weight various goals without outside hard programming. There will need to be replication, so that successful goals and behaviors will be able to persist and come to dominate.
If AI devices become capable of self-replication and establishing their own goals, we as humans are, naturally, fucked, since we will be in competition for the device populations for resources.