(September 28, 2020 at 6:11 pm)The Grand Nudger Wrote: That's a body model. We have one of those, it's muuuuuuuch better than our attention schema. OFC, machine body models are orders of magnitude more precise than ours. Ultimately, they do the same thing (in both cases), control.
Again for purposes of discussion we're going to assume that the scenario above is not only possible but inevitable, but here again I'd wonder why we would expect anything like us to come of it. We aren't the product of an accidental process of trial and error anymore than a digital thermostat is a product of biological evolution. We're what's left. Consider how different your personal experience could be if you had access to the amount and types of data that a machine has access to weith regards to it's internal models. Any machine that was aware, in that way, would be as different from you and I today as you would be from yourself a million years from now (or however long it took to breed or design people with that ability, if it's even possible).
Qualitatively equal reports of subjective experience may be incomprehensible between us. Rather than being the lone intelligence in a world full of inanimate objects, we are alone in a world surrounded by intelligence. Rather than being the lone experiencer, we are alone experiencing in a world full of conscious entities.
I don't necessarily think AI will look or act anything like us although we will be a great decider in which AI get to exist if it doesn't adapt to stealth or overpowering us. We will cull the litters of whatever comes out of the process until we either can't or are happy with what's happening much like we did with dogs or any other domestic animal.
I would put my kinesthetic model up against what I've seen in that video or any other VR model of hand placement with all its jitters and latency. ANY DAY!

I think things are going to get very interesting in the next 40 years if we don't burn the planet to ash.