It's probably more accurate to say that a new born lacks the capacity to entertain the question. They can't focus their eyes properly, have the muscle coordination of over-cooked pasta, and only recognize their parents on an instinctual level, so theological discourse is probably above their pay grade.
I suspect that if you raised children in complete isolation (good luck getting this one approved by the ethics board) both sides would be in for a surprise. Atheists would probably get a shock when the kids grew up to be theist courtesy of our innate propensity for superstition and our need to look for meaning in the meaningless. Theists would be in for a surprise when they discovered that the kids weren't kneeling at the altar of their chosen omnimax deity but a much more primal shamanistic assemblage of gods of sun, rain, thunder, and toys that go squeek.
I suspect that if you raised children in complete isolation (good luck getting this one approved by the ethics board) both sides would be in for a surprise. Atheists would probably get a shock when the kids grew up to be theist courtesy of our innate propensity for superstition and our need to look for meaning in the meaningless. Theists would be in for a surprise when they discovered that the kids weren't kneeling at the altar of their chosen omnimax deity but a much more primal shamanistic assemblage of gods of sun, rain, thunder, and toys that go squeek.