My gut feeling tells me that there is a factor of genetic predisposition which lets people react very differently to such stimuli.
The fool hath said in his heart, There is a God. They are corrupt, they have done abominable works, there is none that doeth good.
Psalm 14, KJV revised edition