If he knows that the guilt is irrational, it appears that he needs to overcome the guilt associated with the oppressive theistic mindset in his own time. Simply be supportive by reassuring him that his assessment of the guilt being irrational is correct.
"Never trust a fox. Looks like a dog, behaves like a cat."
~ Erin Hunter
~ Erin Hunter