If he knows that the guilt is irrational, it appears that he needs to overcome the guilt associated with the oppressive theistic mindset in his own time. Simply be supportive by reassuring him that his assessment of the guilt being irrational is correct.
"What a little moonlight can do." ~ Billie Holiday
