Surround yourself with like-minded people. The mistake I committed was that I took to long in "coming out of the closet". I went for a year still pretending to be a Christian and carrying on with my week as a Christian i.e. going to church 4 times a week for Bible study, worship practice, youth group and Sunday morning church. As soon as I made it public that my beliefs had changed, I was able to be true to myself and live/act like a non-religious person with people other than Christians and I didn't feel guilty at all.
"It is the mark of an educated mind to be able to entertain a thought without accepting it" ~ Aristotle