Here's a long (but far from complete) list of anti-religious and atheist songs in many styles. I'm not sure how conducive some of this stuff is to play along with, because some of it is pretty complex.
XTC - Dear God
Midge Ure - Dear God (different song than the one by XTC)
Midge Ure - Answers to Nothing
The Sundays - Skin and Bones
Björk - It's in our hands
James - One of the Three
The The - Armageddon Days Are Here (Again)
Duran Duran - None of the Above
Tool - Opiate
George Gershwin - It Ain't Necessarily So
Ani Difranco - What if no one's watching
Corporate Avenger - Gay Muslims for Christ
Corporate Avenger- Bible is Bullshit
Elton John - If There's A God In Heaven( What's He Waiting For)
Emerson Lake & Palmer - Mass
Emerson Lake & Palmer – The Only Way
Everclear - Why I Don't Believe in God
Frank Zappa - Jesus thinks you are a jerk
Iced Earth – Disciples of the Lie
Jethro Tull - My God
Rush - Free Will
Rush - Roll the Bones
Rush - The Way the Wind Blows
Randy Newman - God's Song
R.E.M. - Losing My Religion
XTC - Dear God
Midge Ure - Dear God (different song than the one by XTC)
Midge Ure - Answers to Nothing
The Sundays - Skin and Bones
Björk - It's in our hands
James - One of the Three
The The - Armageddon Days Are Here (Again)
Duran Duran - None of the Above
Tool - Opiate
George Gershwin - It Ain't Necessarily So
Ani Difranco - What if no one's watching
Corporate Avenger - Gay Muslims for Christ
Corporate Avenger- Bible is Bullshit
Elton John - If There's A God In Heaven( What's He Waiting For)
Emerson Lake & Palmer - Mass
Emerson Lake & Palmer – The Only Way
Everclear - Why I Don't Believe in God
Frank Zappa - Jesus thinks you are a jerk
Iced Earth – Disciples of the Lie
Jethro Tull - My God
Rush - Free Will
Rush - Roll the Bones
Rush - The Way the Wind Blows
Randy Newman - God's Song
R.E.M. - Losing My Religion
You'd believe if you just opened your heart" is a terrible argument for religion. It's basically saying, "If you bias yourself enough, you can convince yourself that this is true." If religion were true, people wouldn't need faith to believe it -- it would be supported by good evidence.
