What would you consider to be evidence for God?

[RozKek]

Wrong!  It is the existence of your god that mandates infinite regress, ergo, it cannot exist.

Regress ceases since the natural effects trace back to the universe's beginning.  The cosmic timeline began 13.77 billions ago along with matter, space and energy. The beginning must start with a non-physical entity. If there's no god, there would be the absence of anything (the word 'nothing' has many meanings; like "What are you up to"?...nothing). Categorical fallacy to superimpose the natural realm's requirement for beginning's to the supernatural that wouldn't require a beginning; aka, the biblical God is transcendental to time, not control nor confined by it. That's why it was written 'a thousands years is like one day and one day is like a thousand years'. You should of known this by now...but now you do, so that's okay.

After you prove god's existence go on to prove that without god there would be the absence of everything first, you're just making an assumption right now. Even though I doubt that you will, I suggest checking up on quantum mechanics. I'm not an expert on it but I'm sure that it actually has supported explanations to how the universe could have started. I even read an article that suggested the universe is eternal. 

But do you see the difference between science and faith? In science one doesn't claim that something is correct if it makes sense, they test it, do experiments, when you make an assumption or hypothesis you go try to prove it. If it turns out to be wrong, you try something else. You don't believe in what you want to be true. 
Faith is simply just assumptions supported by nothing.

 God is like a "super" variable that you put as the answer of every equation even if it's wrong, just because you can't solve the equation. And once you solve that equation, unsurprisingly you see that god wasn't the answer.