It all depends on whether the concepts of mathematics are independent of a conscious mind (i.e. they have always existed) or if mathematics can only exist whithin a conscious mind, like morality.
"It is the mark of an educated mind to be able to entertain a thought without accepting it" ~ Aristotle