I'm not seeing the logic here. If you insist on interpreting numbers quantitatively (the formal definition of our numbers in mathematics is independent of the quantities they traditionally represent, which makes this entire argument a moot point), what is the issue in starting with nothing and successively adding numbers indefinitely, generating an infinite set? You don't "reach" zero because you start at zero. So, there is absolutely no reason why zero and infinity can't coexist.