Your post reminds me of what xkcd says about it:

http://xkcd.com/435/

There's a truth to it -- CS is just applied math, that doesn't mean you have to understand math to program, but it will be very beneficial.