It distracts, no matter if you count or not. And really, if you do a lot of public speaking and respect your audience—do a favor to your audience and try to improve. Sure, audience will bear with almost anything and more so if what you say is interesting—but why make them suffer?