Very true. Honestly, unless I really listen for it, I don't notice when someone has my own area's accent vs a "generic TV" accent. And they're pretty different! I do notice if it's not mine, though. I'm from North Carolina, and the "Deep South" accent sounds as weird to me as it does to anyone else, although I'm sure someone else might think we sound similar.

It's the entire reason I can't get into House of Cards. Frank Underwood is supposed to be from my area of the country, and speaks with some kind of Charleston-ish non-rhotic accent.