People will say to you "sir/ma'am" in a customer/representative situations, e.g. retail salespeople will call you sir, and so will often clerks in government offices. Outside of these, not really.