One annoyance with floating point binary is when it happens to not line up so well with floating point decimal, for example
>>> 0.1 + 0.2
0.30000000000000004
which is still gonna round to 0.3, but ugh. Also, during aggregations, it's not nice how you get different answers depending on the order of operations when they shouldn't matter.