You can do latency based load balancing to non-AWS endpoints with Route 53 -- the limitation is that you have to associate those endpoints with an AWS region. If your endpoints are not anywhere near an AWS region, you're stuck. Otherwise fine!