Fraudsters have access to a near-infinite supply of phone numbers. It is only an annoyance for the average user trying to legitimately access a service and only helps prevent the smallest and least prepared criminals. But it's true that for 1:1 communication or not having to reach a broad audience there should be better alternatives.