I've always assumed that a part of what Import your friends from your email! did was exactly what you describe - try to invite the non-Facebook users in your address book to Facebook.

This is one of the reasons why I would have never thought of trying to import my email account's address book.