Where else would you draw the line? I don't think what I described is a real problem in practice. Housing and jobs are often advertised in rather neutral publications, not special interest ones. But what Facebook enables goes beyond targeting based on interest, it's explicitly exclusionary.

If your local newspaper could print a special edition for minority subscribers that didn't include job listings, that would be a problem. Advertising in a special interest publication is not, on its own, a problem. Of course there's no clear lines in reality, everything must be evaluated in context.