I don't think this is a physical viability problem (we convert old industrial warehouses into lofts all of the time).

But I think the problems are that this would represent a major depreciation of the value of the real estate - both for the owners and the city. And the zoning issues would be tough. These are currently not good areas for housing without a lot of work.