The Enemy could still shoot and destroy your cavorite plates, or the mechanism which turns them so that it does or doesn't block gravity from the desired direction.