I dislike those "if x didn't happen, you wouldn't be here" arguments, they serve no purpose and just go to incite angry responses on most occasions.
While yes, it may be true that Phant wouldn't be here if it weren't for slavery, it's also true that the geopolitical and social makeup of the entire goddamn continent would be radically different as well.