keep in mind that esperanto can only be considered neutral for speakers in europe and the americas. esperanto should not sound neutral for speakers from africa, austronesia, and other indigenous people from other continents. a better candidate for a neutral language would be lojban.
and i don't see your last point. wouldn't learning esperanto prevent you from speaking a minority language? assuming the average person is only able to speak two languages at most, and therefore incapable of learning a minority language?