Starting in the 17th century and then in ever increasing numbers ship crews grew more cosmopolitan. In the Carribean some of the former slaves were Arabs as well as other Arabs who had sailed out with Arab slaver vessels, at least so say occasional geneologies I've seen.
Indians and sailors from numerous south Pacific cultures could be found in ports through out the Spanish empire, so go ahead use them anywhere in judicious numbers.