I regularly use a silver spray paint as a combined primer/basecoat, and it works just fine.
Granted; I only do this because the model in question needs to be largely metallic, but painting over it is no problem at all.
Mostly, I use washes over it, to tint the metal, but for those details that require standard painting, straight paint over it works perfectly fine.
Now; I use a spray can of silver acrylic paint from Hema, a Dutch chain of stores that only sells their own brands, but I reckon it's no different from those sold by Armypainter, Vallejo or GW.
Just go for it; once well dried, the metallic particles in the paint will not come off, so the subsequent layers of paint over it will not have any stray particles in them. In my experience anyway...