In metal Aventine make some very nice Roman horses.
In plastic, it might be worth buying second-hand Riders of Rohan models on eBay if you can get them at the right price. These are lovely plastic horses; just cut off the riders and reuse. Some have head armour, but then Roman horses sometimes wore this. I have a unit of Romans riding these. :-)