I have paper counters etc for a variety of figure games, and glued most of them to pre-cut MDF bases.
Depends on your counter size, but a couple of bags of 20x20 2mm MDF bases would probably go a long way. The lazer cut ones might be best. If you give the paper a touch of varnish it should make them more durable too.