Reaper miniatures make some swarm bases with multiple rats or spiders, but they’re piles of critters, rather than individuals and probably not ideal for dungeon crawls.
I wonder if sculpting some with green stuff and making a press mould with green stuff or the blue meltable stuff would be feasible. They turn out a bit rough, but a tidy paint job should sort things out.