Baltimore was one of the major centers of gang and election day riots at the time. As in New York, most of the gangs were Nativists, opposed to Irish, Germans, and Dutch immigrants. The most notorious of the gangs was the Plug Uglies, centered in Baltimore but who also ranged from Washington and New York to take part in election and draft riots. They used clubs, cutlasses, muskets, and even (on at least two occasions) a carronade to "defend" polling places so only the right people could vote. Other gangs in Baltimore included the Rip Raps, Bloody Tubs, and the Tigers. They fought other gangs, the police, the National Guard (in DC), and even Maryland and Pennsylvania state militia at the start of the Civil War (the Pratt Street Riot in Baltimore).
Their "exploits" make good skirmish scenarios. I've done games of these gang wars using a mix of Perry, Foundry, and Brigade Games figures.