you can get some nice Victorian looking S scale railway stuff from the US on ebay for doors and windows, also, Antenocit do some architectural details which would work....
I did some Victorian terraces and pub once, can't remember the dimensions, but failing any of the above, you could use a horizontal cocktail stick to simulate a window sash...