This poses a nice conundrum
I've been browsing the Boardgamegeek website for dungeon-like games with (plastic) miniatures, and they do not go further back than around 1985. Older games usually had either cardboard chits or meeples of some sort.
So the games I came up with that come close to your description are either
Dungeonquest and
Warlock of Firetop Mountain.
But the included minis are not in different colours, and I don't spot any female characters either. Which is not to say that those versions do not exist. In fact, I did see later comparable games (outside of your time window though) which
did have coloured minis and male and female versions of the characters...