Most people when they drybrush, drybrush up! What I mean by that is they normally do it with lighter colours than the base colour. Have you ever tried drybrushing down? Drybrush darker colours not the recesses? I tend to use a leathery brown colour or a dark brown maybe going on black. For dusty environments, use a sandy colour. You can also drybrush stains down from certain points.