Adding a negative modifier to Speed has the additional result of weakening the character in combat by making him easier to hit (e.g. anyone striking a character with -1 Speed would get a +1 to hit). Not the worst option for a character, but a factor worth bearing in mind.