You will find those that have a dislike for a particular monster race. These are Goblins, Orcs, Giants and Trolls. As it turns out, all of these are still better than the walking dead - on any day !!! There are some that seek to gather these races towards themselves, and add them to an army, to rid Despair once and for ever of it's undead ilk.
So, having said that, visit the lands in/around Micidal, Gurney, Sermon Swamps, and The Ruins of Despair to find those people, so you can start gathering your forces. The more you make them submit, the more they will join you and your forces.