This is because they will all have someone they dislike and like in the party so this will even it out. These are the companions you will recruit once you have given all the previous noble companions fiefs.You will find while gathering these companions you will have morale/friendship problems within your party, but alas, all of these problems will go away once you have gathered all of these companions.