I suppose you are right, morality should be retained no matter how you view the other party. However since morality is relative and is defined by the individual, one's morals may actually be based on their views of other people. I mean look at the Nazi party, entirely moral in their minds to exterminate people because they didnt like them.