If you have the opposite of a self-serving bias, then you have a modesty bias.

And no, I don't think most people have high self-esteem. But I think most people have an ego they want to protect :)