You answered it yourself, but I will elaborate.
Humans are different between individuals. Some people are dumb. Some people are mean. Some people are evil. Fundamentally the paradox of tolerance applies to fairness as well.
Well you wouldn’t like this answer probably. I suggest to eliminate the differences but i think it’s impossible. As long as there is positive, there is negative. To eliminate the negative is to eliminate the positive too, which is neutral and can make life very dull. So my other suggestion is quite radical which is to eliminate life itself. Or just make life or the world as fair as possible even if it’s impossible.
Ah, good old fashioned Nihilism. Another thing that I think is silly.
It is irrelevant what you think personally. Other people don’t necessarily think those things and assuming that they will or do abide by your positions without an incentive is folly.
I’m simply just providing my solutions or opinions. Better than nothing i guess, unless you have a better plan.
Of course, it’s impossible to please everyone. Can’t take some without losing some. So maybe just brute force it? Idk.