For a lot of people, it does feel bad when people talk about them.
Of course, why not, you are investing your valuable time and life towards a mission and someone else is just gossiping about it drinking a coffee which was prepared while gossiping.
Here’s a little secret:
People talk about you, because probably they haven’t done something as meaningful as you have, and are in real pain witnessing you rise.
Do not get angry with them, have compassion. They are in pain.
And with that compassion, have a complete sense of respect for yourself. Expect from others what you give to you.
Be an unfit. Stop fitting in.