This is a stereotypical thought process that doesn’t even have any sense. In this case, you must ignore everything people say that doesn’t support you or helps you in your career. You can’t shut people’s mouths, you can only focus on your things. So, it’s simple, ignore others and look after yourself. Don’t drag yourself into these things, let them say what they have to say.