There's a saying I like - 'The caravans move on, but the dogs still bark'. It means that there will always be people in your life that aren't always on your side (whether you realise it or not); that as you move on with your life/plan/dreams some kind of resentment or jealousy stops them feeling happy for you. They may whisper, smirk, begrudge or criticise. It's so important (but difficult) to keep on your path. Live YOUR life.