Hi Chicken
I know how you feel and where you are coming from, I've been having some counselling for the last few months and one of my biggest mountains to climb is to try and stop being the person I think everyone else wants me to be. It's very hard to stop your thinking patterns to do that, but what we need to learn to do is to be happy in our own skin, to be ourselves, and to realise that most people will accept you for you and those who don't .. well ... the world isn't going to end because of their opinion.
If you are happy and enjoy going home at weekends, then you carry on doing that. It's what YOU want and what YOU enjoy that's the most important part ... not what others may or may not think about you doing it.
You carry on doing what makes you feel right Chicken, and as my counsellor is always telling me ... be kind to yourself. Which means don't beat yourself up because a few friends think what you are doing is wrong according to them ... congratulate yourself in doing what you want to do and go home every weekend and enjoy it