You should not be afraid of what he is doing with you. Stand against it and raise your voice. You can do two things, either you can try to tackle the situation by involving your family in the matter or you can go for a police complaint and file a case against the man. But you must not take this for granted. Tell your parents about this and ask them to help you and shift somewhere else.