Why wont people let me be alone?

im a very quiet person (not shy, quiet) i prefer sleeping, fishing, or drawing alone rather than hang around with my friends. but for some reason people complain about it even though I am not bothering anyone, i hear people talk about me in groups behind my back even my family does it. I am getting to the point to where i just want to quit school and run away from my friends and family. I don't really care if i become a bum but do i really have to go that far just to be in solitude. what the hell does a guy have to achieve complete silence? die? because i for one don't want to die. is there something mentally wrong with me? i have been told by therapist that i am depressed and they want to medicate me but i don't see anything wrong with my wish....