You aren't crazy, people do this stuff usually out of ignorance. However the fact that you see who is doing this in your dreams tells me he may not be ignorant. Perhaps just curious but definitely not polite.
I agree with the psychic vampire possibly being unaware. I have found that making a talisman out of red cloth with protection symbols drawn on it gathered into a pouch that hangs around your neck close to your heart works very well for protection from such people and from any that might be wanting to get into your head while sleeping. The ingredients inside the pouch should contain sea salt, a pinch of rosemary and lavender, and a small bent brass nail. The nail attracts the energies, the salt traps them. Include anything that you feel important to include. I use a small stone that has meaning, a button etc. things that are you. You want to keep the items small so that your talisman doesn't get too bulky. Basically the same concept as a witches bottle but portable and always with you.
I used to have problems going anywhere that there was a group of pagans around like festivals and balls because it would cause me great headaches. If I wear the talisman I don't have that problem.
Place a chunk of Pink Quartz under your mattress for restful sleep. Amethyst hanging in a window works well as a ward, also sprinkling a little rosemary on the sill. I once made a walk around my entire yard with Morton's salt to create a protective circle on my property because of some teens that discovered my path and were playing around with stuff they shouldn't. It worked although my neighbor thought I was a little eccentric about weed control. Basically I was having the same things going on you are at that time. I don't feel they were being malicious but were trying to figure me out and experimenting.
Once I had my concentration and energy back I put myself in a bubble that deflects attack back to the person sending it. Funny story, I was cooking in the restaurant and one of the teens tried to get in my head while my bubble was up. I saw a blue flash, looked him straight in the eye and he was totally turning pale and left immediately. I heard his friend say, "I told you not to f**k with her". I know that laughing at them was probably not polite but I did tell them to have a nice evening!
Guess I am wordy today. Hope it helps!
Nat