But it doesn't work when someone is facing me, because my brain assumes that their right is my right.

My coping mechanism sometimes gets me, because I learned to think someone else's right was always the right when talking to other people. Don't have much problems with people in real life, but ask me to describe where one person is standing in a photo compared to someone else, and I goof up a lot! I look at a photo, and I put myself in place of the person in the photo. (For example: John is actually to my left compared to Jane when looking at the picture. But John is toward what Jane calls her right when the picture was taken, and that's how I see it!)