I'm new to the world of Accords, just got a 1992 LX Sedan and the power mirrors keep trying to move right if I touch the switch, they wont move any other direction.

Is this a bad switch or a sensor?

 

Try manually moving the mirror(s) in all directions, being gentle of course. Then see if one or both work normal. Sometimes the motors get a little stuck. Otherwise, you can pull the switch, determine which is the hot wire and then manually jumper between the terminals on the wire connector and see if the mirrors operate fine in all directions. If they do then it is the switch.