The switch-pack probably snaps out of the armrest. See if that smells burned. Like the electricians say, you "let the smoke out" of something. Replacing the switch isn't bad (except $$).
If it's the actual motor that burned up, then you have to remove the inner door panel. Unless of course you already broke it apart by kicking... This picture probably doesn't help too much, cause it doesn't say exactly where all the fasteners are located.