After driving on the highway for a few hours my 95 accord will randomly die whenever I pull off the highway and start driving at slower speeds. When I'm stopped the car will also idle around 2000rpm and then drop low till the car almost stalls, sometimes it stalls and sometimes it doesn't. I'm guessing there is something wrong with the fuel pump or the fuel filter needs replacing.

 

Well to be honest, a fuel flow problem would show it's ugly head at highway speeds when the demand for fuel is higher.
Has there ever been any main't done to this Creampuff? PCV valve? Spark Plugs?
I'd first say to check the throttle plate for binding, clean it all up with carb cleaner around the throttle plate, and also consider the IACV for a good cleaning.
Check for any stored codes in the computer.
Does the idle continually go high-low-high-low?