possible bad fuel pump??

Ive been having trouble lately with my 94 GT not wanting to run after a litte bit of driving. Finaly I decided to check fuel pressure after, replacing EGR and EGR posistion sensor. Readings were odd and not overly helpfully to me. KOEO I had around 15PSI. At idle I had 34psi. with mild throttle it dropped down to around 32psi. And dropped to 30psi with a bit more throttle. I'm thinking it needs a new fuel pump. Unless I misunderstand shouldnt the pressure go up a few pounds with load instead of down? When we were starting the car. It didnt seem to smoothly move up the pressure it started at 5psi then yanked up to 10psi and so on untill landing at 34 at idle as well. The fuel filter is about three days old.

Ok we did remove tvac line and there was no gas visable but i will smell of it tomorrow to double chck and with the vac line off pressure went up to 37psi KOER.

Ill just replace both the fuel pump and the FPR. Are concern was that the problem gets worse when the car has been running for a bit, especialy in the heat. I kinda thought it might be a weak fuel pump getting worse the longer it was running. Thank you for your advice.