The diaphram in your new regulator has sprung a leak. Put the old regulator back on and send the new one back for an exchange or refund.
The FPR uses engine vacuum to help regulate the fuel pressure. There is pressurized fuel on one side of the diaphram and engine vacuum on the other side. When an internal leak develops, it spits fuel out the vacuum line.