IMO, it is dependent on what 4 dollars means to you. Is it 5, 10, 15, 25% raise? You need to decide how important 4 dollars an hour is, weight the benies between the two gigs and then decide.
I also would not count on being taken back. Always leave a job assuming you'll never come back...