Delay wiper / washer problems

My intermittent wipers and windshield washer only work when I am using my turn signal. I can push in for washer fluid all I want when I am not signaling, and I'll never get anything, but if I push it in while signaling for a turn, I get washer fluid. Same with the intermittent wipers - the intermittent function works only with the turn signal on.

Granted, people here in upstate NY are such terrible drivers that they likely don't understand turn signals anyways, but I would still like to fix this problem.

Should I buy a new turn signal arm? Or is there something else I should check first? The signals themselves work fine, and regular wiper functions (non-intermittent) work fine as well. I just can't use the delay or washer functions while driving without a turn signal on.