And the pack is cheap and they fail kinda often.
The resistor pack receives full current from the circuit, and like a stepped dining room light rheostat, the resistors are what knock current out of the circuit. The diminished current spins the motor less quickly, giving you speeds.
This might make it more logical why it works on high but not other speeds.
Good luck.