Sticking starter...any ideas on fix?

What year and how is it wired. When an oldschool Ford pole shoe starter does thiis, it means the relay on the fenderwell is stuck in the operating position. Or the ignition switch adjustment is such that when you let go of the key, the spring does not push the switch from start to run like it should.

If it is a mini starter, like the FRPP unit, the same applies, but you could have the wires touching at the starter which keeps it energised.

Lastly, make sure you have the correct starter (starter nosepiece actually) for a stick or auto, the correct block positioning plate and bellhousing, and flexplate or flywheel.