If it runs on after the faucet is shut not enough pressure against the switch to open it. Could be an air leak on the output side somewhere in the system.
Get a new pump anyway, always a spare is good to have on hand.
You may find a wiring problem also but you'll come across that when you change the pump. Pay particular attention to any crimp connections created by the blind installers.
2013 Voltage 3800, 2012 Chevy 3500 HD
2010 Yamaha V Star 950
2009 Yamaha Raider
Volunteering with Habitat for Humanity Caravanners