The fan will run when the compressor runs. Both are controlled by one or two contactors. Good chance it that one of these contactors is shorted together keeping your fan on even while the compressor is off.
Shut power off to the outside unit, pull the maintenance panel off and look at the contactor.
This is what they typically look like:
Ones that are shorted out are typically blackened.