Figured out why the e-pump would receive power as soon as I connected the battery.. I removed one of the red wires, the one I had going from the pump to the battery.
I now have it setup like this:
Positive wire from e-pump to switch
Red power supply wire from positive battery terminal to switch
Ground for pump
Ground for switch.
Now I got to go hide this switch somewhere only I know