I just put 2500 miles on my truck with similar set up as you have.
The blower is a fantasic way to get all around power.
As mentioned, Boost referencing a carb is the way to get past your problems. The power valve on your setup will never open to richen the mixture when you are under load. The suction (vacuum) from the blower is constant, meaning the vacuum is always keeping the valve closed.
There are simple ways to convert your existing carb to work with the blower, if interested, I'll post the information of how to convert your carb.
When converted, the vaccum source for the power valve will come from the under side of the blower, then by a vacuum line the vacuum signal will get to the power valve by way of an outside source vs from under the base plate that it does now.
In my picture you'll see a vacuum line with a tee fitting on the carb. On your carb, you now have a black rubber cap on the vacuum fitting, this fitting will now become the source of which will signal the power valve. Don't worry about my tee fitting I'm using it for the vacuum modualaor on the transmission.
Good luck, Jim