Your carb has four corner idle, correct?
Generally, I've always adjusted the secondary blade to balance idle fuel/air delivery and mitigate idle issues, rather than addressing stumble problems.
Some stuff to check:
Proper clearance at WOT for the pump arm to lever. The service manual spells out the clearance.
Proper operation of the nozzle check valve/ball
Adjust primary pump cam and/or nozzle size
Experiment with larger pump capacity
Since your issue is between gears, assuming you release and re-apply the throttle, your focus should be on the primary side of the carb. You can duplicate rapid release and application off the engine and observe operations.
Other than properly balancing idle fuel/air between primary and secondary (assuming secondary idle circuit), my focus, assuming the carb is adjusted correctly to factory specs, would be the primary accelerator pump circuit.
When you perform high rpm shifts when performance driving, I presume operations are normal and this appears to be a street driveability issue, correct?