Well, The pivot point is already as far out as it can go without moving the hinge down. The hinge can't be moved down anymore because of the tub (see pics). So it's a very tight spot for this set-up. The only thing I have left to play with is getting the door side closer to the outside. I only need about a 1/4".
It's currently shimmed out 1/8" from this location and just touches the skin:
Can't move down any further:
Worst case scenario if i can't use the full "180*" it's not the end of the world.