Ok, so I got it out, but it took some doing.
I tried to drill the stub yesterday to so I could use an easy out, but I needed long drill bits and I ordered some from Amazon that were cobalt, but they sure acted like HSS, so I was pissing up a rope.
Gave up and then figured I'd try removing the mount again. I put a jack under the reverser to keep things in place and then removed the starter to give myself some more room. Then started tapping the reverser forward, but a 1/2" captive nut on the frame got in the way. Wasn't enough room for a cutoff wheel or a big grinder, to I used a burr bit on a die grinder and a chisel and got the captive nut removed. I'll replace it before I button everything back up.
Then the mount slid out.
Cleaned up the mount and spent a fair bit of time getting it in the drill press vise and all squared up, and then I figured I might as well check to see if it the stub will turn if it get after it with a chisel. There was a burr conveniently located on the stub and lo and behold, it came out with no issues!
Before I reinstalled the mount, I ran a tap through the threads in both bolt holes. One had some issues; threads weren't cut nearly far enough, so took my time, used plenty of cutting oil, and got another inch or so of threads cut.
When I reinstalled it, I realized why it was so damn difficult to remove; it was in backwards. One side of the mount had a bevel in the top so it wasn't get wedged against the frame.
It had been installed with 2" bolts, and those were too short. It needed 2.5" bolts, but I just had 2" and 3" so I cut a few down to size.
Installed with some blue Loctite and tightened it to German torque specs (Guttentite).