Scotty, Scotty! Your posts have been by far among the most useful on this forum. I'd hate to think that all the good you've done here has caused you harm.
When you say you have become a pariah, I hope you understand that that probably only is true in the eyes of a relatively small proportion of your friends and acquaintances. The reason for this is that many people, or perhaps even the large majority of people, all have their own sexual secrets. I only began to realize this once my wife cheated on me. Until then, I thought that my marriage had to be like a Disney fairytale. Now I have realized that for many (or most) people it is far from that, and that the most surprising people can still act like real sexual animals.
For example, I found out that one of our secretaries at work did porn for half a year. A little searching online was all it took to discover several dozen videos of her. Except for one other person in our office, no one else here knows anything about it. (Or, at least, I don't think they do.)
Bit by bit over the last two or three years I have gradually discovered that many people whom I previously thought of as morally upstanding, or even prudish, actually have pretty steamy histories. Colleagues have slept with one another, have hit on one another, have become so infatuated with one another that spouses have had to write tear-filled letters to superiors, etc. One gorgeous young mother of two turned out also to have come within a hair's breadth of a sex offender conviction by sleeping with a minor in a previous job. And these are all people whom I see almost every day.
So for every person who might think that you are a pariah, there probably are two people who wish that they had had the balls that you have, and another two people who are thinking "there but for the grace of God go I..."
However, I agree with you that the risks are considerable. Unless, of course, you convert your marriage to an open marriage before proceeding. I presently am working on this. (It doesn't hurt that my wife was the first one to cheat, and it also doesn't hurt that she actually has told me a couple of times that I should go and find other women -- I just need to work toward the point where she and I both are sure that when she says this, she really means it.)