Please listen to The1stWife. You are living in an abusive, controlling situation. You’ve been living like that for so long, you don’t even notice so much that others, even strangers on the internet can see.
You say that he wasn’t always like this, but then you describe point by point how he has controlled and narrowed your life options so that you don’t have work experience, don’t have financial access, and can’t take a walk around the block. Only that last part is recent, you say, but all of these other huge limitations along with moving you away from your family have been about him being in COMPLETE control of you.
And now, he was caught in a very unhealthy fixation with a woman at work, and he has LOST control. He almost got fired. He forced her to leave her job. His facade of control has slipped, and he’s looking to reestablish it somewhere. And you, the commodity/resource that he has always had complete control over, are rebelling suddenly because of the affair.
Believe me, I know what it is like to suddenly realize that you’ve only ever been seen as a convenient, useful possession by your spouse. I too thought that he had changed dramatically, but as time went by, I began to see things much more clearly. My WH was always insecure. He needed to be in the driver’s seat, but he was smart enough to fake it and let me think i had some power. When I started looking back, he always got his way—he just somehow convinced me that I had made the decision. He was able to lie without blinking and did so whenever telling the truth might produce inconvenience or cause me to argue with what he wanted to do (including have an affair).
I did not realize any of that until some time had passed from dday and I was able to think more clearly and look back with a less in-love view of our reality.
What he is doing now is trying to deflect away from what he has done. He’s desperately trying to pin some transgression on you so that he won’t look so bad. Don’t put up with it for a second.
And DON’T let his parents continue thinking that you are the unfaithful one. You are alone there. All you need is for he and his family to start punishing you until you start to wonder if you have actually done something wrong. That’s what he’s aiming for: he’s building a team to wear you down and shame you.
This situation is at the very least emotionally, psychologically dangerous to you. It is also financially and emotionally abusive. He sounds like he must have control, so he may be very unpredictable if he begins to feel that he’s losing control of you completely.
Please proceed with caution. Seek support from professionals who understand abuse better than you do.
Keep reminding yourself that this is NOT the person you thought you knew. You don’t at all know who he is and what he’s capable of at this point.