It doesn't matter if the husband was an asshole. If she divorced him and later decided to start a relationship with this guy that's one thing. There is no scenario where it's ok to screw another man's wife, and you have to be a real idiot to be screwing your boss's wife. It is most definitely a breach of trust.