Should I stop my colleague from having an extramarital affair?

This kind of thing belongs to other people's housework, and you just don't have the need to take care of it. Also, just take care of yourself and don't worry about others. But out of friendship, you should stop talking. After all, this person is like this now. If you talk too much, he will definitely be hostile to you, so you should be nice.