it is because that you are same like your wife mean have girl friend and doing may be something wrong with her (may be), i don't know which country and which society do you belong,
first think on yourself that if you are alone with any girl then will you can stop yourself to do with her...