Can a single man fall in love with a married woman?

Is it OK to fall in love with a married woman? Most societies agree that it is wrong to engage in an affair with a married person, whether a man or woman. Men can still be attracted to a married woman, and a single woman or a married woman can be attracted to someone other than their spouse.