Yeah that would be a hard no in my book if the marriage is monogamous and not open. If my spouse was being intimate with someone else -- and cuddling is intimate, regardless of whether there's sex happening -- and hadn't explicitly discussed that with me beforehand, yeah... that's a huge problem.