‘Mamma Mia!’ star admitted that at the time, she was aware of some of the ‘rumors about him, but not to the extent that it became’