Influencer Holly, 25, and Olympic swimmer Adam, 30, have reportedly banned his mother Caroline from their Christmas wedding