‘I just looked at her and thought, wow. I think if anything spoils a marriage, it’s children,’ said the 87-year-old Top of the Pops veteran