The Britain's Got Talent judge didn't need to be told by the comedian as she shared how she 'knew' he'd done well on the show