Threats from ‘lunatics’ and ‘terrorists’ will stop Harry and Meghan coming back to the UK, an expert says, but the Duke would have missed his dad on Father’s Day