The Duke of Sussex previously said does not feel it is safe to bring his family to the UK without police protection.