The Duke of Sussex made a surprise visit to a royal residence near Buckingham Palace to see his father during a break in a brief trip from California.