Prince Harry and his wife Meghan Markle moved to California in 2020 after they stepped back from their roles as senior members of the Royal Family