Prince Harry couldn't resist making jokes about his upbringing as a royal, five years on from stepping away from his senior role