“It was like he was just another man, not my father,” the famous actor recalls this Father’s Day.