"The love between them has grown deeper. We've grown both as people and as actors," he said