One of the most shocking moments of the BBC reality gameshow saw the actor vote to banish the ex-rugby star