A senior SNP minister has been accused of physical assault by the former leader of the Scottish Conservatives.