Sir Ken McCallum admitted he was ‘frustrated’ over spy case collapse as CPS faces further questions over failure to prosecute