The Chancellor hinted that the UK could "potentially" back Israel, but didn't comment on "what might happen in the future"