Finance chief says government will ‘lead by example’ and demonstrate commitment to cutting expenditure to reduce budget deficit.