The public service will lose around 40,000 jobs from its peak in 2023-24, according to the federal budget tabled on Tuesday.