But Minister for Housing accused of having ‘brass neck’ in telling city council to zone more land for residential property