Labour TD Duncan Smith said Fine Gael “squandered” its time in the Justice brief while in Government.