The councillor made the decision to leave the party after the welfare cut announcement in the Spring Budget