Conservatives have faced furious opposition from their constituents during town hall meetings in their districts