News comes after Acadie-Annapolis representative told Politico he was considering crossing floor to join Liberals