Michelle Collins is taking a break from the show and won't be seen on screen for months after their character's huge storyline