The Real Housewives producer claims he stopped hearing from Bravo production teams after he started a side hustle in the adult entertainment industry