The world of estrangement is a weird little club that no one really wants to be part of, says Eilidh Dorgan