The home made a lasting impression on former Victorian premier Ted Baillieu when he first walked inside 27 years ago.