The house is one part of the former sugar magnate’s Park Hill estate, which is was broken up into smaller properties