Grade II listed Georgian gem packed with character but also hiding masses of surprise space and remarkable rooms