Property was the site of parties, fights, drama and was the backdrop to the success of the Rolling Stones