Locals in the town of Stroud in the Cotswolds have demanded the long-time Labour donor and entrepreneur removes the banner from his office building.