Decorum at hallowed public spaces that represent our governance must be maintained, a former Conservative MP argues.