A quarter of people surveyed have fallen victim to ticket scams, losing £82 on average, Nationwide Building Society said.