While on Wednesday some people tried to climb the fence, Saturday's concert saw a much more relaxed atmosphere at the location