When Anthropic's older Claude model played Pokemon Red, it spent “dozens of hours” stuck in one city and had trouble identifying non-player characters. With Claude 4 Opus, the team noticed an improvement in Claude’s long-term memory and planning capabilities.