As conventional AI benchmarking techniques prove inadequate, AI builders are turning to more creative ways to assess the capabilities of generative AI models. For one group of developers, that’s Minecraft, the Microsoft-owned sandbox-building game. The website Minecraft Benchmark (or MC-Bench) was developed collaboratively to pit AI models against each other in head-to-head challenges to respond […] © 2024 TechCrunch. All rights reserved. For personal use only.
A high schooler created MC-Bench, a website where users can challenge AI models to Minecraft build-offs. This novel benchmarking method allows users to vote on which AI model best responds to prompts with Minecraft creations, providing a more intuitive assessment of AI capabilities compared to traditional methods. Companies like Anthropic, Google, OpenAI, and Alibaba have subsidized the project.
