Dataset and code
StarCraftImage is a large-scale easy-to-use spatial reasoning dataset that includes 3.6 million images that summarize 10-second windows of human-played matches from the StarCraft II video game. This work was presented in CVPR 2023: StarCraftImage: A Dataset For Prototyping Spatial Reasoning Methods For Multi-Agent Environments
The image below showcases additional examples from StarCraftImage including the hyperspectral format that includes all unit type information at a resolution of 64 x 64 (left), the RGB format that matches CIFAR10 at a resolution of 32 x 32 (middle) and the grayscale format that matches MNIST at a resolution of 28 x 28.