A new benchmark called MATE-Hard shows that cooperative multi-agent reinforcement learning policies lose roughly half their ...