The MARL Simulator is designed to facilitate efficient and scalable development of multi-agent reinforcement learning (MARL) algorithms. Leveraging PyTorch's distributed backend, it allows users to run parallel training across multiple GPUs or nodes, significantly reducing experiment runtime. The simulator offers a modular environment interface that supports standard benchmark scenarios—such as cooperative navigation, predator-prey, and grid world—as well as user-defined custom environments. Agents can utilize various communication protocols to coordinate actions, share observations, and synchronize rewards. Configurable reward and observation spaces enable fine-grained control over training dynamics, while built-in logging and visualization tools provide real-time insights into performance metrics.

Reinforcement Learning Agents for PettingZoo Games is a Python-based code library delivering off-the-shelf DQN, PPO, and A2C algorithms for multi-agent reinforcement learning on PettingZoo environments. It features standardized training and evaluation scripts, configurable hyperparameters, integrated TensorBoard logging, and support for both competitive and cooperative games. Researchers and developers can clone the repo, adjust environment and algorithm parameters, run training sessions, and visualize metrics to benchmark and iterate quickly on their multi-agent RL experiments.