Mean-Field MARL provides a robust Python framework for implementing and evaluating mean-field multi-agent reinforcement learning algorithms. It approximates large-scale agent interactions by modeling the average effect of neighboring agents via mean-field Q-learning. The library includes environment wrappers, agent policy modules, training loops, and evaluation metrics, enabling scalable training across hundreds of agents. Built on PyTorch for GPU acceleration, it supports customizable environments like Particle World and Gridworld. Modular design allows easy extension with new algorithms, while built-in logging and Matplotlib-based visualization tools track rewards, loss curves, and mean-field distributions. Example scripts and documentation guide users through setup, experiment configuration, and result analysis, making it ideal for both research and prototyping of large-scale multi-agent systems.

Acme is a Python-based framework that simplifies the development and evaluation of reinforcement learning agents. It offers a collection of prebuilt agent implementations (e.g., DQN, PPO, SAC), environment wrappers, replay buffers, and distributed execution engines. Researchers can mix and match components to prototype new algorithms, monitor training metrics with built-in logging, and leverage scalable distributed pipelines for large-scale experiments. Acme integrates with TensorFlow and JAX, supports custom environments via OpenAI Gym interfaces, and includes utilities for checkpointing, evaluation, and hyperparameter configuration.