VacuumWorld is an open-source simulation platform designed to facilitate the development and evaluation of multi-agent reinforcement learning algorithms. It provides grid-based environments where virtual vacuum cleaner agents operate to detect and remove dirt patches across customizable layouts. Users can adjust parameters such as grid size, dirt distribution, stochastic movement noise, and reward structures to model diverse scenarios. The framework includes built-in support for agent communication protocols, real-time visualization dashboards, and logging utilities for performance tracking. With simple Python APIs, researchers can quickly integrate their RL algorithms, compare cooperative or competitive strategies, and conduct reproducible experiments, making VacuumWorld ideal for academic research and teaching.

Scalable MADDPG is a research-oriented framework for multi-agent reinforcement learning, offering a scalable implementation of the MADDPG algorithm. It features centralized critics during training and independent actors at runtime for stability and efficiency. The library includes Python scripts to define custom environments, configure network architectures, and adjust hyperparameters. Users can train multiple agents in parallel, monitor metrics, and visualize learning curves. It integrates with OpenAI Gym-like environments and supports GPU acceleration via TensorFlow. By providing modular components, Scalable MADDPG enables flexible experimentation on cooperative, competitive, or mixed multi-agent tasks, facilitating rapid prototyping and benchmarking.