Gym-Recsys is a toolbox that wraps recommendation tasks into OpenAI Gym environments, allowing reinforcement learning algorithms to interact with simulated user-item matrices step by step. It provides synthetic user behavior generators, supports loading popular datasets, and delivers standard recommendation metrics like Precision@K and NDCG. Users can customize reward functions, user models, and item pools to experiment with different RL-based recommendation strategies in a reproducible manner.

VacuumWorld is an open-source simulation platform designed to facilitate the development and evaluation of multi-agent reinforcement learning algorithms. It provides grid-based environments where virtual vacuum cleaner agents operate to detect and remove dirt patches across customizable layouts. Users can adjust parameters such as grid size, dirt distribution, stochastic movement noise, and reward structures to model diverse scenarios. The framework includes built-in support for agent communication protocols, real-time visualization dashboards, and logging utilities for performance tracking. With simple Python APIs, researchers can quickly integrate their RL algorithms, compare cooperative or competitive strategies, and conduct reproducible experiments, making VacuumWorld ideal for academic research and teaching.