Pits and Orbs is an open-source reinforcement learning environment implemented in Python, offering a turn-based multi-agent grid-world where agents pursue objectives and face environmental hazards. Each agent must navigate a customizable grid, avoid randomly placed pits that penalize or terminate episodes, and collect orbs for positive rewards. The environment supports both competitive and cooperative modes, enabling researchers to explore varied learning scenarios. Its simple API integrates seamlessly with popular RL libraries like Stable Baselines or RLlib. Key features include adjustable grid dimensions, dynamic pit and orb distributions, configurable reward structures, and optional logging for training analysis.

The Beer Game Environment provides a discrete-time simulation of a four-stage beer supply chain—retailer, wholesaler, distributor, and manufacturer—exposing an OpenAI Gym interface. Agents receive observations including on-hand inventory, pipeline stock, and incoming orders, then output order quantities. The environment computes per-step costs for inventory holding and backorders, and supports customizable demand distributions and lead times. It integrates seamlessly with popular RL libraries like Stable Baselines3, enabling researchers and educators to benchmark and train algorithms on supply chain optimization tasks.