CityLearn provides a modular simulation platform for energy management research using reinforcement learning. Users can define multi-zone building clusters, configure HVAC systems, storage units, and renewable sources, then train RL agents against demand response events. The environment exposes state observations like temperatures, load profiles, and energy prices, while actions control setpoints and storage dispatch. A flexible reward API allows custom metrics—such as cost savings or emission reductions—and logging utilities support performance analysis. CityLearn is ideal for benchmarking, curriculum learning, and developing novel control strategies in a reproducible research framework.

OpenSpiel is a research framework that provides a wide range of environments (from simple matrix games to complex board games such as Chess, Go, and Poker) and implements various reinforcement learning and search algorithms (e.g., value iteration, policy gradient methods, MCTS). Its modular C++ core and Python bindings allow users to plug in custom algorithms, define new games, and compare performance across standard benchmarks. Designed for extensibility, it supports single and multi-agent settings, enabling study of cooperative and competitive scenarios. Researchers leverage OpenSpiel to prototype algorithms quickly, run large-scale experiments, and share reproducible code.