CityLearn provides a modular simulation platform for energy management research using reinforcement learning. Users can define multi-zone building clusters, configure HVAC systems, storage units, and renewable sources, then train RL agents against demand response events. The environment exposes state observations like temperatures, load profiles, and energy prices, while actions control setpoints and storage dispatch. A flexible reward API allows custom metrics—such as cost savings or emission reductions—and logging utilities support performance analysis. CityLearn is ideal for benchmarking, curriculum learning, and developing novel control strategies in a reproducible research framework.

Fast Reinforcement Learning is a specialized Python framework designed to accelerate the development and execution of reinforcement learning agents. It offers out-of-the-box support for popular algorithms such as PPO, A2C, DDPG and SAC, combined with high-throughput vectorized environment management. Users can easily configure policy networks, customize training loops and leverage GPU acceleration for large-scale experiments. The library’s modular design ensures seamless integration with OpenAI Gym environments, enabling researchers and practitioners to prototype, benchmark and deploy agents across a variety of control, game and simulation tasks.

OpenSpiel is a research framework that provides a wide range of environments (from simple matrix games to complex board games such as Chess, Go, and Poker) and implements various reinforcement learning and search algorithms (e.g., value iteration, policy gradient methods, MCTS). Its modular C++ core and Python bindings allow users to plug in custom algorithms, define new games, and compare performance across standard benchmarks. Designed for extensibility, it supports single and multi-agent settings, enabling study of cooperative and competitive scenarios. Researchers leverage OpenSpiel to prototype algorithms quickly, run large-scale experiments, and share reproducible code.

Scale Insights provides an advanced AI-driven PPC automation solution specifically engineered for Amazon FBA sellers. It allows users to manage multiple campaigns, gain deep insights into performance, and make data-driven decisions. The platform provides customizable algorithms, real-time data, and detailed analytics to help sellers optimize their advertising strategies and increase their return on investment. Perfect for scaling Amazon businesses efficiently, Scale Insights also offers a 30-day free trial for new users.