CityLearn provides a modular simulation platform for energy management research using reinforcement learning. Users can define multi-zone building clusters, configure HVAC systems, storage units, and renewable sources, then train RL agents against demand response events. The environment exposes state observations like temperatures, load profiles, and energy prices, while actions control setpoints and storage dispatch. A flexible reward API allows custom metrics—such as cost savings or emission reductions—and logging utilities support performance analysis. CityLearn is ideal for benchmarking, curriculum learning, and developing novel control strategies in a reproducible research framework.

CryptoTrader Agents provides a comprehensive toolkit for designing, training, and deploying AI-driven trading strategies in cryptocurrency markets. It includes a modular environment for data ingestion, feature engineering, and custom reward functions. Users can leverage preconfigured reinforcement learning algorithms or integrate their own models. The platform offers simulated backtesting on historical price data, risk management controls, and detailed metric tracking. When ready, agents can connect to live exchange APIs for automated execution. Built on Python, the framework is fully extensible, enabling users to prototype new tactics, run parameter sweeps, and monitor performance in real time.

Fast Reinforcement Learning is a specialized Python framework designed to accelerate the development and execution of reinforcement learning agents. It offers out-of-the-box support for popular algorithms such as PPO, A2C, DDPG and SAC, combined with high-throughput vectorized environment management. Users can easily configure policy networks, customize training loops and leverage GPU acceleration for large-scale experiments. The library’s modular design ensures seamless integration with OpenAI Gym environments, enabling researchers and practitioners to prototype, benchmark and deploy agents across a variety of control, game and simulation tasks.

Multi-Agents System from Scratch provides a comprehensive set of Python modules to build, customize, and evaluate multi-agent environments from the ground up. Users can define world models, create agent classes with unique sensory inputs and action capabilities, and establish flexible communication protocols for cooperation or competition. The framework supports dynamic task allocation, strategic planning modules, and real-time performance tracking. Its modular architecture allows easy integration of custom algorithms, reward functions, and learning mechanisms. With built-in visualization tools and logging utilities, developers can monitor agent interactions and diagnose behavior patterns. Designed for extensibility and clarity, the system caters to both researchers exploring distributed AI and educators teaching agent-based modeling.

OpenSpiel is a research framework that provides a wide range of environments (from simple matrix games to complex board games such as Chess, Go, and Poker) and implements various reinforcement learning and search algorithms (e.g., value iteration, policy gradient methods, MCTS). Its modular C++ core and Python bindings allow users to plug in custom algorithms, define new games, and compare performance across standard benchmarks. Designed for extensibility, it supports single and multi-agent settings, enabling study of cooperative and competitive scenarios. Researchers leverage OpenSpiel to prototype algorithms quickly, run large-scale experiments, and share reproducible code.

Scale Insights provides an advanced AI-driven PPC automation solution specifically engineered for Amazon FBA sellers. It allows users to manage multiple campaigns, gain deep insights into performance, and make data-driven decisions. The platform provides customizable algorithms, real-time data, and detailed analytics to help sellers optimize their advertising strategies and increase their return on investment. Perfect for scaling Amazon businesses efficiently, Scale Insights also offers a 30-day free trial for new users.

Waverly is a deep-tech AI platform designed to power AI-native experiences for social networking. It enables users to create customized content curation algorithms, allowing for a highly personalized and engaging user experience. Waverly's AI technology helps in building trust with users while providing valuable insights and intuitive content management. It's specifically designed for businesses looking to elevate their customer experience and engagement through innovative AI solutions.

The Multi Agent Robotic System project offers a modular Python-based platform for developing, simulating, and deploying cooperative robotic teams. At its core, it implements decentralized control strategies, enabling robots to share state information and collaboratively allocate tasks without a central coordinator. The system includes built-in modules for path planning, collision avoidance, environment mapping, and dynamic task scheduling. Developers can integrate new algorithms by extending provided interfaces, adjust communication protocols via configuration files, and visualize robot interactions in simulated environments. Compatible with ROS, it supports seamless transitions from simulation to real-world hardware deployments. This framework accelerates research by providing reusable components for swarm behavior, collaborative exploration, and warehouse automation experiments.

Pacman AI offers a fully functional Python-based environment and agent framework for the classic Pacman game. The project implements key reinforcement learning algorithms—Q-learning and value iteration—to allow the agent to learn optimal policies for pill collection, maze navigation, and ghost avoidance. Users can define custom reward functions and adjust hyperparameters such as learning rate, discount factor, and exploration strategy. The framework supports metric logging, performance visualization, and reproducible experiment setups. It is designed for easy extension, letting researchers and students integrate new algorithms or neural network-based learning approaches and benchmark them against baseline grid-based methods within the Pacman domain.