simple_rl is a minimalistic Python library designed to streamline reinforcement learning research and education. It provides a consistent API for defining environments and agents, with built-in support for common RL paradigms including Q-learning, Monte Carlo methods, and dynamic programming algorithms like value and policy iteration. The framework includes sample environments such as GridWorld, MountainCar, and Multi-Armed Bandits, facilitating hands-on experimentation. Users can extend base classes to implement custom environments or agents, while utility functions handle logging, performance tracking, and policy evaluation. simple_rl's lightweight architecture and clear codebase make it ideal for rapid prototyping, teaching RL fundamentals, and benchmarking new algorithms in a reproducible, easy-to-understand environment.

CommNet is a research-oriented library that implements the CommNet architecture, allowing multiple agents to share hidden states at each timestep and learn to coordinate actions in cooperative environments. It includes PyTorch model definitions, training and evaluation scripts, environment wrappers for OpenAI Gym, and utilities for customizing communication channels, agent counts, and network depths. Researchers and developers can use CommNet to prototype and benchmark inter-agent communication strategies on navigation, pursuit–evasion, and resource-collection tasks.