The LLM Maze Agent framework provides a Python-based environment for building intelligent agents capable of navigating grid mazes using large language models. By combining modular environment interfaces with chain-of-thought prompt templates and heuristic planning, the agent iteratively queries an LLM to decide movement directions, adapts to obstacles, and updates its internal state representation. Out-of-the-box support for OpenAI and Hugging Face models allows seamless integration, while configurable maze generation and step-by-step debugging enable experimentation with different strategies. Researchers can adjust reward functions, define custom observation spaces, and visualize agent paths to analyze reasoning processes. This design makes LLM Maze Agent a versatile tool for evaluating LLM-driven planning, teaching AI concepts, and benchmarking model performance on spatial reasoning tasks.

MARL-DPP is an open-source framework enabling multi-agent reinforcement learning (MARL) with enforced diversity through Determinantal Point Processes (DPP). Traditional MARL approaches often suffer from policy convergence to similar behaviors; MARL-DPP addresses this by incorporating DPP-based measures to encourage agents to maintain diverse action distributions. The toolkit provides modular code for embedding DPP in training objectives, sampling policies, and managing exploration. It includes ready-to-use integration with standard OpenAI Gym environments and the Multi-Agent Particle Environment (MPE), along with utilities for hyperparameter management, logging, and visualization of diversity metrics. Researchers can evaluate the impact of diversity constraints on cooperative tasks, resource allocation, and competitive games. The extensible design supports custom environments and advanced algorithms, facilitating exploration of novel MARL-DPP variants.

The MARL Simulator is designed to facilitate efficient and scalable development of multi-agent reinforcement learning (MARL) algorithms. Leveraging PyTorch's distributed backend, it allows users to run parallel training across multiple GPUs or nodes, significantly reducing experiment runtime. The simulator offers a modular environment interface that supports standard benchmark scenarios—such as cooperative navigation, predator-prey, and grid world—as well as user-defined custom environments. Agents can utilize various communication protocols to coordinate actions, share observations, and synchronize rewards. Configurable reward and observation spaces enable fine-grained control over training dynamics, while built-in logging and visualization tools provide real-time insights into performance metrics.

MARTI (Multi-Agent Reinforcement learning Toolkit and Interface) is a research-oriented framework that streamlines the development, evaluation, and benchmarking of multi-agent RL algorithms. It offers a plug-and-play architecture where users can configure custom environments, agent policies, reward structures, and communication protocols. MARTI integrates with popular deep learning libraries, supports GPU acceleration and distributed training, and generates detailed logs and visualizations for performance analysis. The toolkit’s modular design allows rapid prototyping of novel approaches and systematic comparison against standard baselines, making it ideal for academic research and pilot projects in autonomous systems, robotics, game AI, and cooperative multi-agent scenarios.

Mava is a JAX-based open-source library for developing, training, and evaluating multi-agent reinforcement learning systems. It offers pre-built implementations of cooperative and competitive algorithms such as MAPPO and MADDPG, along with configurable training loops that support single-node and distributed workflows. Researchers can import environments from PettingZoo or define custom environments, then use Mava’s modular components for policy optimization, replay buffer management, and metric logging. The framework’s flexible architecture allows seamless integration of new algorithms, custom observation spaces, and reward structures. By leveraging JAX’s auto-vectorization and hardware acceleration capabilities, Mava ensures efficient large-scale experiments and reproducible benchmarking across various multi-agent scenarios.

simple_rl is a minimalistic Python library designed to streamline reinforcement learning research and education. It provides a consistent API for defining environments and agents, with built-in support for common RL paradigms including Q-learning, Monte Carlo methods, and dynamic programming algorithms like value and policy iteration. The framework includes sample environments such as GridWorld, MountainCar, and Multi-Armed Bandits, facilitating hands-on experimentation. Users can extend base classes to implement custom environments or agents, while utility functions handle logging, performance tracking, and policy evaluation. simple_rl's lightweight architecture and clear codebase make it ideal for rapid prototyping, teaching RL fundamentals, and benchmarking new algorithms in a reproducible, easy-to-understand environment.