EthicalEvalMAS provides a modular environment to assess multi-agent systems across key ethical dimensions such as justice, autonomy, privacy, transparency, and beneficence. Users can generate custom scenarios or use built-in templates, define bespoke metrics, execute automated evaluation scripts, and visualize outcomes through built-in reporting tools. Its extensible architecture supports integration with existing MAS platforms and facilitates reproducible ethical benchmarking across different agent behaviors.