Countless.dev is a comprehensive platform that allows you to see and compare different AI models effortlessly. The platform is free and open-source, offering detailed comparisons based on various parameters such as input length, output length, input price, output price, and vision support. With support for multiple AI categories like chat, embedding, image generation, completion, audio transcription, and TTS (Text To Speech), Countless.dev makes it easy to find the best AI model for your needs.

llm-tournament provides a modular, extensible approach for benchmarking large language models. Users define participants (LLMs), configure tournament brackets, specify prompts and scoring logic, and run automated rounds. Results are aggregated into leaderboards and visualizations, enabling data-driven decisions on LLM selection and fine-tuning efforts. The framework supports custom task definitions, evaluation metrics, and batch execution across cloud or local environments.