Awesome AI AgentsCode Automation and Testing

codeintegrity-ai/mutahunter

⭐ 300 Python added to this list on 2025-04-19 repository created 2024-06-21

Mutahunter is an open-source, language-agnostic mutation testing tool that leverages large language models (LLMs) to enhance software testing processes. It supports multiple programming languages and integrates with existing test frameworks to evaluate the effectiveness of test suites by introducing mutations into source code and checking if the tests detect these changes. The tool is designed to work with Python 3.11+ and can be installed easily via pip from its GitHub repository. Mutahunter uses advanced AI models like GPT-4o to generate and analyze mutants, providing detailed feedback on mutation coverage, including metrics such as the number of mutants killed, survived, timed out, or causing compile errors. This helps developers identify weaknesses in their test suites and improve code quality and reliability. The project emphasizes ease of use with simple command-line instructions to run mutation tests on specific files or entire projects. It supports integration with build tools like Maven for Java projects, allowing seamless testing workflows. The output includes comprehensive mutation testing reports with statistics on mutation coverage and cost estimates, making it practical for continuous integration environments. Mutahunter's open-source nature encourages community contributions and transparency, fostering innovation in mutation testing techniques. Examples provided in the repository demonstrate how to apply Mutahunter to different programming languages, showcasing its versatility and adaptability. The tool's language-agnostic approach and use of LLMs position it as a cutting-edge solution for mutation testing, helping developers ensure their tests are robust and effective across diverse codebases. Overall, Mutahunter aims to improve software quality by making mutation testing accessible, efficient, and intelligent through AI-driven analysis.

https://github.com/codeintegrity-ai/mutahunter

ai-driven-analysisartificial-intelligenceautomated-testingcontinuous-integrationgpt-4ojavalanguage-agnosticllmllm-agentmavenmutantsmutation-testingopen-sourcepythonsoftware-testingstatic-code-analysistest-automationtest-coveragetest-suite-evaluationunit-testing

Also in Code Automation and Testing

alibaba/arthas

Arthas is an open-source Java diagnostic tool by Alibaba that enables real-time production troubleshooting and performance monitoring without code changes or JVM restarts.

SWE-agent/SWE-agent

SWE-agent is an autonomous software engineering tool that uses large language models to automatically fix GitHub issues, perform web tasks, and solve cybersecurity challenges, achieving state-of-the-art results in automated software repair and offensive cybersecurity.

qodo-ai/qodo-cover

Qodo-Cover is an AI-powered tool that automates the generation of unit tests to enhance code coverage, supporting integration with GitHub CI workflows and local CLI usage.

judge0/judge0

Judge0 is a robust, scalable, and open-source online code execution system that supports over 60 programming languages and is designed for easy integration into various applications.

BuilderIO/micro-agent

BuilderIO/micro-agent is an AI-powered tool that writes and iteratively refines code by generating tests and ensuring all test cases pass, focusing on reliable test-driven development.

mattzcarey/shippie

Shippie is an AI-powered extensible code review agent that integrates into CI/CD pipelines to automatically detect code issues and improve software delivery speed.

OpenAutoCoder/Agentless

Agentless is an open-source project that automatically solves software development problems through a three-phase process of fault localization, repair, and patch validation, achieving competitive results on SWE-bench benchmarks.

the-open-engine/zeroshot

Command-line orchestrator that drives coding agent CLIs through an executor-verifier loop, so the agent that wrote a change is never the one that declares it correct.