Awesome AI AgentsCode Automation and Testing

duriantaco/skylos

⭐ 462 Python repository created 2025-04-28

Skylos is an open-source static analysis command-line tool covering Python, TypeScript, JavaScript, Java, Go, Kotlin, PHP, Rust, Dart, C#, shell scripts and deployment configuration. It runs locally by default and can also act as a pull request gate in continuous integration, with a generator that writes a ready GitHub Actions workflow. A default scan reports dead code, unused files and framework entrypoint mistakes, and a flag adds security checks for dangerous data flows, hardcoded secrets, dependency vulnerabilities, deployment misconfiguration and quality regressions such as high complexity, duplicate branches and deep nesting. The agent-related part of the tool is a set of checks aimed at code produced by LLMs: missing guards, invented helper functions, calls to package APIs that do not exist, impossible dependency versions, and risks specific to LLM applications such as unsafe tool use and missing output validation. A verify command checks a specific file or line range and returns pass, fail or incomplete, where incomplete means a required proof could not be established, for example an unresolvable third-party import or an unsupported language feature; the result carries a coverage object listing which checks ran, which were skipped and why. Deterministic local API verification without executing target code is currently implemented for Python, TypeScript, JavaScript, Go and Java. Projects can declare a repository-specific hallucination contract that verify discovers automatically, define local rule packs, and set thresholds and ignores in a project config. A separate agent subcommand tests a running agent against deterministic response and tool-use scenarios. Skylos also ships as an MCP server, so an assistant can call its analysis directly, and as a VS Code extension. It is Apache-2.0 licensed and installs from PyPI, aimed at teams reviewing machine-generated code before merge.

https://github.com/duriantaco/skylos

static-analysissastdead-codesecuritysecrets-detectionllm-agentsmcp-servercode-qualityci-cdpython

Also in Code Automation and Testing

alibaba/arthas

Arthas is an open-source Java diagnostic tool by Alibaba that enables real-time production troubleshooting and performance monitoring without code changes or JVM restarts.

SWE-agent/SWE-agent

SWE-agent is an autonomous software engineering tool that uses large language models to automatically fix GitHub issues, perform web tasks, and solve cybersecurity challenges, achieving state-of-the-art results in automated software repair and offensive cybersecurity.

qodo-ai/qodo-cover

Qodo-Cover is an AI-powered tool that automates the generation of unit tests to enhance code coverage, supporting integration with GitHub CI workflows and local CLI usage.

judge0/judge0

Judge0 is a robust, scalable, and open-source online code execution system that supports over 60 programming languages and is designed for easy integration into various applications.

BuilderIO/micro-agent

BuilderIO/micro-agent is an AI-powered tool that writes and iteratively refines code by generating tests and ensuring all test cases pass, focusing on reliable test-driven development.

mattzcarey/shippie

Shippie is an AI-powered extensible code review agent that integrates into CI/CD pipelines to automatically detect code issues and improve software delivery speed.

OpenAutoCoder/Agentless

Agentless is an open-source project that automatically solves software development problems through a three-phase process of fault localization, repair, and patch validation, achieving competitive results on SWE-bench benchmarks.

the-open-engine/zeroshot

Command-line orchestrator that drives coding agent CLIs through an executor-verifier loop, so the agent that wrote a change is never the one that declares it correct.