Awesome AI AgentsCode Automation and Testing

vostride/agent-qa

⭐ 907 TypeScript repository created 2026-05-07

agent-qa is an open-source QA harness in which tests are written in natural language and executed by an agent against web and mobile applications. Test files describe actions and assertions in human language, and the agent works from what is visible on screen, using roles, labels and screen state rather than brittle selectors. When a sub-action such as a click, a fill or a select fails, the harness re-observes the interface and tries a different path inside the same run, so a test can survive UI drift instead of failing at the first broken action. Every run produces observations at product, suite and test level that are stored as execution memory and added as context to later runs, and steps that had to be healed during execution are curated into that memory so future runs avoid the same mistake. An action cache reuses validated plans across similar subsequent runs to cut planner work, token usage and runtime. Tests, configuration, hooks, memory and suite logic all live as version-controlled files, so every change can be diffed, reviewed, reused and shared across teams. Hooks written in Node, Bun, Python or Bash run inside isolated Docker containers to set up environments, call APIs, seed fixtures, tear down state and pass structured output back into the active test run, which is why Docker is a prerequisite. The project ships both a dashboard and a CLI: npm install -D agent-qa, then npx agent-qa init, npx agent-qa install-browsers --chromium and, for mobile work, npx agent-qa install-mobile-drivers --all, with npx agent-qa dashboard --open starting the UI and npx agent-qa run pointing at a YAML test file. It also exposes MCP and skills for coding agents. Models are pluggable through OpenAI- and Anthropic-compatible endpoints, Gemini, local or open-source models, and Codex or Claude Code subscriptions via a separate auth package.

https://github.com/vostride/agent-qa

qa-automationtestingself-healingnatural-language-testsmcpmobile-testingtypescriptdocker

Also in Code Automation and Testing

alibaba/arthas

Arthas is an open-source Java diagnostic tool by Alibaba that enables real-time production troubleshooting and performance monitoring without code changes or JVM restarts.

SWE-agent/SWE-agent

SWE-agent is an autonomous software engineering tool that uses large language models to automatically fix GitHub issues, perform web tasks, and solve cybersecurity challenges, achieving state-of-the-art results in automated software repair and offensive cybersecurity.

qodo-ai/qodo-cover

Qodo-Cover is an AI-powered tool that automates the generation of unit tests to enhance code coverage, supporting integration with GitHub CI workflows and local CLI usage.

judge0/judge0

Judge0 is a robust, scalable, and open-source online code execution system that supports over 60 programming languages and is designed for easy integration into various applications.

BuilderIO/micro-agent

BuilderIO/micro-agent is an AI-powered tool that writes and iteratively refines code by generating tests and ensuring all test cases pass, focusing on reliable test-driven development.

mattzcarey/shippie

Shippie is an AI-powered extensible code review agent that integrates into CI/CD pipelines to automatically detect code issues and improve software delivery speed.

OpenAutoCoder/Agentless

Agentless is an open-source project that automatically solves software development problems through a three-phase process of fault localization, repair, and patch validation, achieving competitive results on SWE-bench benchmarks.

the-open-engine/zeroshot

Command-line orchestrator that drives coding agent CLIs through an executor-verifier loop, so the agent that wrote a change is never the one that declares it correct.