bytedance/UI-TARS-desktop
UI-TARS Desktop is a GUI Agent application that uses a Vision-Language Model to enable natural language control of computers across multiple platforms with real-time visual recognition and automation capabilities.
Awesome AI Agents › Desktop Automation
mediar-ai/terminator
Terminator is an advanced AI-native GUI automation tool designed to automate desktop applications across multiple operating systems including Windows, MacOS, and Linux. It functions similarly to a browser automation framework but is specialized for desktop environments. The project leverages OS-level accessibility features rather than relying on visual recognition, which enhances its speed and reliability. It supports multiple programming languages such as TypeScript, Python, and Rust, making it versatile for developers with different language preferences. The core functionality of Terminator revolves around enabling fast and reliable automation of desktop apps by interacting with their graphical user interfaces. It is optimized for AI agents rather than human users, which means it is designed to be integrated into automated workflows and intelligent systems. The tool boasts impressive performance metrics, including UI scans that take approximately 80 milliseconds and a significant speedup of up to 10,000 times through compiled workflows. Terminator provides a Playwright-style SDK that simplifies the process of automating Windows GUI applications, with partial support for Linux and macOS. The SDK allows developers to open applications, locate UI elements by accessibility names, and perform actions such as clicking buttons or typing text programmatically. This makes it suitable for a wide range of automation tasks, from simple repetitive actions to complex workflows. The project is open to contributions and encourages community involvement through GitHub and Discord. It also offers extensive documentation and example repositories to help users get started quickly. Businesses interested in scaling desktop automation can engage with the developers for tailored solutions. Overall, Terminator stands out as a powerful, fast, and reliable tool for desktop automation with a focus on AI integration and cross-platform support.
https://github.com/mediar-ai/terminator
Also in Desktop Automation
asweigart/pyautogui
PyAutoGUI is a cross-platform Python module that enables programmatic control of the mouse and keyboard for GUI automation, including features like screen capture and image recognition.
bytebot-ai/bytebot
Bytebot is a containerized Linux desktop environment that enables programmatic control and remote access for automation, scraping, CI tasks, and remote work through a unified REST API and VNC interfaces.
OthersideAI/self-operating-computer
The Self-Operating Computer Framework enables multimodal AI models to autonomously operate a computer by interpreting screen visuals and executing mouse and keyboard actions to achieve user-defined objectives.
wonderwhy-er/DesktopCommanderMCP
Desktop Commander MCP is a server that integrates with the Claude desktop app to provide terminal control, file system search, and diff-based file editing capabilities, enabling advanced AI-assisted desktop management.
jacklandrin/OnlySwitch
OnlySwitch is a customizable all-in-one macOS menu bar app that consolidates system toggles, shortcuts, and AI-powered controls to enhance user productivity and convenience.
iflytek/astron-rpa
AstronRPA is an enterprise-grade open-source Robotic Process Automation desktop application that enables low-code/no-code workflow automation for desktop and web applications with strong enterprise security, collaboration, and AI agent integration.
yuruotong1/autoMate
autoMate is an AI-driven local automation assistant that uses natural language commands to enable users to automate complex computer tasks without programming, supporting local deployment and full interface control for enhanced privacy and flexibility.