FIRERPA Android ｜ AI-Powered Automation

An all-in-one Android automation framework that combines on-device services, AI-ready agents, and extensible tool invocation.

Documentation | 使用文档 | TELEGRAM | QQ Group | SKILLS | llms-full.txt | 中文版本

FIRERPA is an all-in-one Android device control platform. The server runs directly on the device with no extra runtime dependencies; it supports multiple generations of Android and works with or without root. On the PC side, the Python client library orchestrates UI automation, remote operations, traffic capture, Hook-based reverse engineering, network proxying, distributed networking, AI agents, and MCP through a single service and API. Compared with stitching together Appium, mitmproxy, frida-server, adb, uiautomator2, and ad-hoc scripts and ops tools, FIRERPA offers one source of capabilities, unified configuration, connected workflows, and a stack built for multi-device, long-running, production use.

Remote Desktop & Live Streaming

FIRERPA provides a browser-based remote desktop: view and control the device in real time without installing a dedicated PC client, over LAN or across networks. Streaming supports both MJPEG and H.264, with software and hardware encoding backends. Frame rate (up to 60fps), resolution scale, bitrate, and quality can be tuned to device capability and network conditions—reducing bandwidth and improving smoothness on weak links. WebRTC is also supported, with configurable STUN/TURN servers for better NAT traversal and lower end-to-end latency in public or cross-region setups.

The remote desktop supports multi-user concurrent access for collaborative debugging, demos, and training. Bidirectional clipboard sharing and live audio (Android 10+) are included, along with an integrated terminal, drag-and-drop uploads, and browser-based file browsing and downloads—all over a single port. Built-in visual layout inspection highlights elements, supports Tab traversal, shows coordinates and RGB values, and exports the XML layout tree so you can validate selectors and automation logic in the same UI, shortening the loop from screen to script.

Remote desktop and RPC support end-to-end TLS and service-certificate access control, with optional custom WebUI login passwords to reduce exposure on public networks. Remote desktop capabilities can also be embedded into your own web apps over WebSocket (live video, touch, terminal, keys, etc.), with allow_origin for cross-origin integration—suitable for productizing real-device control.

UI Automation

FIRERPA provides a full selector-based automation system: text, resourceId, description, scrollable, and other common matchers, plus child / sibling chaining for duplicate elements, deep hierarchies, or controls without distinctive attributes. At the element level: screenshots, wait for appear/disappear, corner/center coordinates, exists checks, Unicode input, stepped swipes, fling scrolling, scroll-to-end, and more. It can coexist with other accessibility services on Android 8.0+ and improves WebView node discovery for hybrid apps.

The UI Watcher listens for UI changes in real time and runs clicks, key events, or counters when conditions match—useful for auto-dismissing agreements, update prompts, ads, and other interruptions. Multiple selector conditions and per-event enable/disable are supported; transient screens can be counted.