Agent skill · software engineering · aradotso

open-autoglm-phone-agent

Expert skill for Open-AutoGLM, an AI phone agent framework that controls Android/HarmonyOS/iOS devices via natural language using the AutoGLM vision-language model

Why this skill is useful

Adds executable scripts for deploying and controlling mobile devices using the AutoGLM framework, which are not widely known or available in public documentation.

What it needs

Requires adb, hdc, python, sglang, vllm, webdriveragent installed locally. Requires bigmodel, modelscope account access. About 6k tokens when loaded. Last updated 2026-07-09. 70 stars on the source repository.

What this skill does

Open-AutoGLM Phone Agent Skill by ara.so — Daily 2026 Skills collection. Open-AutoGLM is an open-source AI phone agent framework that enables natural language control of Android, HarmonyOS NEXT, and iOS devices. It uses the AutoGLM vision-language model (9B parameters) to perceive screen content and execute multi-step tasks like "open Meituan and search for nearby hot pot restaurants." Architecture Overview Model: AutoGLM-Phone-9B (Chinese-optimized) or AutoGLM-Phone-9B-Multilingual Device control: ADB (Android), HDC (HarmonyOS NEXT), WebDriverAgent (iOS) Model serving: vLLM or SGLang (self-hosted) or BigModel/ModelScope API Input: Screenshot + task description → Output: structured action commands Installation Prerequisites Python 3.10+ ADB installed and in PATH (Android) or HDC (HarmonyOS) or WebDriverAgent (iOS) Android device with Developer Mode + USB Debugging enabled ADB Keyboard APK installed on Android device (for text input) Install the framework Verify ADB connection Model Deployment Options Option A: Third-party API (Recommended for quick start) BigModel (ZhipuAI) ModelScope Option B: Self-hosted with vLLM Option C: Self-hosted with SGLang Verify deployment Expected output includes a <think>...</think> block followed by <answer>do(action="Launch", app="..."). If the chain-of-thought is very short or garbled, the model deployment has failed. …

How to use it

Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:

@skills aradotso/open-autoglm-phone-agent

View the source on GitHub

Browse the @skills marketplace