mac-control
Control Mac via mouse/keyboard automation using cliclick and AppleScript. Use for clicking UI elements, taking screenshots, getting window bounds, handling coordinate scaling on Retina displays, and automating UI interactions like clicking Chrome extension icons, dismissing dialogs, or toolbar buttons.
Why use this skill?
Automate macOS desktop interactions with the OpenClaw mac-control skill. Use precise mouse clicking, keyboard input, and screen analysis to manage apps.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/easonc13/mac-controlWhat This Skill Does
The mac-control skill provides OpenClaw with the ability to physically interact with your macOS desktop environment by simulating human mouse and keyboard inputs. By leveraging high-precision automation tools like 'cliclick' and 'osascript', the agent can see, move, click, and type within any graphical interface, even those that do not provide native APIs or accessibility hooks. This allows the AI to interact with closed-source applications, browser extensions, system dialogs, and native menu bars effectively.
Installation
To integrate this skill into your environment, use the OpenClaw command-line interface:
clawhub install openclaw/skills/skills/easonc13/mac-control
Once installed, ensure that your user account has the necessary 'Accessibility' and 'Screen Recording' permissions granted in macOS System Settings for the terminal or shell executing the agent, as these are required to allow the agent to move the cursor and capture the screen.
Use Cases
- Browser Automation: Interacting with specific Chrome extension icons that are not reachable via standard web automation libraries.
- Desktop App Management: Navigating legacy software that lacks a command-line interface or JSON-based configuration.
- Workflow Automation: Automating repetitive GUI tasks such as dismissing recurring OS dialogs, clicking 'Save' buttons in non-scriptable apps, or filling out desktop forms.
- Visual Testing: Using screenshot analysis to verify that buttons or UI elements have appeared on screen after a specific set of actions.
Example Prompts
- "Open the browser, click on the extension icon in the top right corner, and click the 'Start Recording' button inside the dropdown."
- "Take a screenshot, identify the 'Submit' button in the application window, and click it."
- "Dismiss the system update prompt by pressing the Escape key and then click on the 'Remind Me Later' button if it appears."
Tips & Limitations
- Coordinate Calibration: The skill is calibrated for a 1920x1080 display with 1:1 scaling. If you move your agent to a Retina display, remember to divide your screen coordinates by two, or run the provided
calibrate-cursor.shscript to ensure accuracy. - Visual Verification: Always use the 'Screenshot -> Analyze -> Click -> Verify' workflow. Since the AI cannot 'feel' the UI, taking a post-action screenshot is the only way to confirm success.
- System Permissions: If actions aren't working, verify that your terminal application is enabled in 'System Settings -> Privacy & Security -> Accessibility'.
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-easonc13-mac-control": {
"enabled": true,
"auto_update": true
}
}
}Tags(AI)
Flags: file-write, file-read, code-execution
Related Skills
sui-move
Sui blockchain and Move smart contract development. Use when the user asks about Sui, Move language, smart contracts, objects, transactions, or blockchain development on Sui.
sui-knowledge
Answer questions about Sui blockchain ecosystem, concepts, tokenomics, validators, staking, and general knowledge. Use when users ask "what is Sui", "how does Sui work", "Sui vs other chains", or any Sui-related questions that aren't specifically about Move programming.
abstract-searcher
Add abstracts to .bib file entries by searching academic databases (arXiv, Semantic Scholar, CrossRef) with browser fallback.
sui-coverage
Analyze Sui Move test coverage, identify untested code, write missing tests, and perform security audits. Includes Python tools for parsing coverage output and generating reports.
m3u8-downloader
Download encrypted m3u8/HLS videos using parallel downloads. Use when given an m3u8 URL to download a video, especially encrypted HLS streams with AES-128.