clawtv

What This Skill Does

ClawTV is an advanced, AI-powered automation interface for the Apple TV ecosystem. By integrating computer vision with remote control protocols, it allows your AI agent to 'see' the Apple TV interface and interact with it as a human would. Unlike basic scripts that require static button mapping, ClawTV uses Anthropic's Claude to interpret the visual state of the TV screen, enabling it to navigate complex UI menus, handle search bars across disparate streaming apps, and manage settings autonomously.

Installation

To integrate ClawTV into your environment, use the OpenClaw command-line interface. Ensure you have your environment paths set correctly for Python. Run the following command in your terminal:

clawhub install openclaw/skills/skills/akivasolutions/clawtv

After installation, remember to configure your credentials. Set your ANTHROPIC_API_KEY for AI navigation capabilities and, optionally, populate ~/.clawtv/config.json with your Plex server details to enable rapid, direct-call playback without the overhead of vision-based processing.

Use Cases

ClawTV shines when you need hands-free media management. Use it for:

• Unified Search: Searching for content across different streaming platforms (Netflix, YouTube, Plex) without needing to manually toggle between apps.
• Complex Navigation: Reaching deep system settings (e.g., turning on subtitles, changing audio output) that typically require extensive remote clicking.
• Automation Workflows: Incorporating TV control into your home automation routines, such as a 'Movie Night' scene that dims the lights, opens Plex, and resumes your last watched show.
• Visual Feedback: Querying the status of the TV, such as asking if the device is currently on or what media is currently displayed.

Example Prompts

1. "Open Netflix and search for the latest season of Black Mirror."
2. "I'm tired, go to the settings menu and turn on dark mode for the Apple TV."
3. "Open Plex and play the next episode of my current show."

Tips & Limitations

• Latency: Because the 'do' command relies on vision analysis, there may be a slight delay while the screenshot is processed by the API. For time-critical actions, prefer using direct commands like plex play or cmd.
• Privacy: Note that ClawTV saves screenshots to ~/.clawtv/screenshots/. Periodically clear this folder to maintain storage and privacy.
• Environment: Ensure your Apple TV is on the same network and accessible via your computer's screen-sharing or remote management tools for best results.