grok-scraper

What This Skill Does

The grok-scraper skill allows the OpenClaw AI agent to interact with Grok via X (Twitter) using browser automation. Unlike standard API-based integrations that require a paid X API key, this tool simulates a real user interaction using Playwright. It bypasses the need for costly API subscriptions by leveraging an authenticated local browser session, enabling the agent to perform real-time searches, query Grok, and extract information directly from the X interface.

Installation

To get started, ensure you have a local environment with GUI support, as the skill requires launching a browser to manage login credentials. First, navigate to the scripts directory, run npm install, and execute npx playwright install chromium to prepare the environment. Complete the setup by running npm run login to open the X login page; once you sign in, the browser session is cached in the session/ directory, allowing the agent to persist your authentication for future queries.

Use Cases

This skill is perfect for users who want to query Grok for real-time news, social media trends, or data analysis without the overhead of API billing. It is ideal for research tasks that require up-to-the-minute information available on X. Furthermore, it serves as a robust fallback for developers who need to integrate real-time search capabilities into their local agent workflow without managing complex API keys or rate-limiting tiers.

Example Prompts

1. "Check the latest updates on the OpenClaw repository trends and summarize them for me using Grok."
2. "What are people saying about the latest advancements in quantum computing right now? Use Grok to search."
3. "Search for the current price and market sentiment for Bitcoin on X and provide a markdown summary."

Tips & Limitations

Because this tool relies on browser automation, it is sensitive to updates on the X website. If the UI changes, DOM selectors might break, requiring a manual update of the selector logic. Always check the output/debug-dom.json file if a process fails. Additionally, this skill cannot operate in headless cloud environments—it strictly requires a local screen display to maintain the login session. Always verify your session status if you encounter exit code 2.