xfetch

What This Skill Does

The xfetch skill is a powerful, headless command-line interface tool designed for efficient scraping and data retrieval from the X/Twitter platform. By leveraging cookie-based authentication, it bypasses the traditional limitations of API keys, allowing users to access a wide range of public and account-bound data. This skill enables agents to pull user profiles, follower lists, chronological or algorithmic timelines, search results, and complete conversation threads. With its built-in pagination support, JSON/CSV output formatting, and automatic query ID management, xfetch is an essential tool for social media data harvesting, sentiment analysis, and community auditing within the OpenClaw environment.

Installation

To integrate this skill into your OpenClaw agent, use the following command:

clawhub install openclaw/skills/skills/lxgicstudios/xfetch

Once installed, ensure you have your X.com session cookies (auth_token and ct0) handy. You can initialize authentication by running:

xfetch auth set --auth-token <token> --ct0 <token>

Verify your credentials by executing xfetch auth check to ensure your session is active.

Use Cases

1. Research & Audience Insight: Analyze a user's follower base or their following patterns to understand audience composition.
2. Market Intelligence: Search for industry-specific hashtags or keywords in real-time to track emerging trends or competitor sentiment.
3. Content Aggregation: Fetch full threads or historical tweets for archiving, model training, or summarizing conversations.
4. Personal CRM: Sync your home timeline, bookmarks, or likes to keep track of important discussions across your personalized X feed.

Example Prompts

1. "xfetch, please fetch the last 50 tweets from @OpenClawAI and save them in JSONL format for me to analyze."
2. "Search for the latest tweets containing 'AI agents' and save the top 20 results into a file called ai_trends.json."
3. "Could you retrieve the full conversation thread for this URL: https://x.com/user/status/123456789 and display it in plain text?"

Tips & Limitations

• Rate Limiting: Twitter enforces strict rate limits. When performing high-volume tasks, use the --delay flag to introduce pauses between requests to avoid account bans.
• Authentication: Keep your cookies secure. These grant full access to your account session. Do not share your auth_token or ct0 with others.
• Dynamic Queries: Twitter updates its internal GraphQL schema regularly. If you encounter errors, run xfetch query-ids --refresh to fetch the latest query IDs.
• Pagination: When scraping large datasets (like long follower lists), always specify a limit with -n or use --all with caution, ensuring your network connection is stable during the operation.