scrapping

What This Skill Does

The Scrapping skill provides a powerful interface for the ScrapeCreators API, enabling OpenClaw to retrieve public data from over 20 social media platforms. It serves as a direct pipeline to fetch profiles, post content, video transcripts, engagement metrics, and advertising intelligence. Designed for efficiency, this skill leverages a single-header authentication pattern to return structured, JSON-ready data from major networks including TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Reddit, and Twitch, among others. It is specifically optimized to avoid complex SDK dependencies, making it a lightweight solution for market research, creator analysis, and social media monitoring.

Installation

To integrate this skill into your environment, run the following command in your terminal: clawhub install openclaw/skills/skills/berthelol/scrapping Once installed, ensure you have your ScrapeCreators API key configured as an environment variable: export SCRAPECREATORS_API_KEY="your-key-here" to maintain security standards.

Use Cases

• Creator Intelligence: Retrieve engagement stats, follower counts, and trending content to identify influencers for brand collaborations.
• Market Research: Pull data from TikTok Shop or Meta Ad Library to analyze competitors' active ad creative strategies.
• Trend Analysis: Monitor specific hashtags or search queries across multiple platforms to stay ahead of viral content waves.
• Content Pipeline: Automate the collection of video transcripts or post summaries to feed into secondary analysis workflows.

Example Prompts

1. "Grab the latest engagement stats and recent post captions from TikTok creator @khaby.lame to analyze his recent reach."
2. "Search for the top trending posts under the hashtag #AIInnovation on Twitter and extract the creator info and view counts."
3. "Check the Meta Ad Library for recent ads from my competitor and pull the active creative summaries."

Tips & Limitations

• Credit Management: Be aware that complex endpoints like audience demographics consume more credits (e.g., 26 credits) than standard profile lookups. Always check the official documentation for specific cost per request.
• Data Privacy: This skill is strictly for public data collection. It does not provide access to private accounts, direct messages, or non-public user data.
• Performance: Use the trim=true parameter whenever possible to reduce API response sizes, which keeps the OpenClaw context window clean and lowers latency. Always use the cursor parameter for multi-page data extraction rather than attempting to fetch massive datasets in a single request.