web-search-scraper-api-skill
This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactively apply this skill when users express needs like extract complete markdown from a specific website, scrape the content of an article link, get the text from a target url, convert a webpage to markdown format, fetch the main content of a blog post, extract data from a given web page, parse the html of a website into markdown, download the readable text from a news article, obtain the content of a tutorial page, extract all the markdown text from any http or https url, scrape documentation from a web link, or grab the text of a single webpage.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/browseract-ai/web-search-scraper-api-skillWhat This Skill Does
The web-search-scraper-api-skill provides a robust and reliable interface for converting raw web pages into clean, structured Markdown. Powered by the BrowserAct Web Search Scraper API, this skill bypasses common hurdles associated with traditional web scraping, such as CAPTCHAs, IP geofencing, and complex DOM structures. By inputting a target URL, the OpenClaw agent triggers a headless browser process that parses the page content and extracts the main text, images, and links into a readable format. It serves as an essential bridge between chaotic web content and structured data suitable for documentation, research, or LLM context augmentation.
Installation
To integrate this skill into your OpenClaw environment, execute the following command in your terminal:
clawhub install openclaw/skills/skills/browseract-ai/web-search-scraper-api-skill
After installation, ensure you have your BROWSERACT_API_KEY configured in your environment variables. If you lack a key, register at the BrowserAct Console to obtain one.
Use Cases
This skill is highly effective for developers, researchers, and content creators. Typical use cases include extracting documentation from static sites to create local knowledge bases, scraping news articles for summarized analysis, pulling tutorial steps from technical blogs, and gathering competitor pricing or feature sets from product landing pages. It is particularly useful when you need to ingest website information into an AI context window without the noise of advertisements, sidebars, or footer scripts.
Example Prompts
- "Please scrape the content of this tutorial at https://example-docs.com/guide and convert it to markdown for my notes."
- "Can you go to https://news-site.com/article-123 and extract the main body text as a markdown file?"
- "I need to parse the data from this documentation page: https://api.browseract.com/docs, please grab the full text content."
Tips & Limitations
Execution speed is dependent on the complexity of the target webpage and network latency. Because the skill utilizes actual browser automation, it may take several minutes for heavy pages to render. Monitor the terminal timestamps to track progress; as long as status logs appear, the task is active. Do not interrupt the process prematurely unless the system reports a timeout or error. Finally, always verify your API key configuration, as the agent is designed to halt and request the key if it is missing from your environment.
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-browseract-ai-web-search-scraper-api-skill": {
"enabled": true,
"auto_update": true
}
}
}Tags(AI)
Flags: network-access, external-api, code-execution
Related Skills
browser-act
Browser automation CLI for AI agents with anti-detection stealth browsing, captcha solving, and parallel multi-browser support. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, scraping sites with bot detection, or automating any browser task. Also use when the user needs to connect to their existing Chrome session, configure proxy-based stealth browsing, or run parallel browser sessions. Triggers on requests to open a website, fill out a form, click a button, take a screenshot, scrape data from a page, login to a site, automate browser actions, handle captcha challenges, or any task requiring programmatic web interaction.
youtube-influencer-finder-api-skill
This skill helps users extract YouTube influencer profiles including social links, subscriber counts, and channel stats via the BrowserAct API. Agent should proactively apply this skill when users express needs like finding YouTube creators for specific keywords, discovering influencers for a marketing campaign, extracting YouTube channel contact emails, scraping YouTube influencer social media links, gathering subscriber counts for YouTube creators, researching top YouTube channels in a specific niche, compiling a list of YouTube content creators with recent uploads, collecting YouTube creator profiles for outreach, extracting total views and video counts for specific YouTube influencers, building a database of YouTube partners for market research, finding YouTube influencers who uploaded videos this month, or monitoring competitor influencer activities on YouTube.
amazon-buy-box-monitor-api-skill
This skill helps users extract basic product details other sellers prices and seller ratings from Amazon via ASIN automatically using the BrowserAct API. Agent should proactively apply this skill when users express needs like query Amazon buy box information, monitor Amazon product prices, extract Amazon product details by ASIN, check other sellers prices on Amazon, get Amazon seller ratings and feedback count, monitor buy box ownership for a specific ASIN, track Amazon fulfillment methods for competitors, compare Amazon product prices across different sellers, retrieve Amazon buy box availability status, analyze Amazon seller profile details.
reddit-competitor-analysis-api-skill
This skill helps users extract structured data from Reddit posts and comments via BrowserAct API. Agent should proactively apply this skill when users express needs like analyzing competitor mentions on Reddit, tracking brand sentiment in Reddit comments, extracting Reddit discussions for market research, finding popular Reddit posts by keywords, monitoring community feedback on specific topics, gathering user reviews from Reddit threads, searching for Reddit posts within a specific date range, sorting Reddit discussions by relevance or hotness, compiling nested Reddit comments for deep analysis, building a structured dataset of Reddit conversations, discovering trending topics in specific subreddits, or monitoring social media activity for specific brands on Reddit.
industry-key-contact-radar-api-skill
This skill helps users discover key contacts across industries, roles, and social platforms via the BrowserAct API. Agent should proactively apply this skill when users express needs like finding public profiles for founders or CEOs, discovering key decision-makers in a specific industry, extracting contact details for lead generation, searching for growth leaders on LinkedIn or Facebook, gathering professional networking profiles, retrieving URLs and names of industry leaders, finding marketing managers in a specific field, conducting competitive analysis by identifying key personnel, sourcing talent acquisition targets across platforms, or compiling a list of target roles on specific social sites.