firecrawl
Web scraping and crawling with Firecrawl API. Fetch webpage content as markdown, take screenshots, extract structured data, search the web, and crawl documentation sites. Use when the user needs to scrape a URL, get current web info, capture a screenshot, extract specific data from pages, or crawl docs for a framework/library.
Why use this skill?
Integrate Firecrawl with OpenClaw to scrape websites, extract structured data, capture screenshots, and crawl documentation for smarter AI assistance.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/andrewdmwalker/firecrawlerWhat This Skill Does
The Firecrawl web skill enables your OpenClaw agent to interact with the live internet by turning complex, JavaScript-rendered websites into clean, usable data. By leveraging the Firecrawl API, this skill allows the agent to scrape full webpages and convert them into clean markdown, capture high-quality screenshots for visual verification, extract specific structured data using custom JSON schemas, perform live web searches, and perform full-site crawls. It acts as the bridge between your agent and the vast repository of documentation and real-time information available on the web.
Installation
- Ensure you have obtained an API key from firecrawl.dev.
- Set your environment variable:
export FIRECRAWL_API_KEY=fc-your-key-here. - Install the required SDK via pip:
pip3 install firecrawl. - Install the skill into your OpenClaw environment using:
clawhub install openclaw/skills/skills/andrewdmwalker/firecrawler.
Use Cases
- Automated Research: Quickly scrape and summarize technical blogs, news articles, or research papers without manual navigation.
- Documentation Integration: Crawl entire documentation websites to help your agent gain context on specific frameworks or libraries, allowing it to provide more accurate coding assistance.
- Data Extraction: Use structured extraction to pull specific product information (like pricing or feature lists) from e-commerce websites into machine-readable JSON format.
- Visual Verification: Capture screenshots of web applications or dashboards for record-keeping or debugging purposes.
- Web Reconnaissance: Discover internal site structures and mapping via the
mapfunctionality to understand the footprint of a target domain.
Example Prompts
- "Can you scrape the documentation at https://docs.astro.build and use that information to help me build a new landing page?"
- "Please visit https://www.example-store.com/laptop and extract the model name, current price, and technical specifications into a structured format."
- "Search for the latest security updates regarding the Linux kernel and summarize the top three findings for me."
Tips & Limitations
Each request typically consumes 1 credit per page or action. Keep an eye on your usage limits to avoid unexpected costs. When scraping, use the --main-only flag to avoid cluttering your context window with navigation menus and footers. If you are crawling documentation, always start with a smaller limit (e.g., 50 pages) to ensure you are gathering relevant data before committing to larger crawls.
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-andrewdmwalker-firecrawler": {
"enabled": true,
"auto_update": true
}
}
}Tags(AI)
Flags: network-access, file-write, external-api
Related Skills
phantombuster
Control PhantomBuster automation agents via API. List agents, launch automations, get output/results, check status, and abort running agents. Use when the user needs to run LinkedIn scraping, Twitter automation, lead generation phantoms, or any PhantomBuster workflow.
weather-nws
Reliable US weather data using the National Weather Service API. Free, no API key, detailed forecasts and official alerts.
dnd
D&D 5e toolkit for players and DMs. Roll dice, look up spells and monsters, generate characters, create encounters, and spawn NPCs. Uses the official D&D 5e SRD API.
apollo
Apollo.io contact and company enrichment API. Enrich people with email, phone, title, company data. Enrich organizations with industry, revenue, employee count, funding. Search for prospects. Use when the user needs to enrich contacts, find emails, lookup company info, or search for leads.
solar-weather
Monitor solar weather conditions including geomagnetic storms, solar flares, aurora forecasts, and solar wind data. Uses NOAA Space Weather Prediction Center real-time data.