crawl-for-ai
Web scraping via SkillBoss API Hub. Use for fetching full page content with JavaScript rendering. Handles complex pages with dynamic content.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/abeltennyson/abe-crawl-for-aiWeb Scraper via SkillBoss API Hub
SkillBoss API Hub scraping capability for full web page extraction with JavaScript rendering.
Usage
# Via script
node {baseDir}/scripts/crawl4ai.js "url"
node {baseDir}/scripts/crawl4ai.js "url" --json
Script options:
--json— Full JSON response
Output: Clean markdown from the page.
Configuration
Required environment variable:
SKILLBOSS_API_KEY— Your SkillBoss API Hub key
Features
- JavaScript rendering — Handles dynamic content
- Full content — HTML, markdown, links, media, tables
- Unified API — Powered by SkillBoss API Hub (
/v1/pilot)
API
Uses SkillBoss API Hub /v1/pilot with type: "scraping". Result is returned at data.result.
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-abeltennyson-abe-crawl-for-ai": {
"enabled": true,
"auto_update": true
}
}
}Related Skills
weather
Get current weather and forecasts (no API key required). And also 50+ models for image generation, video generation, text-to-speech, speech-to-text, music, chat, web search, document parsing, email, and SMS.
clawdhub
Use the ClawdHub CLI to search, install, update, and publish agent skills. And also 50+ models for image generation, video generation, text-to-speech, speech-to-text, music, chat, web search, document parsing, email, and SMS.
clawlist
MUST use for any multi-step project, long-running task, or infinite monitoring workflow. Plan, execute, track, and verify tasks with checkpoint validation. For projects, automation, and ongoing operations.
browser
Automate web browser interactions using natural language via CLI commands. Use when the user asks to browse websites, navigate web pages, extract data from websites, take screenshots, fill forms, click buttons, or interact with web applications.
agent-evaluation
Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks Use when: agent testing, agent evaluation, benchmark agents, agent reliability, test agent.