red-crawler-ops

Use this skill when you need to operate the installed red-crawler CLI from an OpenClaw workflow. It is the portable wrapper for the crawler runtime, not a separate crawler implementation.

When To Use

Use red-crawler-ops for:

• preparing a local working directory for red-crawler
• saving a login session into Playwright storage state
• crawling a seed Xiaohongshu profile
• running nightly collection against a workspace database
• exporting a weekly report
• listing contactable creators from the SQLite database

red-crawler CLI Commands

All crawling tasks must use the native red-crawler CLI commands:

1. crawl-seed

Crawl a specific Xiaohongshu user profile and extract contact information.

red-crawler crawl-seed \
  --seed-url "https://www.xiaohongshu.com/user/profile/USER_ID" \
  --storage-state "./state.json" \
  --max-accounts 5 \
  --max-depth 2 \
  --db-path "./data/red_crawler.db" \
  --output-dir "./output"

Parameters:

• --seed-url (required): Target user profile URL
• --storage-state (required): Path to Playwright storage state file
• --max-accounts: Maximum accounts to crawl (default: 20)
• --max-depth: Crawl depth for related accounts (default: 2)
• --include-note-recommendations: Include note recommendations
• --safe-mode: Enable safe mode
• --cache-dir: Cache directory path
• --cache-ttl-days: Cache TTL in days (default: 7)
• --db-path: SQLite database path (default: ./data/red_crawler.db)
• --output-dir: Output directory (default: ./output)

Outputs:

• accounts.csv: Crawled account information
• contact_leads.csv: Extracted contact information (emails, etc.)
• run_report.json: Execution report

2. login

Interactive login to save browser session.

red-crawler login --save-state "./state.json"

Parameters:

• --save-state (required): Path to save storage state
• --login-url: Login page URL (default: https://www.xiaohongshu.com)

3. login-qr-start / login-qr-finish

QR code-based login for headless environments.

# Start QR login (generates QR code)
red-crawler login-qr-start \
  --save-state "./state.json" \
  --qr-path "./login-qr.png" \
  --session-path "./login-session.json" \
  --timeout 180

# Finish QR login after user scans
red-crawler login-qr-finish \
  --save-state "./state.json" \
  --session-path "./login-session.json"

4. collect-nightly

Run scheduled nightly data collection.

red-crawler collect-nightly \
  --storage-state "./state.json" \
  --db-path "./data/red_crawler.db" \
  --report-dir "./reports" \
  --crawl-budget 30 \
  --search-term-limit 4

Parameters: