Web Scraper (r.jina.ai)
Bypass Cloudflare and scrape any website using r.jina.ai API. Works on sites with strong protection like Truth Social, Cloudflare Turnstile, etc.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/itonlyforfun-ai/web-scraper-jinaWeb Scraper using r.jina.ai
Bypass Cloudflare and scrape any website using free r.jina.ai API.
Features
- Bypass Cloudflare, Turnstile, and other protections
- Works on Truth Social, Bitget, and other protected sites
- Returns clean Markdown content
- Free to use
Usage
Simply prepend https://r.jina.ai/ to any URL:
https://r.jina.ai/https://truthsocial.com/@realDonaldTrump
https://r.jina.ai/https://bitget.com/events/poolx
Examples
Get Trump Truth Social posts:
curl -s "https://r.jina.ai/https://truthsocial.com/@realDonaldTrump"
Get any protected page:
curl -s "https://r.jina.ai/https://example.com"
In Code
import requests
def scrape(url):
return requests.get(f"https://r.jina.ai/{url}").text
Use Cases
- Scrape Truth Social, Gab, Gettr
- Bypass Cloudflare protected sites
- Extract content from news articles
- Monitor competitors
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-itonlyforfun-ai-web-scraper-jina": {
"enabled": true,
"auto_update": true
}
}
}Tags
Related Skills
x-reader
Read X (Twitter) posts without official API. Supports both Nitter (free) and RapidAPI (detailed) methods.
agent-analytics
Web analytics platform that AI agents can query via CLI. Track page views, custom events, run A/B experiments, analyze funnels, retention cohorts, and traffic heatmaps. Use when the user needs web analytics, visitor tracking, event tracking, conversion optimization, growth insights, A/B testing, or wants to add analytics to their website or app. Also available as an MCP server at mcp.agentanalytics.sh.
Bitget PoolX Monitor
Monitor Bitget PoolX for new staking projects using r.jina.ai to bypass Cloudflare. Detect ETH, BTC, SOL and other pool launches.
webclaw
Web dashboard for OpenClaw. Browser-based UI for any installed skill. Schema-driven rendering, JWT auth, RBAC, AI chat, real-time updates. Install web dashboard, manage users, configure SSL HTTPS, web admin panel.
google-search
Google web search via Gemini Search Grounding (primary) and Custom Search JSON API (fallback). Use for: (1) Synthesized answers with citations (grounded search), (2) Raw link results with snippets, (3) Image search. Excellent Hebrew support. Preferred over built-in web_search (Perplexity).