camoufox-stealth-browser

What This Skill Does

The Camoufox Stealth Browser skill leverages a custom, C++ compiled Firefox fork called Camoufox to achieve advanced anti-bot browser automation. Unlike JavaScript-based patching solutions (such as those used with Playwright or Selenium), Camoufox modifies the browser at a deeper level, embedding stealth patches directly into its compiled code. This approach effectively spoofs crucial browser fingerprints like WebGL and Canvas, making it significantly harder for anti-bot systems (including Cloudflare Turnstile and Datadome) to detect and block automated sessions. The skill is designed to be a superior alternative when standard browser automation tools fail, particularly for scraping data from heavily protected websites like Airbnb and Yelp. It also includes curl_cffi for API-only interactions, offering a dual-tool approach for comprehensive web scraping needs.

Installation

To install the Camoufox Stealth Browser skill, use the following command:

clawhub install openclaw/skills/skills/kesslerio/camoufox-stealth-browser

After installation, you'll need to set up the necessary tools within the pybox distrobox environment. Run the following command to install Camoufox and curl_cffi:

distrobox-enter pybox -- python3.14 -m pip install camoufox curl_cffi

Note: Camoufox, a Firefox fork, will be automatically downloaded on its first run, which may take some time and requires approximately 700MB of space. It is crucial to use python3.14 explicitly within the pybox environment, as it might have multiple Python versions installed.

Use Cases

This skill is ideal for scenarios where standard web scraping methods are blocked by advanced anti-bot measures. Key use cases include:

• Bypassing Cloudflare and Datadome Challenges: Successfully navigate websites protected by these common anti-bot services.
• Scraping Protected Websites: Access and extract data from sites like Airbnb, Yelp, and other platforms that employ sophisticated bot detection.
• When JavaScript Stealth Fails: Use Camoufox when puppeteer-stealth, undetected-chromedriver, or standard Playwright/Selenium scripts are detected and blocked.
• API Scraping: Utilize curl_cffi for faster scraping of API endpoints when browser rendering is not required.
• Maintaining System Cleanliness: Camoufox runs in an isolated distrobox container, ensuring your host system remains unaffected.

Example Prompts

1. "Can you scrape the product listings from this Amazon page using the stealth browser? [URL]"
2. "I need to get the user reviews from this Yelp page, but my current scraper is blocked. Can you use Camoufox to fetch it? [URL]"
3. "Fetch the HTML content of this Airbnb listing page using the headless stealth browser. [URL]"

Tips & Limitations

• Explicit Python Version: Always use python3.14 within the pybox environment for pip installations and script execution.
• Containerized Operation: All operations occur within the pybox distrobox. Ensure it's properly set up.
• Headless Mode: The --headless flag is available for background execution, but be aware that some anti-bot systems might have different detection mechanisms for headless browsers versus visibly automated ones.
• Resource Usage: Running a full browser, even in headless mode, consumes more resources than API-only scraping.
• Evolving Anti-Bot Tech: While Camoufox offers C++ level patching, anti-bot technologies are constantly evolving. It may not be effective against all future detection methods, though it represents a significant advancement over JS-based solutions.