veriglow-agent-map

What This Skill Does

The veriglow-agent-map skill acts as a comprehensive registry and diagnostic tool for AI agents attempting to navigate, extract, or interact with web-based data. Rather than relying on fragile, generic web scraping that breaks when site layouts change, this skill provides a structured 'map' of a website. These maps function as a technical blueprint, detailing how to bypass browser-based rendering by identifying internal hidden APIs, mapping out required request parameters, and providing exact response schemas. When direct API access is restricted or insufficient, the map provides granular browser automation recipes—including specific DOM selectors, JavaScript controller references, and authentication requirements—to ensure reliable data retrieval. Essentially, it transforms the unpredictable landscape of the web into a standardized, machine-readable format for your OpenClaw agents.

Installation

To install this skill, use the OpenClaw package manager: clawhub install openclaw/skills/skills/chizhongwang/veriglow-agent-map

Use Cases

• Structured Data Extraction: Automatically pull real-time financial, e-commerce, or government data using validated internal API endpoints instead of scraping HTML elements.
• Browser Automation: Execute complex workflows on web portals, such as authenticated form submissions or multi-step data exports, using proven automation recipes.
• Agent Reliability: Before writing a custom script, check the Agent Report section to understand historical success rates, common IP-blocking patterns, or rate-limiting thresholds encountered by other agents.
• Hidden API Discovery: Uncover and leverage backend data streams that are not exposed via the primary UI, significantly increasing speed and reliability.

Example Prompts

1. "Look up the VeriGlow map for https://www.sse.com.cn/market/bonddata/overview/day/ and retrieve the bond trading volume for 2025-02-11."
2. "I need to automate a login and data export on this site. Fetch the Page Internals from the Agent Map to see the required DOM selectors and JavaScript controllers."
3. "Is there a reliable API endpoint for extracting product listings from this e-commerce site, or should I rely on the browser automation recipe provided in the Agent Map?"

Tips & Limitations

• Always check Agent Reports: Before building a pipeline, review the reported edge cases. If an agent reports frequent IP blocks, implement proxy rotation in your agent flow.
• Prefer APIs over DOM: Whenever the 'Available Data' section lists a direct API endpoint, prioritize that over browser automation; it is consistently faster and less prone to breaking when the UI updates.
• Data Freshness: Note that some maps indicate data lag or specific refresh intervals. Always cross-reference the 'Caveats' section if you are dealing with time-sensitive financial data.
• Compatibility: This skill is designed for websites indexed within the VeriGlow registry. If a site is not currently indexed, the map may return limited information.