finviz-crawler
Continuous financial news crawler for finviz.com with SQLite storage, article extraction, and query tool. Use when monitoring financial markets, building news digests, or needing a local financial news database. Runs as a background daemon or systemd service.
Install via CLI (Recommended)
clawhub install openclaw/skills/skills/camopel/finviz-crawlerWhat This Skill Does
The finviz-crawler is a robust, autonomous background service designed to build a persistent, local financial news archive. Unlike traditional API-based integrations that provide a snapshot of current data, this skill acts as a continuous collector, scraping headlines and full article content from finviz.com. It utilizes crawl4ai and feedparser to aggregate information from major financial news outlets like Bloomberg, Reuters, and CNBC. All collected metadata and full-text content are stored locally in a SQLite database, ensuring you retain access to your history even if source websites change or take content offline. It features an automated, configurable cleanup system to manage storage growth and supports background daemon execution via systemd or launchd.
Installation
To integrate this skill into your OpenClaw environment, execute the following command in your terminal:
clawhub install openclaw/skills/skills/camopel/finviz-crawler
Ensure you have Python 3 installed. The automated setup script (python3 scripts/install.py) will handle the configuration of browser dependencies and directory structure. For manual installation, confirm you have crawl4ai and feedparser installed and your Playwright Chromium drivers initialized.
Use Cases
- Automated Financial Digests: Use the query tool to generate daily summaries of market movement for specific tickers (e.g., AAPL, NVDA).
- Historical Trend Analysis: Build a searchable local database of financial news to perform sentiment analysis or track market sentiment shifts over time.
- Investment Research: Maintain a private repository of articles related to your portfolio, enabling offline reading and analysis without relying on premium subscriptions.
Example Prompts
- "Check the database for any news regarding NVDA from the last 12 hours and summarize the key sentiment."
- "List all tracked tickers and pull the full content for the top three latest headlines regarding Tesla."
- "Show me the last 24 hours of market news headlines so I can compile a quick briefing for the morning."
Tips & Limitations
- Storage Management: Always define an
--expiry-daysvalue that fits your disk capacity; setting it to 0 is only recommended if you have dedicated storage. - Performance: While designed to be lightweight, running the crawler too frequently (e.g., sub-60s intervals) may impact local system resources.
- Compliance: This tool is for personal information gathering. Ensure you respect the source websites' Terms of Service when scheduling your crawls.
Metadata
Not sure this is the right skill?
Describe what you want to build — we'll match you to the best skill from 16,000+ options.
Find the right skillPaste this into your clawhub.json to enable this plugin.
{
"plugins": {
"official-camopel-finviz-crawler": {
"enabled": true,
"auto_update": true
}
}
}Tags(AI)
Flags: network-access, file-write, file-read
Related Skills
ddgs-search
Free multi-engine web search via ddgs CLI (DuckDuckGo, Google, Bing, Brave, Yandex, Yahoo, Wikipedia) + arXiv API search. No API keys required. Use when user needs web search, research paper discovery, or when other skills need a search backend. Drop-in replacement for web-search-plus.
arxivkb
Local arXiv paper manager with semantic search. Crawls arXiv categories, downloads PDFs, chunks content, and indexes with FAISS + Ollama embeddings. No cloud API keys required — everything runs locally.
privateapp
Personal PWA dashboard server with plugin apps. Use when: (1) installing or setting up PrivateApp, (2) starting/stopping/restarting the service, (3) building frontends after changes, (4) adding new app plugins, (5) configuring push notifications. Requires Python 3.9+, Node.js 18+. Runs as systemd user service or launchd plist.
storage-cleanup
One-command disk cleanup for macOS and Linux — trash, caches, temp files, old kernels, snap revisions, Homebrew, Docker, and Xcode artifacts. Use when user asks to free storage, clean up disk, reclaim space, reduce disk usage, or encounters low disk / "disk full" warnings. Safe by default with dry-run mode. No dependencies beyond bash and awk.
claw-guard
System-level watchdog for OpenClaw gateway restarts and sub-agent task PIDs. Monitors registered PIDs and optional log/directory freshness. Auto-reverts config on failed gateway restarts. Requires explicit registration — does NOT auto-discover. Use when running long background tasks or before gateway restarts.