Veil

A web scraper that uses the lightest method that works

Open Source Developer Tools GitHubローンチ 2026年6月23日

Veil とは？

Veil is an open-source Python web scraper that tries the cheapest method first and only escalates when a site blocks it so you're not running a full browser for every page. • 3 tiers: plain HTTP → TLS impersonation → stealth browser • Resumable concurrent crawler (checkpoint, JSONL, dedupe) • Proxy rotation, rate limiting, robots.txt by default • Honest README: documents what it can't beat Python, MIT, tested. A learning project built in the open.

スクリーンショット

まだコメントはありません。最初のひとりになりましょう！