Todas las etiquetas
Etiqueta del catálogo

#web-scraping

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

158 registros
Con la etiqueta «web-scraping»Ordenado por índice de salud
PyPI
57Moderadoíndice de salud
mherrmann/helium
Lighter web automation with Python
Python · HTML★ 8320↓ 19.5K/mes15 sept 2026
MIT15 sept 2026 · métricas 2.10.0
Go
56Moderadoíndice de salud
0xMassi/webclaw-go
Official Go SDK for the Webclaw web extraction API
Go★ 113 sept 2026
MIT13 sept 2026 · métricas 2.10.0
Go · npm
56Moderadoíndice de salud
arinbalyan/scrappy
Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.
Go★ 619 sept 2026
Licencia propia19 sept 2026 · métricas 2.10.0
PyPI · npm
56Moderadoíndice de salud
dondai44423/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 91↓ 3148/mes14 sept 2026
MIT14 sept 2026 · métricas 2.10.0
Go
56Moderadoíndice de salud
dotcommander/defuddle
Go library and CLI for extracting web page content — articles, metadata, and clean text from any URL
Go★ 410 sept 2026
MIT10 sept 2026 · métricas 2.10.0
Go
56Moderadoíndice de salud
naiba/proxy-in-a-box
Automatic proxy pool for web scraping - crawls, validates, and rotates proxies with rate limiting and MITM support
Go★ 4219 oct 2026
MIT19 oct 2026 · métricas 2.10.0
PyPI
56Moderadoíndice de salud
serpapi/google-search-results-python
Google Search Results via SERP API pip Python Package
Python★ 755↓ 1.6M/mes12 sept 2026
MIT12 sept 2026 · métricas 2.10.0
Go
54Moderadoíndice de salud
SohrabZ/x-browser-mcp
Read and post to X from your own logged-in browser session, exposed to local AI agents over MCP. No X API keys required.
Go★ 219 oct 2026
MIT19 oct 2026 · métricas 2.10.0
Go · npm
54Moderadoíndice de salud
pithecene/quarry
Web extraction runtime for browser-driven crawling and durable ingestion
Go · TypeScript★ 023 ago 2026
Apache-2.023 ago 2026 · métricas 2.10.0
npm
54Moderadoíndice de salud
zeative/zpi-sdk
Universal zero-dependency TypeScript SDK for the Zapi (Zest API) scraper platform
TypeScript★ 10↓ 31.1K/mes18 sept 2026
MIT18 sept 2026 · métricas 2.10.0
Go
53Moderadoíndice de salud
monbooru/monloader
Online media downloader for monbooru
Go★ 810 sept 2026
AGPL-3.010 sept 2026 · métricas 2.10.0
Go
53Moderadoíndice de salud
tamnd/hf-cli
Read huggingface.co as data: every model, dataset, space, user, org, collection and paper as a typed record with an hf:// URI and a knowledge graph of the edges between them
Go★ 122 oct 2026
Apache-2.022 oct 2026 · métricas 2.10.0
Go · PyPI
51Moderadoíndice de salud
JoakimCarlsson/bonk
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
Go★ 1520 oct 2026
MIT20 oct 2026 · métricas 2.10.0
Go
50Moderadoíndice de salud
jhartum/redditrs
Go CLI for Reddit search & research: threads, subreddits, trends via web-session cookie — no API keys, no quota. Agent-friendly output.
Go · Shell★ 012 oct 2026
MIT12 oct 2026 · métricas 2.10.0
Go
50Moderadoíndice de salud
mjc-gh/virgo
Convert a webpage into plaintext or markdown using the Chrome DevTool Protocol
Go · JavaScript★ 110 sept 2026
BSD-3-Clause10 sept 2026 · métricas 2.10.0
PyPI
50Moderadoíndice de salud
ouli-1242/dhole-mcp
让 AI 代理访问互联网:抓取 · 爬取 · 搜索,内置反爬,$0 无密钥。Web research for AI agents: fetch, crawl & keyless search with anti-bot bypass.
Python · HTML★ 2↓ 3454/mes20 oct 2026
Licencia propia20 oct 2026 · métricas 2.10.0
Go
50Moderadoíndice de salud
tamnd/martinfowler-cli
Fetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal
Go · Python★ 012 sept 2026
Apache-2.012 sept 2026 · métricas 2.10.0
npm
48Débilíndice de salud
Hyper-Solutions/hyper-sdk-js
JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.
TypeScript★ 53↓ 32.2K/mes12 sept 2026
MIT12 sept 2026 · métricas 2.10.0
NuGet
48Débilíndice de salud
darrylwhitmore/NScrape
A web scraping framework for .NET
C#★ 659 sept 2026
MIT9 sept 2026 · métricas 2.10.0
PyPI
48Débilíndice de salud
sarperavci/UAForge
Generate statistically accurate User Agents and Client Hints (Sec-CH-UA). Deterministic, data-driven browser identities based on real-world market share distributions.
Python★ 8↓ 628/mes15 sept 2026
Sin licencia15 sept 2026 · métricas 2.10.0
npm
48Débilíndice de salud
webscraping-ai/webscraping-ai-mcp-server
A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities.
JavaScript★ 45↓ 340/mes12 sept 2026
Sin licencia12 sept 2026 · métricas 2.10.0
npm
47Débilíndice de salud
yansircc/pipee
Pipee — Web UI for Pi and its official extensions
TypeScript★ 2↓ 430/mes15 sept 2026
Sin licencia15 sept 2026 · métricas 2.10.0
Packagist
44Débilíndice de salud
firecrawl/firecrawl-php
El repositorio no publica descripción.
PHP★ 2↓ 15.1K/mes19 oct 2026
Sin licencia19 oct 2026 · métricas 2.10.0
Go
44Débilíndice de salud
khanglvm/online
Online web discovery CLI for AI agents
Go★ 09 sept 2026
MIT9 sept 2026 · métricas 2.10.0
npm
42Débilíndice de salud
vaaya-ai/vaaya-mcp
MCP server for AI agent payments: pay-per-call APIs (search, scraping, data, compute, media, research) with no vendor keys and a spend ceiling on every call. Works in Cursor, Claude Code, Claude Desktop, and Codex.
JavaScript · Shell · Dockerfile★ 4311 sept 2026
MIT11 sept 2026 · métricas 2.10.0
Go
36Débilíndice de salud
North-web-dev/impersonate-http
Go http.Client with a byte-exact browser TLS fingerprint (uTLS) — survive JA3/JA4 blocking without a headless browser.
Go★ 428 sept 2026
MIT28 sept 2026 · métricas 2.10.0
PyPI
34En riesgoíndice de salud
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Python★ 64.4K↓ 4.6M/mes17 sept 2026
BSD-3-Clause17 sept 2026 · métricas 2.10.0
Go
30En riesgoíndice de salud
CrimsonKarma44/rss_detector
Go package that discovers RSS, Atom, and JSON Feed subscription links for any website URL
Go★ 122 sept 2026
Sin licencia22 sept 2026 · métricas 2.10.0
Go
29En riesgoíndice de salud
jim-ww/shiraberu
Multi-engine search aggregator for the terminal — no API keys, no server. CLI + Go library.
Go★ 115 sept 2026
AGPL-3.015 sept 2026 · métricas 2.10.0
PyPI · npm
29En riesgoíndice de salud
omkarcloud/botasaurus-driver
Super Fast, Super Anti-Detect, and Super Intuitive Web Driver
Python★ 10214 sept 2026
MIT14 sept 2026 · métricas 2.10.0