220 skills found · Page 1 of 8
apify / CrawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify / Crawlee PythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
oxylabs / Google AI Mode ScraperScrape Google AI Mode responses without blocks on a large scale.
oxylabs / Free Proxy ListClaim Free proxy list with United States IP addresses and use it for your projects.
claffin / CloudproxyHide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
Ge0rg3 / Requests Ip RotatorA Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
Altimis / ScweetScrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.
monosans / Proxy Scraper CheckerHTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.
prometheus-community / PushProxProxy to allow Prometheus to scrape through NAT etc.
iw4p / Proxy Scraperscrape proxies from more than 5 different sources and check which ones are still alive
sunny9577 / Proxy Scraper⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
rootVIII / Proxy Requestsa class that uses scraped proxies to make http GET/POST requests (Python requests)
oxylabs / Dedicated Isp ProxiesTechnical overview of dedicated proxies and dedicated ISP proxies, covering features, setup, and use cases for reliable web scraping and automation.
vwh / Telegram ViewsAsynchronous Telegram view automation with proxy rotation and auto-proxy scraping
essamamdani / Search Result Scraper MarkdownThis project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.
hamzarana07 / MultiProxiesProxies scraped from spys.me and free-proxies-list.net
ProxyScraper / ProxyScraperAutomatic and permanent proxy collection and update center for free (updated every hour)
0xSolanaceae / ProXXyA super simple asynchronous multithreaded proxy scraper; scraping & checking ~500k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.
Lemons1337 / Discord SpammerAdvanced Discord Spammer with multiple options and auto scraping proxies!
rookmoot / ProxifierA fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.
