1,395 skills found · Page 1 of 47
apify / CrawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
getmaxun / Maxun🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
apify / Crawlee PythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
MontFerret / FerretDeclarative web scraping
Anorov / Cloudflare ScrapeA Python module to bypass Cloudflare's anti-bot page.
gosom / Google Maps Scraperscrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
TheBlewish / Automated AI Web Researcher OllamaA python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various relevant websites and do research for you all on its own! And more, not limited to but including saving the findings for you!
oxylabs / Oxylabs AI Studio PyStructured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
PaulMcInnis / JobFunnelScrape job websites into a single spreadsheet with no duplicates.
JonasCz / How To Prevent ScrapingThe ultimate guide on preventing Website Scraping
jamesturk / Scrapeghost👻 Experimental library for scraping websites using OpenAI's GPT API.
lorey / Mlscraper🤖 Scrape data from HTML websites automatically by just providing examples
gildas-lormeau / Single File CliCLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
elixir-crawly / CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Netflix-Skunkworks / SketchyA task based API for taking screenshots and scraping text from websites.
skrapeit / Skrape.itA Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
0xjas0 / Edu Mail GeneratorGenerate Free Edu Mail(s) within minutes
josephlimtech / Linkedin Profile Scraper Api🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
slotix / DataflowkitExtract structured data from web sites. Web sites scraping.
Python-World / Python And The WebBuild Bots, Scrape a website or use an API to solve a problem.
