ScrapFly Scrapers 🕷️

This repository contains educational example scrapers for popular web scraping targets using the ScrapFly web scraping API and Python.
Most Scrapers use a simple web scraping stack:

• Python version 3.10+
• Scrapfly's Python SDK for sending HTTP request, bypass blocking and parsing the HTML using the built-in parsel selector.
• asyncio for writing concurrent code using the async/await syntax.
• JMESPath and nested-lookup for JSON parsing when needed.
• loguru for logging.

To learn more about web scraping see our full tutorials on how to scrape these targets (and many others) see the scrapeguide directory.

List of Scrapers

Below is the list of available web scrapers for the supported domains along with their scrape guide, sample datasets, and status. 👇

<table> <tr> <td><strong>Domain</strong></td> <td><strong>Guide</strong></td> <td><strong>Sample Datasets</strong></td> <td><strong>Status</strong></td> </tr> <tr> <td><a href="/aliexpress-scraper/">Aliexpress.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-aliexpress/">How to Scrape Aliexpress.com (2025 Update)</a></td> <td> <ul> <li><a href="./aliexpress-scraper/results/product.json">Product pages</a></li> <li><a href="./aliexpress-scraper/results/search.json">Search pages</a></li> <li><a href="./aliexpress-scraper/results/reviews.json">Product reviews</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Aliexpress_scraper-success-brightgreen" alt="aliexpress-scraper-status"></td> </tr> <tr> <td><a href="/amazon-scraper/">Amazon.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-amazon/">How to Scrape Amazon.com Product Data and Reviews</a></td> <td> <ul> <li><a href="./amazon-scraper/results/product.json">Product pages</a></li> <li><a href="./amazon-scraper/results/search.json">Search pages</a></li> <li><a href="./amazon-scraper/results/reviews.json">Product reviews</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Amazon_scraper-success-brightgreen" alt="amazon-scraper-status"></td> </tr> <tr> <td><a href="/bestbuy-scraper/">BestBuy.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-bestbuy-product-offer-and-review-data/">How to Scrape BestBuy Product, Offer and Review Data</a></td> <td> <ul> <li><a href="./bestbuy-scraper/results/promos.json">Sitemap pages</a></li> <li><a href="./bestbuy-scraper/results/products.json">Product pages</a></li> <li><a href="./bestbuy-scraper/results/reviews.json">Review pages</a></li> <li><a href="./bestbuy-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/BestBuy_scraper-success-brightgreen" alt="bestbuy-scraper-status"></td> </tr> <tr> <td><a href="/bing-scraper/">Bing.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-bing-search-using-python/">How to Scrape Bing Search with Python</a></td> <td> <ul> <li><a href="./bing-scraper/results/serps.json">SERP data</a></li> <li><a href="./bing-scraper/results/keywords.json">Keyword data</a></li> <li><a href="./bing-scraper/results/rich_snippets.json">Rich snippet data</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Bing_scraper-success-brightgreen" alt="bing-scraper-status"></td> </tr> <tr> <td><a href="/booking-scraper/">Booking.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-bookingcom/">How to Scrape Booking.com (2025 Update)</a></td> <td> <ul> <li><a href="./bookingcom-scraper/results/hotel.json">Hotel pages</a></li> <li><a href="./bookingcom-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Booking_scraper-success-brightgreen" alt="booking-scraper-status"></td> </tr> <tr> <td><a href="/crunchbase-scraper/">Crunchbase.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-crunchbase/">How to Scrape Crunchbase in 2025</a></td> <td> <ul> <li><a href="./crunchbase-scraper/results/company.json">Company pages</a></li> <li><a href="./crunchbase-scraper/results/person.json">Investor pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Crunchbase_scraper-success-brightgreen" alt="crunchbase-scraper-status"></td> </tr> <tr> <td><a href="/domaincom-scraper/">Domain.com.au</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-domain-com-au-real-estate-property-data/">How to Scrape Domain.com.au Real Estate Property Data</a></td> <td> <ul> <li><a href="./domaincom-scraper/results/properties.json">Property pages</a></li> <li><a href="./domaincom-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Domain.com.au_scraper-success-brightgreen" alt="domaincom-scraper-status"></td> </tr> <tr> <td><a href="/ebay-scraper/">Ebay.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-ebay/">How to Scrape Ebay Using Python (2025 Update)</a></td> <td> <ul> <li><a href="./ebay-scraper/results/product.json">Product pages</a></li> <li><a href="./ebay-scraper/results/product-with-variants.json">Product pages with variant</a></li> <li><a href="./ebay-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Ebay_scraper-success-brightgreen" alt="ebay-scraper-status"></td> </tr> <tr> <td><a href="/etsy-scraper/">Etsy.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-etsy-com-product-review-data/">How to Scrape Etsy.com Product, Shop and Search Data</a></td> <td> <ul> <li><a href="./etsy-scraper/results/products.json">Product pages</a></li> <li><a href="./etsy-scraper/results/shops.json">Shop pages</a></li> <li><a href="./etsy-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Etsy_scraper-success-brightgreen" alt="etsy-scraper-status"></td> </tr> <tr> <td><a href="/fashionphile-scraper/">Fashionphile.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-fashionphile/">How to Scrape Fashionphile for Second Hand Fashion Data</a></td> <td> <ul> <li><a href="./fashionphile-scraper/results/products.json">Product pages</a></li> <li><a href="./fashionphile-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Fashionphile_scraper-success-brightgreen" alt="fashionphile-scraper-status"></td> </tr> <tr> <td><a href="/glassdoor-scraper/">Glassdoor.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-glassdoor/">How to Scrape Glassdoor (2025 update)</a></td> <td> <ul> <li><a href="./glassdoor-scraper/results/jobs.json">Job pages</a></li> <li><a href="./glassdoor-scraper/results/reviews.json">Review pages</a></li> <li><a href="./glassdoor-scraper/results/salaries.json">Salary pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Glassdoor_scraper-success-brightgreen" alt="glassdoor-scraper-status"></td> </tr> <tr> <td><a href="/goat-scraper/">Goat.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-goat-com-fashion-apparel/">How to Scrape Goat.com for Fashion Apparel Data in Python</a></td> <td> <ul> <li><a href="./goat-scraper/results/products.json">Product pages</a></li> <li><a href="./goat-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Goat_scraper-success-brightgreen" alt="goat-scraper-status"></td> </tr> <tr> <td><a href="/google-scraper/">Google.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-google/">How to Scrape Google Search Results</a> - <a href="https://scrapfly.io/blog/how-to-scrape-google-maps/">How to Scrape Google Maps</a></td> <td> <ul> <li><a href="./google-scraper/results/serp.json">SERP data</a></li> <li><a href="./google-scraper/results/keywords.json">Keyword data</a></li> <li><a href="./google-scraper/results/google_map_places_urls.json">Google Maps place URLs</a></li> <li><a href="./google-scraper/results/google_map_places.json">Google Maps place data</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Google_scraper-success-brightgreen" alt="goat-scraper-status"></td> </tr> <tr> <td><a href="/homegate-scraper/">Homegate.ch</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-homegate-ch-real-estate-property-data/">How to Scrape Homegate.ch Real Estate Property Data</a></td> <td> <ul> <li><a href="./homegate-scraper/results/properties.json">Property pages</a></li> <li><a href="./homegate-scraper/results/search.json">Search pages</a></li> </ul> </td> <td><img src="https://img.shields.io/badge/Homegate_scraper-success-brightgreen" alt="homegate-scraper-status"></td> </tr> <tr> <td><a href="/idealista-scraper/">Idealista.com</a></td> <td><a href="https://scrapfly.io/blog/how-to-scrape-idealista/">How to Scrape Idealista.com in Python - Real Estate Property Data</a></td> <td> <ul> <li><a href="./id