10 skills found
gosom / Google Maps Scraperscrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
MorvanZhou / Easy Scraping TutorialSimple but useful Python web scraping tutorial code.
get-set-fetch / ScraperNodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
aaldaber / Distributed Multi User Scrapy System With A Web UIDjango based application that allows creating, deploying and running Scrapy spiders in a distributed manner
nemo / ScrapeDistributed Scraper
queue-xec / MasterPeer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper
vonj / ScrapingReal life example of news site scraper. Download articles matching key words, generate full content reports in PDF, Excel and SPSS. SPSS generation might only work on Mac or Windows, pushed here to github “as is”. This whole program is just a hack, take it for what it is, something hastily thrown together to. Enough of excuses - I present you the license: The MIT License (MIT) Copyright (c) 2015 vonj Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
d502e19 / Scraperdistributed web scraper
ubugnu / DGMSA Distributed Google maps scraper written in bash
big-datai / ScraperDistributed web scraper, kafka, spark, and html unit
