25 skills found
scrapinghub / PortiaVisual scraping for Scrapy
firecrawl / Open Agent Builder🔥 Visual workflow builder for AI agents powered by Firecrawl - drag-and-drop web scraping pipelines with real-time execution
ScrapeGraphAI / Scrapecraft🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
sonnylazuardi / Reactriot2017 Dotamania🌐 Web scraping made easy with the visual 🗺 mind map editor to JSON
gurtejrehal / FALCON AI Data CrawlerFalcon Search has been created to aid the National Crime Records Bureau keeping in mind the need for an efficient AI data crawler that collects classified data from the web based on given keywords. It is a SaaS web data integration (WDI) platform which converts unstructured web data into structured format by extracting, preparing and integrating web data in areas of crime for consumption in criminal investigation agencies. Falcon provides a visual environment for automating the workflow of extracting and transforming web data. After specifying the target website url, the web data extraction module provides a visual environment for designing automated workflows for harvesting data, going beyond HTML/XML parsing of static content to automate end user interactions yielding data that would otherwise not be immediately visible. Once extracted, the software provides full data preparation capabilities that are used for harmonizing and cleansing the web data. For consuming the results, Falcon provides several options. It has its own visualization and dashboarding module to help criminal investigators gain the insights that they need. It also provides APIs that offer full access to everything that can be done on our platform, allowing web data to be integrated directly. FALCON is capable of crawling ten million links and scrape one million links per month using Celery Worker. It moreover has the potential of outperforming this number if tested under standard cloud platforms.
OnPage-Scraper / OnPage ScraperA Chrome extension for web scraping with visual element selection and data export.
capJavert / JawaVisual scraper interface, exports to puppeteer script which you can run anywhere.
nerodtm / AttackSurfaceMapperAttack Surface Mapper is a reconnaissance tool that uses a mixture of open source intellgence and active techniques to expand the attack surface of your target. You feed in a mixture of one or more domains, subdomains and IP addresses and it uses numerous techniques to find more targets. It enumerates subdomains with bruteforcing and passive lookups, Other IPs of the same network block owner, IPs that have multiple domain names pointing to them and so on. Once the target list is fully expanded it performs passive reconnaissance on them, taking screenshots of websites, generating visual maps, looking up credentials in public breaches, passive port scanning with Shodan and scraping employees from LinkedIn.
jeekzhang / Crawling And Visualization Of Data Scrapingpython大作业——爬取各省降水量及可视化
NicholasMontalbano / Apt Finder Streeteasy ScrapeStreetEasy webscraper and apartment finder https://nicholasmontalbano.github.io/apt_finder_streeteasy_scrape/visuals/filter_table.html
mrmoxon / Agent WebVoyagerAgent-WebVoyager autonomously navigates the web like a human, performing tasks without specific APIs. It uses visual cues and intelligent decisions for web scraping and information retrieval, documenting each step visually. This innovative approach showcases AI's versatility in dynamic web exploration.
Decodo / Google Lens ScraperEasy-to-use API to scrape Google Lens results with proxy support, visual search extraction, and a built-in web UI for testing and debugging.
PHY041 / SuperscrapeWeb scraping + AI visual intelligence that just works — anti-bot era edition
thisisairo / Google Lens Images ScraperPython script utilizing Selenium to scrape image URLs from Google Lens search results and download them. Automates image retrieval from Google's visual search engine.
nichtlegacy / Letterboxd GraphGenerates a GitHub-style contribution graph based on your Letterboxd diary. Uses Node.js to scrape data, process entries, and create daily updated SVG visuals via GitHub Actions.
lodow / Portia ProxyA fork of portia (Visual scraping for Scrapy) with a proxies pool
zingpython / Web Scraping ResourcesWEB SCRAPING AND CONTENT MINING Web Scraping is a method for extracting textual characters from websites so that they could be analyzed. Web scraping is sort of content mining, which means that you collect useful information from websites, including quotes, prices, news company info, etc.This method for gathering data is direct, either through looking at websites' html code or visual abstraction techniques using Python programming language.
SeraphinaGlacia / Steam ScraperA simple, efficient, and visual Steam review data scraper. Scrapes Steam game details and review history trends into SQLite/CSV.
maksimKorzh / Code Monkey ScrapeVisual web scraping service
max-mapper / Atom Scrapeexperimental visual scraping tool built with atom-shell
