127 skills found · Page 1 of 5
bitmagnet-io / BitmagnetA self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration.
gigablast / Open Source Search EngineNov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com, which has binaries for download. See the README.md file at the very bottom of this page for instructions.
amirgamil / ApolloA Unix-style personal search engine and web crawler for your digital footprint.
ZSAIm / VideoCrawlerEngine起源于旧项目爱奇艺解析器(iqiyi-parser)在开发、维护和扩展的过程中遇到的一些问题，而实现的一个基于任务流式的可视化爬虫引擎。引擎的执行单元是节点。脚本节点(script)作为根节点来完成对节点和流程的描述，经由任务节点(task)解析流程描述并生成节点的执行队列，最后交由工作者执行池处理。整个过程可视可控，所有节点处理器都以插件的形式导入，以最大程度实现易扩展性。
biolds / SosseSelenium Open Source Search Engine & crawler
wcong / Ants Goopen source, distributed, restful crawler engine in golang
commoncrawl / Commoncrawl CrawlerThe Common Crawl Crawler Engine and Related MapReduce code (2008-2012)
nuhmanpk / WebScrapperPowerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands!
RevoltSecurities / SpideyXSpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.
NexvisionLab / Darkweb Search EngineDark Web & Deep Web Search Engine. Data Crawler and indexer for Darkweb , OSINT Tools for the Dark Web
aws-samples / Aws Step Functions Kendra Web Crawler Search EngineThis sample aims to demonstrate how to create a serverless web crawler and search engine, using AWS Lambda, AWS Step Functions, and Amazon Kendra
neverneverendup / Translator互联网在线翻译引擎爬虫集合，包含谷歌翻译、百度翻译、有道翻译、必应翻译等引擎。Internet online translation engine crawler collection, including Google translation, Baidu translation, Youdao translation, Bing translation and other engines.
kurokikaze / Node Search EngineSample search engine with web crawler, built on Node.js + CouchDB + Limestone
Drahflow / CrawlerI needed a serious web crawler for search engine applications. This is it.
liameno / LibrenginePrivacy Web Search Engine (not meta, own crawler)
ecmendenhall / DaveDaveFindA simple search engine based on the web crawler developed in Udacity's CS101 course.
c-bata / PysearchWeb crawler and Search engine in Python.
conaticus / Search Engine CrawlerNo description available
kabegame / KabegameKabegame — An anime image crawler client with pluggable crawlers (from a GitHub plugin repo), wallpaper rotation by custom rules, and Wallpaper Engine export. Supports Windows 10/11, macOS Big Sur+, and Ubuntu 24.04+.
Conso1eCowb0y / DeepminerDeep web crawler and search engine
