Stormcrawlerfight
Crawl configurations for benchmarking / testing StormCrawler
Install / Use
/learn @DigitalPebble/StormcrawlerfightREADME
stormcrawlerfight
Benchmarking of StormCrawler with different versions, backends or alternative crawlers.
Create a link named 'seeds' to the seeds file of your choice.
With Storm installed, you can generate an uberjar:
mvn clean package
then
storm jar target/storm-crawler-fight-2.0-SNAPSHOT.jar org.apache.storm.flux.Flux --local es-crawler.flux
Replace '--local' with '--remote' to deploy it on a running Storm cluster.
Related Skills
node-connect
341.0kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
84.4kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
341.0kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
commit-push-pr
84.4kCommit, push, and open a PR
