KillZombieZeppelinsAndSparkShells
Kill those Zombie Zeppelins & Spark Shells !
Install / Use
/learn @amandeepbatra/KillZombieZeppelinsAndSparkShellsREADME
What is this about?
https://github.com/amandeepbatra/killZombieZeppelinsAndSparkShells/wiki/Kill-those-Zombie-Zeppelins-&-Spark-Shells-!
How to execute this?
Prerequisites:
Python, EMR over Yarn, Should be run on EMR Master, Hadoop Web UI and Spark UI
To Run:
sh killZombiesSparkShellsZeppelins.sh Or setup as cron Job: */10 * * * * sh /mnt/yarnMetricsScripts/killZombies/killZombiesSparkShellsZeppelins.sh > /dev/null 2>/dev/null
Output:
appsRunning.txt : Will contain currently running apps in yarn in given queues (in yarnAppsRunning.py) sparkShell.txt: Currently running Spark Shells zeppelin.txt: Currently running Zeppelins killZombies.2016_09_12.log:
########## Start Thu Sep 8 06:30:01 UTC 2016 ########### ########## Spark Shell Processing ########### Spark shell not found so killing pid=5502 name=abc memory(KB)=2053520 Spark shell found pid=6196 name=validation-set memory(KB)=3370564 ########## Zepplin Processing ########### Zeppelin not found so killing pid=5741 memory(KB)=2247636 cid=52610 Zeppelin found pid=9785 name=amandeep-Zeppelin memory(KB)=1660872 cid=33721 ########## End ###########
Related Skills
node-connect
347.2kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
108.0kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
347.2kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
qqbot-media
347.2kQQBot 富媒体收发能力。使用 <qqmedia> 标签，系统根据文件扩展名自动识别类型（图片/语音/视频/文件）。
