Brigade
Parallel S3 bucket-bucket differential sync in Go
Install / Use
/learn @Shopify/BrigadeREADME
brigade
Command brigade is a toolkit to list and sync S3 buckets.
It can create a listing of all the keys in a bucket, compute the difference between two listing, slice a listing into sub-listings and synchronize a listing between a source bucket onto a destination bucket, using PutCopy.
It also provides a convenience backup command that performs all those steps
automatically, using a third S3 bucket to keep state between executions. This
command is most appropriate for periodic backup jobs of an S3 bucket to another.
The motivation behind command brigade is to keep a copy of an S3 bucket accessible from an incompatible set of credentials for the original bucket. In a scenario where the original bucket is compromised and destroyed, the copy would be up and relatively fresh, while inaccessible by an attacker.
list Lists the keys in an S3 bucket.
sync Syncs the keys from a source S3 bucket to another.
slice Slice an S3 key listing into multiple sub-listings.
diff Generates a differential listing of S3 keys.
backup Executes list, diff and sync from a source to a destination bucket.
help, h Shows a list of commands or help for one command
Generated by godoc2md
Related Skills
node-connect
347.6kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
108.4kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
347.6kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
qqbot-media
347.6kQQBot 富媒体收发能力。使用 <qqmedia> 标签,系统根据文件扩展名自动识别类型(图片/语音/视频/文件)。
