Spark
Apache Spark - A unified analytics engine for large-scale data processing
Install / Use
/learn @apache/SparkREADME
Apache Spark
Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R (Deprecated), and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
- Official version: https://spark.apache.org/
- Development version: https://apache.github.io/spark/
Online Documentation
You can find the latest Spark documentation, including a programming guide, on the project web page. This README file only contains basic setup instructions.
Build Pipeline Status
| Branch | Status |
|------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| master | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| | 
|
| branch-4.1 | 
|
| | 
|
| | 
|
| | 
|
| | [
](https://github.com/
Related Skills
openai-image-gen
329.7kBatch-generate images via OpenAI Images API. Random prompt sampler + `index.html` gallery.
oracle
329.7kBest practices for using the oracle CLI (prompt + file bundling, engines, sessions, and file attachment patterns).
prose
329.7kOpenProse VM skill pack. Activate on any `prose` command, .prose files, or OpenProse mentions; orchestrates multi-agent workflows.
claude-opus-4-5-migration
81.2kMigrate prompts and code from Claude Sonnet 4.0, Sonnet 4.5, or Opus 4.1 to Opus 4.5
