Onyx

What is it?

• a masterless, cloud scale, fault tolerant, high performance distributed computation system
• batch and stream hybrid processing model
• exposes an information model for the description and construction of distributed workflows
• Competes against Storm, Flink, Cascading, Cascalog, Spark, Map/Reduce, Sqoop, etc
• written in pure Clojure

What would I use this for?

• Realtime event stream processing
• CQRS
• Continuous computation
• Extract, transform, load
• Data transformation à la map-reduce
• Data ingestion and storage medium transfer
• Data cleaning

Installation

Available on Clojars:

[org.onyxplatform/onyx "0.14.6"]

Changelog

Changelog can be found at changes.md.

Quick Lookup Doc

A searchable set of documentation for the Onyx data model is available.

Project Template

A project template can be found at onyx-template.

Plugins and Libraries

Plugin Template

We provide a plugin template for use in building new plugins. This can be found at onyx-plugin.

Plugin Use

To use the supported plugins, please use version coordinates such as [org.onyxplatform/onyx-amazon-sqs "0.14.6.SNAPSHOT.0"], and read the READMEs on the 0.14.x branches linked above.

Build Status

Component | release| unstable ----------|--------|---------- onyx core| | onyx-local-rt| | onyx-kafka| | onyx-datomic| | onyx-redis| | onyx-sql| | onyx-bookkeeper| | onyx-amazon-sqs| | onyx-amazon-s3| | onyx-http| | learn-onyx| | - onyx-examples| | onyx-peer-http-query| | lib-onyx| | onyx-plugin| | onyx-template| |

• release: stable, released content
• unstable: unreleased content

Unsupported plugins

Some plugins are currently unsupported in onyx 0.14.x. These are:

• onyx-durable-queue
• onyx-elasticsearch
• onyx-kafka-0.8

Companies Running Onyx in Production

                   <img src="doc/images/cognician.png" height="30%" width="30%">                    <img src="doc/images/indaba.png" height="40%" width="40%">                    <img src="doc/images/yapster.png" height="15%" width="15%">                    <img src="doc/images/modnakasta.png">                    <img src="doc/images/breeze-125.png">

Quick Start Guide

Feeling impatient? Hit the ground running ASAP with the onyx-starter repo and walkthrough. You can also boot into preloaded a Leiningen application template.

User Guide 0.14.6

• User Guide Table of Contents
• API docs
• Cheat Sheet

Developer's Guide 0.14.6

• Branch Policy
• Release Checklist
• Deployment Process

API Docs 0.14.6

Code level API documentation can be found here.

Official plugin listing

Official plugins are vetted by Michael Drogalis. Ensure in your project that plugin versions directly correspond to the same Onyx