<img alt="Mantis logo" src="./.assets/mantis.png" width="200" align="right">

Mantis Documentation

Official Website

---

Development

Setting up Intellij

Run ./gradlew idea to (re-) generate IntelliJ project and module files from the templates in .baseline. The generated project is pre-configured with Baseline code style settings and support for the CheckStyle-IDEA plugin.

Install Docker

Install and run Docker to support local containers.

Building

$ ./gradlew clean build

Testing

$ ./gradlew clean test

Formatting the code

Run ./gradlew format task which autoformats all Java files using Spotless.

Building deployment into local Maven cache

$ ./gradlew clean publishNebulaPublicationToMavenLocal

Releasing

We release by tagging which kicks off a CI build. The CI build will run tests, integration tests, static analysis, checkstyle, build, and then publish to the public Bintray repo to be synced into Maven Central.

Tag format:

vMajor.Minor.Patch

You can tag via git or through Github's Release UI.

Contributing

Mantis is interested in building the community. We welcome any forms of contributions through discussions on any of our mailing lists or through patches.

For more information on contribution, check out the contributions file here.

Module Structure

This excludes all connectors and examples as they are mostly leaf nodes in the dependency graph.

Module | Purpose | Example Classes | Package Prefixes ----------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------- mantis-common-serde | Support for serializing and deserializing POJOs using Json | <li>JsonSerializer</li> | <li>io.mantisrx.common.</li> mantis-discovery-proto | todo: need to fill this in | <li>JobDiscoveryProto</li><li>AppJobClustersMap</li><li>StageWorkers</li> | <li>com.netflix.mantis.discovery.proto.</li> mantis-common | Mantis common code shared across modules | <li>MantisJobDefinition</li><li>MachineDefinition</li><li>MantisJobState | <li>io.mantisrx.common.*</li><li> io.mantisrx.runtime.*<li>io.mantisrx.server.code.*</li><li>io.reactivx.mantis.operators.*</li><li>com.mantisrx.common.utils.* mantis-remote-observable | connection to other job,stage related code | <li>ConnectToObservable</li><li>ConnectToGroupedObservable</li><li>RemoteObservable | <li>io.reactivex.mantis.remote.observable.*</li><li>io.reactivex.netty.codec.*<li> mantis-control-plane-core | common code between mantis-control-plane-server, mantis-control-plane-client, mantis-server-worker, mantis-server-agent | <li>TaskExecutorID</li><li>ClusterID</li><li>ExecuteStageRequest</li><li>JobAssignmentResult</li><li>Status | <li>io.mantisrx.server.core.*</li><li>io.mantisrx.server.master.resourcecluster.*</li><li>io.mantisrx.server.worker.* mantis-control-plane-client | API to talk to the mantis control plane server | <li>MasterClientWrapper</li><li>MantisMasterGateway</li><li>MantisMasterClientApi | <li>io.mantisrx.server.master.client.*<li> io.mantisrx.server.master.resourcecluster.* mantis-network | todo: need to fill this in | | mantis-publish-core | todo: need to fill this in | | mantis-server-worker-client | API to interact with workers | <li>MetricsClient</li><li> MetricsClientImpl</li><li>WorkerConnection</li><li>WorkerMetricsClient | <li>io.mantisrx.server.worker.client.* mantis-runtime | Runtime that the jobs need to depend upon. Job DSL should go in here along with how to talk to other jobs | <li>KeyToKey</li><li>GroupToGroup</li><li>Source</li><li>Sink | <li>io.mantisrx.runtime.* mantis-publish-netty | todo: need to fill this in | | mantis-client | client to interact with mantis control plane | <li>MantisClient::submitJob</li><li> MantisClient::killJob | <li>io.mantisrx.client.*</li> mantis-publish-netty-guice | todo: need to fill this in | | mantis-control-plane-server | Actual server that runs the mantis master code | <li>MasterMain</li><li>SchedulingService</li><li>ServiceLifecycle | <li>io.mantisrx.master.*<li>io.mantisrx.server.master.* mantis-server-agent | Contains mantis-runtime agnostic code to start the task executor that runs on the agent | <li>TaskExecutor</li><li>TaskExecutorStarter</li><li>BlobStore</li><li>BlobStoreAwareClassLoaderHandle | <li>io.mantisrx.server.agent.* mantis-server-worker | One implementation of Mantis Worker that depends on the master runtime | <li>MantisWorker</li><li>Task</li><li>ExecuteStageRequestService<li>JobAutoScaler | <li>io.mantisrx.server.worker.config.*<li>io.mantisrx.server.worker.jobmaster.*

Dependency Graph

graph TD;
    A[mantis-common-serde]-->B[mantis-common];
    B-->C[mantis-control-plane-core];
    B-->D[mantis-runtime];
    C-->E[mantis-control-plane-client];
    E-->F[mantis-server-worker-client];
    F-->G[mantis-client];
    E-->G;
    C-->H[mantis-control-plane-server];
    C-->I[mantis-server-worker];
    F-->I;
    D-->I;
    F-->J[mantis-server-agent];
    E-->J;