API Reference · Benchmarks · Stdlib Benchmarks

<!-- ```ocaml # #thread ``` -->

Saturn — Parallelism-Safe Data Structures for Multicore OCaml

This repository is a collection of concurrent-safe data structures for OCaml 5. It aims to provide an industrial-strength, well-tested (and possibly model-checked and verified in the future), well documented, and maintained concurrent-safe data structure library. We want to make it easier for Multicore OCaml users to find the right data structures for their uses.

You can learn more about the motivation behind Saturn through the implementation of a lock-free stack here.

Saturn is published on opam and is distributed under the ISC license.

Contents

• Saturn — Parallelism-Safe Data Structures for Multicore OCaml
• Contents
• Installation
  • Getting OCaml 5.2.0
  • Getting Saturn
• Provided data structures
  • Treiber Lock-free Stack
  • Lock-free Bounded Stack
  • Michael-Scott Lock-free Queue
  • Lock-free Bounded Queue
  • Lock-free Chase-Lev Work-Stealing Dequeue
  • Lock-free Single Producer Single Consumer Queue
  • Lock-free Multiple Producers Single Consumer Queue
  • Lock-free Skip List
  • Lock-free Hash Table
  • Lock-free Bag
• About the Unsafe Data Structures
• Usage
  • Data Structures with Domain Roles
  • Composability
• Testing
• Benchmarks
• Contributing

Installation

Getting OCaml 5.2.0

To use Saturn, you need OCaml 5.2.0 or later. While Saturn is compatible with OCaml 4.14, this is primarily for compatibility purposes, as parallelism-safe data structures are not required without OCaml 5. Note that versions of OCaml 5 prior to 5.2 are not supported due to bugs in the Atomic module that affect the functionality of some data structures.

To install OCaml 5.2.0 yourself, first make sure you have opam 2.1 or later. You can run this command to check:

opam --version

Then use opam to install OCaml 5.2.0:

opam switch create 5.2.0

If you want a later version, you can run the following line to get a list of all available compiler versions:

opam switch list-available

Getting Saturn

saturn can be installed from opam:

opam install saturn

Provided data structures

Treiber Lock-free Stack

• Module: Stack
• Description: A classic multi-producer, multi-consumer, lock-free stack, known for robustness and flexibility.
• Recommendation: It's a recommended starting point when a LIFO structure is needed.

Lock-free Bounded Stack

• Module: Bounded_stack
• Description: A stack based on the Treiber stack algorithm, with a limited capacity and a length function. This ensures that the stack is memory-bounded.
• Recommendation: Adding a capacity introduces a general overhead to the operations. It is recommended to use the unbounded stack if neither the capacity nor the length function is needed.

Michael-Scott Lock-free Queue

• Module: Queue
• Description: A multi-producer, multi-consumer lock-free queue that is both robust and flexible.
• Recommendation: This structure is ideal when a FIFO setup is required.
• Sources: Simple, Fast, and Practical Non-Blocking and Blocking Concurrent Queue Algorithms

Lock-free Bounded Queue

• Module: Bounded_queue
• Description: A queue based on the Michael-Scott queue algorithm, with a limited capacity and a length function. This ensures that the queue is memory-bounded.
• Recommendation: Adding a capacity introduces a general overhead to the operations. It is recommended to use the unbounded queue if neither the capacity nor the length function is needed.

Lock-free Chase-Lev Work-Stealing Dequeue

• Module: Work_stealing_deque
• Description: Single-producer, multi-consumer dynamic-size deque (double-ended queue).
• Recommendation: Designed for high-throughput scheduling using per-core work distribution. Note that pop and steal operations follow different ordering (LIFO and FIFO) with distinct linearization constraints. It is a role-oriented data structure: most functions can't be used by all domains.
• Sources:
  • Dynamic Circular Work-Stealing Deque
  • Correct and Efficient Work-Stealing for Weak Memory Models

Lock-free Single Producer Single Consumer Queue

• Module: Single_prod_single_cons_queue
• Description: A single-producer, single-consumer fixed-size queue. This specific configuration enables strong optimizations but also makes the data structure unsafe if used improperly, i.e., with more than one producer or one consumer at any time.
• Recommendation: It's concurrent-safe as long as only one thread acts as producer and one as consumer at any time.

Lock-free Multiple Producers Single Consumer Queue

• Module: Single_consumer_queue
• Description: A multi-producer, single-consumer concurrent-safe queue with a closing mechanism to prevent further pushes.
• Recommendation: Designed for scheduler run queues. It is not concurrent-safe if used by multiple consumers simultaneously.

Lock-free Skip List

• Module: Skiplist
• Description: A skiplist is a probabilistic data structure that has an average logarithmic complexity for search and insertion operations. Like Stdlib.Map, it is an ordered collection.
• Recommendation: The skiplist is not resizable. It will, however, continue to work once the limit capacity is reached, but performance will decrease as the depth of the structure won't be enough to maintain logarithmic performance.
• Sources: See Chapter 14 in The Art of Multiprocessor Programming

Lock-free Hash Table

• Module: Htbl
• Description: A resizable lock-free hash table with a snapshot mechanism.
• Recommendation: Contains useful high-level operations designed to work as building blocks of non-blocking algorithms.

Lock-free Bag

• Module: Bag
• Description: A resizable lock-free bag based on the hash table. The pop functions returns a random value contained on the bag.

About the Unsafe Data Structures

Some data structures are available in two versions: a normal version and a more optimized but unsafe version. The unsafe version utilizes Obj.magic in a way that may be unsafe with flambda2 optimizations.

The reason for providing the unsafe version is that certain optimizations require features that are currently not available in OCaml, such as arrays of atomics or atomic fields in records. We recommend using the normal version of a data structure unless its performance is not sufficient for your use case. In that case, you can try the unsafe version.

Currently, the following data structures have an unsafe version:

• Single_cons_single_prod_unsafe: a single consumer single producer lock-free queue
• Queue_unsafe: a Michael-Scott lock-free queue
• Bounded_queue_unsafe: a lock-free bounded queue based on Michael-Scott queue algorithm
• Htbl_unsafe : a lock-free hashtable

Usage

This part describes how to use the provided data structures, and more exactly, what not to do with them. Two main points are discussed:

• some data structures have restrictions on what operations can be performed in a single domain or a