OxiMedia

Pure Rust reconstruction of OpenCV + FFmpeg — A patent-free, memory-safe multimedia and computer vision framework.

Vision

OxiMedia is a clean room, Pure Rust reconstruction of both FFmpeg (multimedia processing) and OpenCV (computer vision) — unified in a single cohesive framework.

FFmpeg Domain

Codec encoding/decoding (AV1, VP9, VP8, Theora, Opus, Vorbis, FLAC, MP3), container muxing/demuxing (MP4, MKV, MPEG-TS, OGG), streaming protocols (HLS, DASH, RTMP, SRT, WebRTC, SMPTE 2110), transcoding pipelines, filter graphs (DAG-based), audio metering (EBU R128), loudness normalization, packaging (CMAF, DRM/CENC), and server-side media delivery.

OpenCV Domain

Computer vision (object detection, motion tracking, video enhancement, quality assessment), professional image I/O (DPX, OpenEXR, TIFF), video stabilization, scene analysis, shot detection, denoising (spatial/temporal/hybrid), camera calibration, color management (ICC, ACES, HDR), video scopes (waveform, vectorscope, histogram), and forensic analysis (ELA, PRNU, copy-move detection).

Design Principles

• Patent Freedom: Only royalty-free codecs (AV1, VP9, Opus, FLAC, and more)
• Memory Safety: Zero unsafe code, compile-time guarantees
• Async-First: Built on Tokio for massive concurrency
• Single Binary: No DLL dependencies, no system library requirements
• WASM Ready: Runs in browser without transcoding servers
• Sovereign: No C/Fortran dependencies in default features — 100% Pure Rust

FFmpeg + OpenCV, Reimagined

FFmpeg is the de facto standard for multimedia processing, but it is written in C with patent-encumbered codecs (H.264, H.265, AAC), chronic memory safety vulnerabilities, and notoriously complex build systems requiring dozens of system libraries.

OpenCV is the de facto standard for computer vision, but it depends on C++ with complex CMake builds, optional proprietary modules (CUDA, Intel IPP), and heavy system-level dependencies.

OxiMedia unifies both into a single Pure Rust framework with zero C/Fortran dependencies:

| | FFmpeg | OpenCV | OxiMedia | |---|---|---|---| | Language | C | C++ | Pure Rust | | Memory safety | Manual | Manual | Compile-time guaranteed | | Patent-free codecs | Opt-in | N/A | Default (AV1, VP9, Opus, FLAC) | | Install | ./configure && make + system deps | cmake + system deps | cargo add oximedia | | WASM support | Limited (Emscripten) | Limited (Emscripten) | Native (wasm32-unknown-unknown) | | CV + Media unified | No | No | Yes — single framework |

From the FFmpeg world: codec encode/decode, container mux/demux, streaming (HLS/DASH/RTMP/SRT/WebRTC), transcoding pipelines, filter graphs, audio processing, packaging, and media server.

From the OpenCV world: detection, tracking, stabilization, scene analysis, shot detection, denoising, calibration, image I/O (DPX/EXR/TIFF), color science, quality metrics (PSNR/SSIM/VMAF), and forensics.

One cargo add — no battling system library installations, no pkg-config, no LD_LIBRARY_PATH, no brew install ffmpeg opencv.

Project Scale

OxiMedia is a production-grade framework at v0.1.2 (released 2026-03-17):

| Metric | Value | |--------|-------| | Total crates | 106 | | Total SLOC (Rust) | ~2,155,000 | | Stable crates | 106 | | Alpha crates | 0 | | Partial crates | 0 | | License | Apache 2.0 | | MSRV | Rust 1.85+ |

Architecture

FFmpeg domain spans Foundation, Codecs & Container, Networking, and Audio layers. OpenCV domain spans Computer Vision, Video Processing, and Analysis layers. Both domains share the Processing Pipeline and Applications layers above them.

┌─────────────────────────────────────────────────────────────────────────────┐
│                              Applications                                    │
│          CLI / Server / Python Bindings (oximedia-py) / Review UI            │
├──────────────────────┬──────────────────────────────┬───────────────────────┤
│   Production Layer   │      Media Management        │    Broadcast Layer    │
│  oximedia-playout    │      oximedia-mam             │  oximedia-switcher    │
│  oximedia-playlist   │      oximedia-search          │  oximedia-routing     │
│  oximedia-automation │      oximedia-rights          │  oximedia-ndi         │
│  oximedia-multicam   │      oximedia-review          │  oximedia-videoip     │
├──────────────────────┴──────────────────────────────┴───────────────────────┤
│                         Processing Pipeline                                  │
│   oximedia-graph (Filter DAG)  ·  oximedia-transcode  ·  oximedia-effects   │
│   oximedia-timeline            ·  oximedia-edit        ·  oximedia-workflow  │
├────────────────┬────────────────┬──────────────────┬──────────────────────-─┤
│ Video Domain   │  Audio Domain  │  Computer Vision │  Quality & Analysis    │
│ oximedia-codec │ oximedia-audio │ oximedia-cv      │ oximedia-quality       │
│ oximedia-vfx   │ oximedia-metering│ oximedia-scene │ oximedia-qc            │
│ oximedia-lut   │ oximedia-normalize│ oximedia-shots│ oximedia-analysis      │
│ oximedia-colormgmt│ oximedia-effects│ oximedia-stabilize│ oximedia-scopes   │
├────────────────┴────────────────┴──────────────────┴────────────────────────┤
│                         Container / Networking                               │
│  oximedia-container  ·  oximedia-net  ·  oximedia-packager                  │
│  oximedia-hls/DASH   ·  oximedia-srt  ·  oximedia-webrtc                   │
├─────────────────────────────────────────────────────────────────────────────┤
│                           Foundation                                         │
│     oximedia-io  ·  oximedia-core  ·  oximedia-gpu  ·  oximedia-simd        │
│     oximedia-accel  ·  oximedia-storage  ·  oximedia-jobs                   │
└─────────────────────────────────────────────────────────────────────────────┘

Crates

Foundation

| Crate | Description | Status | |-------|-------------|--------| | oximedia-core | Core types, traits, error handling, buffer pools | Stable | | oximedia-io | I/O foundation (async media source, bit reader, Exp-Golomb) | Stable | | oximedia-gpu | GPU compute via WGPU (Vulkan/Metal/DX12) | Stable | | oximedia-simd | Hand-written SIMD kernels for codec acceleration | Stable | | oximedia-accel | GPU acceleration via Vulkan compute with CPU fallback | Stable | | oximedia-storage | Cloud storage abstraction (S3, Azure, GCS) | Stable | | oximedia-jobs | Job queue (priority scheduling, SQLite persistence, worker pool) | Stable | | oximedia-plugin | Dynamic codec plugin system with registry and manifests | Stable | | oximedia-bench | Comprehensive codec benchmarking suite | Stable | | oximedia-presets | Preset management (codec, platform presets: YouTube, Instagram, etc.) | Stable |

Codecs & Container

| Crate | Description | Status | |-------|-------------|--------| | oximedia-codec | Video codecs (AV1, VP9, VP8, Theora) and image I/O | Stable | | oximedia-audio | Audio codec implementations (Opus, Vorbis, FLAC, MP3) | Stable | | oximedia-container | Container mux/demux (MP4, MKV, MPEG-TS, OGG) | Stable | | oximedia-lut | Color science/LUT (1D/3D, Rec.709/2020/DCI-P3/ACES, HDR) | Stable | | oximedia-edl | EDL parser/generator (CMX 3600, GVG, Sony BVE-9000) | Stable | | oximedia-aaf | SMPTE ST 377-1 AAF reader/writer for post-production | Stable | | oximedia-imf | IMF SMPTE ST 2067 (CPL, PKL, ASSETMAP, MXF essence) | Stable | | oximedia-dolbyvision | Dolby Vision RPU metadata (profiles 5/7/8/8.1/8.4) | Stable | | oximedia-drm | DRM/encryption (CENC, Widevine, PlayReady, FairPlay) | Stable | | oximedia-subtitle | Subtitle/caption rendering (SRT, WebVTT, CEA-608/708) | Stable | | oximedia-timecode | LTC and VITC timecode reading/writing | Stable | | oximedia-compat-ffmpeg | FFmpeg CLI argument compatibility layer (80+ codec mappings) | Stable |

Networking & Streaming

| Crate | Description | Status | |-------|-------------|--------| | oximedia-net | Network streaming (HLS/DASH/RTMP/SRT/WebRTC/SMPTE 2110) | Stable | | oximedia-packager | Streaming packaging (HLS/DASH/CMAF, encryption, DRM) | Stable | | oximedia-server | RESTful media server with transcoding and CDN support | Stable | | oximedia-cloud | Cloud integration (AWS, Azure, GCP) | Stable | | oximedia-ndi | NDI support (send/receive, failover, tally, bandwidth management) | Stable | | oximedia-videoip | Patent-free video-over-IP (NDI alternative) | Stable | | oximedia-timesync | Precision Time Protocol and clock discipline | Stable | | oximedia-distributed | Distributed encoding (gRPC, load balancing, fault tolerance) | Stable |

Video Processing

| Crate | Description | Status | |-------|-------------|--------| | oximedia-cv | Computer vision (detection, tracking, enhancement, quality) | Stable | | oximedia-graph | Filter graph pipeline (DAG, topological sort, optimization) | Stable | | oximedia-effects | Audio effects (reverb, delay, chorus, compressor, EQ) | Stable | | oximedia-vfx | Professional video effects library | Stable | | oximedia-colormgmt | Color management (ICC profiles, ACES, HDR, LUT/GPU) | Stable | | oximedia-image | Professional image I/O (DPX, OpenEXR, TIFF) | Stable | | `oximedia-scalin