Vald

<div align="center"> <a href="https://vald.vdaas.org/"> <img src="./assets/image/readme.svg" width="50%" /> </a> </div>

<!--[](https://codecov.io/gh/vdaas/vald) -->

What is Vald?

Vald is a highly scalable distributed fast approximate nearest neighbor (ANN) dense vector search engine.

Vald is designed and implemented based on Cloud-Native architecture.

Vald has automatic vector indexing and index backup, and horizontal scaling which made for searching from billions of feature vector data.

Vald is easy to use, feature-rich and highly customizable as you needed.

It uses the fastest ANN Algorithm NGT to search neighbors.

(If you are interested in ANN benchmarks, please refer to ann-benchmarks.com.)

For more information, please refer to Official Web Site.

<div align="center"> <img src="./assets/image/svg/vald_architecture_overview.svg" width="100%" /> </div>

Vald can handle any object data, image, audio processing, video, text, binary, or etc., if converting to the vector, and be used for:

• Recognition
• Recommendation
• Detecting
• Grammar checker
• Real-time translator
• anything you want to do!

Requirements

• Kubernetes 1.19~
• AVX2 instructions (required by Vald Agent NGT)

Get Started

Go to Get Started page to try out Vald !

Installation

Using Helm

helm repo add vald https://vald.vdaas.org/charts
helm install vald-cluster vald/vald

If you use the default values.yaml, the nightly images will be installed.

Using Helm-operator

Please refer to vald-helm-operator.

Components

<table> <tr> <th>Component</th> <th>Docker image</th> <th>latest image</th> <th>nightly image</th> </tr> <tr> <td>Agent NGT</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-ngt"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-agent-ngt?label=vdaas%2Fvald-agent-ngt&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-agent-ngt"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--agent--ngt-brightgreen?logo=docker&style=flat-square"/> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-ngt/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-agent-ngt/latest?label=vald-agent-ngt" /> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-ngt/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-agent-ngt/nightly?label=vald-agent-ngt" /> </a> </td> </tr> <tr> <td>Agent Sidecar</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-sidecar"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-agent-sidecar?label=vdaas%2Fvald-agent-sidecar&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-agent-sidecar"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--agent--sidecar-brightgreen?logo=docker&style=flat-square"/> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-sidecar/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-agent-sidecar/latest?label=vald-agent-sidecar" /> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-agent-sidecar/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-agent-sidecar/nightly?label=vald-agent-sidecar" /> </a> </td> </tr> <tr> <td>Discoverer</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-discoverer-k8s"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-discoverer-k8s?label=vdaas%2Fvald-discoverer-k8s&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-discoverer-k8s"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--discoverer--k8s-brightgreen?logo=docker&style=flat-square"/> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-discoverer-k8s/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-discoverer-k8s/latest?label=vald-discoverer-k8s" /> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-discoverer-k8s/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-discoverer-k8s/nightly?label=vald-discoverer-k8s" /> </a> </td> </tr> <tr> <td>Gateways</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-lb-gateway"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-lb-gateway?label=vdaas%2Fvald-lb-gateway&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-lb-gateway"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--lb--gateway-brightgreen?logo=docker&style=flat-square"/> </a><br/> <a href="https://hub.docker.com/r/vdaas/vald-filter-gateway"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-filter-gateway?label=vdaas%2Fvald-filter-gateway&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-filter-gateway"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--filter--gateway-brightgreen?logo=docker&style=flat-square"/> </a><br/> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-lb-gateway/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-lb-gateway/latest?label=vald-lb-gateway" /> </a><br /> <a href="https://hub.docker.com/r/vdaas/vald-filter-gateway/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-filter-gateway/latest?label=vald-filter-gateway" /> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-lb-gateway/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-lb-gateway/nightly?label=vald-lb-gateway" /> </a><br> <a href="https://hub.docker.com/r/vdaas/vald-filter-gateway/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-filter-gateway/nightly?label=vald-filter-gateway" /> </a><br /> </td> </tr> <tr> <td>Index Manager</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-manager-index"> <img src="https://img.shields.io/docker/pulls/vdaas/vald-manager-index?label=vdaas%2Fvald-manager-index&logo=docker&style=flat-square"/> </a><br/> <a href="https://github.com/orgs/vdaas/packages/container/package/vald/vald-manager-index"> <img src="https://img.shields.io/badge/ghcr.io-vdaas%2Fvald%2Fvald--manager--index-brightgreen?logo=docker&style=flat-square"/> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-manager-index/tags?page=1&name=latest"> <img src="https://img.shields.io/docker/v/vdaas/vald-manager-index/latest?label=vald-index-manager" /> </a> </td> <td> <a href="https://hub.docker.com/r/vdaas/vald-manager-index/tags?page=1&name=nightly"> <img src="https://img.shields.io/docker/v/vdaas/vald-manager-index/nightly?label=vald-index-manager" /> </a> </td> </tr> <tr> <td>Helm Operator</td> <td> <a href="https://hub.docker.com/r/vdaas/vald-helm-operator"> <img src="https://img.