Kubeflow

Run your data pipelines on Kubernetes – where each step in the workflow is a container.

Execute end-to-end data pipelines entirely on GPUs.

Orchestrate complex data pipelines and handle dependencies - built by Spotify.

An open-source container-orchestration system for automating application deployment, scaling, and management.