Flyte
Flyte’s main purpose is to increase the development velocity for data processing and machine learning, enabling large-scale compute execution without the operational overhead. Teams can therefore focus on the business goals and not the infrastructure.
Features
Container Native
Extensible Backend & SDK’s
Ergonomic SDK’s in Python, Java & Scala
Versioned & Auditable – all actions are recorded
Matches your workflow – Start with one task, convert to a pipeline, attach multiple schedules or trigger using a programmatic API or on-demand
Battle-tested – millions of pipelines executed per month
Vertically-Integrated Compute – serverless experience
Deep understanding of data-lineage & provenance
Operation Visibility – cost, performance, etc.
Cross-Cloud Portable Pipelines