Flyte

GitHub Support CommunityData Processing

The Workflow Automation Platform for Complex, Mission-Critical Data and ML Processes at Scale

Features

Executing distributed data pipelines/workflows
Reusing tasks across projects, users, and workflows
Making it easy to stitch together workflows from different teams and domain experts
Backtracing to a specified workflow
Comparing results of training workflows over time and across pipelines
Sharing workflows and tasks across your teams
Simplifying the complexity of multi-step, multi-owner workflows

Official website

Tutorial and documentation

Enter your contact information to continue reading