theflow Documentation

theflow aims for:

Composable function: functions can be combined into more complex composite functions. Functions and params in composite functions can easily be switched and swapped.

Pipeline tracability: input and output to a function can be logged and investigated.

Fast execution: utilize cache whenever possible.

Simple to run local: most of the pipeline building happen at local. Developers have as much freedom to design their desired pipelines. They are also equipped with tools and functionalities to help them arrive at the final pipeline.

Simple to deploy to workflow orchestrator: once a production-ready pipeline has been made, developers can quickly deploy this pipeline to a matured production-grade pipeline execution system.