This guide explores workflow engines, their essential features, and types, while offering insights and evaluation criteria to help you choose the right solution for your specific use case.
In this post we will describe how we were able to run our Dask-based data preparation at scale on Azure ML Compute Clusters, using Dask-MPI and the native Azure ML MPI support.