Desktop Site (Beta)

Introductory Video

Selinon - dynamic distributed task flows

Loading

Follow to receive video recommendations   a   A
Speaker: Are you the speaker?

Have you ever tried to define and process complex workflows for dataprocessing? If the answer is yes, you might have struggled to find theright framework for that. You've probably came across Celery - populartask flow management for Python. Celery is great, but it does notprovide enough flexibility and dynamic features needed badly in complexflows. As we discovered all the limitations, we decided to implementSelinon.Have you ever tried to define and process complex workflows for dataprocessing? If the answer is yes, you might have struggled to find theright framework for that. You've probably came across Celery - populartask flow management for Python. Celery is great, but it does notprovide enough flexibility and dynamic features needed badly in complexflows. As we discovered all the limitations, we decided to implementSelinon.Selinon enhances Celery task flow management and allows you to createand model task flows in your distributed environment that candynamically change behavior based on computed results in your cluster,automatically resolve tasks that need to be executed in case ofselective task runs, automatic tracing mechanism and many others.

Editors Note:

I am looking for editors/curators to help with branches of the tree. Please send me an email  if you are interested.  

Comment On Twitter