Batch data processing, historically known as ETL, is extremely challenging. It’s time-consuming, brittle, and often unrewarding. Not only that, it’s hard to operate, evolve, and troubleshoot. As ETL pipelines grow in complexity, and as data teams grow in numbers, using methodologies that provide clarity isn’t a luxury, it’s a necessity.
I am looking for editors/curators to help with branches of the tree. Please send me an email if you are interested.