When Isn't Automation Worth It?


The Latest From Pipeline: Your Data Engineering Resource

Hi past, present or future data professional!

Have you heard about the programmer who successfully automated his job to the point where he did no work for 5 years?

Unfortunately, automation efforts are rarely this comprehensive—or successful.

In fact, spending time on automation often results in a time sink, requiring more time to conceive and create the automation than time it saves you.

In the latest from Pipeline, I provide a simple formula to determine ROI on automation. I also share successes—and failures—to inspire you to think critically before attempting to put any aspect of your job (or even the whole thing!) on autopilot.

Read the story here.

Until next time - thanks for ingesting,

-Zach

Extract. Transform. Read.

Reaching 20k+ readers on Medium and over 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.

Read more from Extract. Transform. Read.

Hi fellow data professional! This is the 100th week I’m reaching out into the void of the Internet to connect with you in order to democratize data engineering career knowledge. In the golden age of cable TV, shows would celebrate the 100th episode milestone by airing extended content like a 1-hour special for a sitcom that would typically consume 30 minutes. But I know your time is valuable so I’m going to do the opposite and make this a shorter newsletter than normal. Since I live what I...

Hi fellow data professional! For my health I try not to argue with my wife; but when she told me her networking plan I had to push back. Some context. She’s exploring career paths within the multinational corp she works for and wanted to meet with a friend of a family member. The catch? She felt weird about leveraging a personal connection and wanted to reach out cold. This is the wrong approach. Western culture demonizes nepotism but, truthfully, sometimes a connection is so painfully...

Hi fellow data professional! It’s baseball season in the U.S., a game defined by the "on-deck" line up. Before a player takes a big swing at the plate, they are already there, weighted bat in hand, timing the pitcher (who has to move a bit faster now thanks to the pitch clock), fully prepared for their moment. They don’t start looking for their helmet only after the umpire calls them up. In your early career perhaps you're considering "taking a big swing" by applying for that dream role at a...