Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer and time as a former journalist to demystify data science/programming concepts while sharing career strategies so you can target, land and excel in data-driven roles.
When Isn't Automation Worth It?
The Latest From Pipeline: Your Data Engineering ResourceHi past, present or future data professional! Have you heard about the programmer who successfully automated his job to the point where he did no work for 5 years? Unfortunately, automation efforts are rarely this comprehensive—or successful. In fact, spending time on automation often results in a time sink, requiring more time to conceive and create the automation than time it saves you. In the latest from Pipeline, I provide a simple formula to determine ROI on automation. I also share successes—and failures—to inspire you to think critically before attempting to put any aspect of your job (or even the whole thing!) on autopilot. Read the story here. Until next time - thanks for ingesting, -Zach |
Extract. Transform. Read.
Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer and time as a former journalist to demystify data science/programming concepts while sharing career strategies so you can target, land and excel in data-driven roles.
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! For years, a start-up cliche was being the “Uber” of (product, service, etc.). Now, it seems like any content platform wants to be the “Tik Tok” of a given subject area. Case in point for the latter: A fun app I came across called, fittingly, “Gittok.”* Like Tik Tok, Gittok feeds users an endless stream of distraction but instead of dance challenges it serves up a random GitHub repository, like...
Extract. Transform. Read. A newsletter from Pipeline For a STEM discipline, there is a lot of abstraction in data engineering, evident in everything from temporary SQL views to complex, multi-task AirFlow DAGs. Though perhaps most abstract of all is the concept of containerization, which is the process of running an application in a clean, standalone environment–which is the simplest definition I can provide. Since neither of us has all day, I won’t get too into the weeds on containerization,...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! From 2014-2017 I lived in Phoenix, Arizona and enjoyed the state’s best resident privilege: No daylight saving time. If you’re unaware (and if you're in the other 49 US states, you’re really unaware), March 9th was daylight saving, when we spring forward an hour. If you think this messes up your microwave and oven clocks, just wait until you check on your data pipelines. Even though data teams...