Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
[Pipeline] Provision A Python VM In 5 Minutes
The Latest From Pipeline: Your Data Engineering ResourceHi past, present or future data professional! One of the worst habits you can adapt in data engineering is to accept a tool or technology as a black box you’ll simply never understand. For me, for the longest time, this was virtual machines. I would commit and troubleshoot code that would run within a VM but never quite knew how to interact with it. Recently, I provisioned a Google Cloud Compute Engine instance for a junior teammate and learned how to simply and logically create a virtual environment that can boost compute power and accurately mimic production. The best part is, I’ve distilled this into a process that shouldn’t take you more than 5 minutes. Read the latest here. And if you want to learn why automation isn’t always the end goal of software engineering, read last week’s article. Thanks for ingesting, -Zach |
Extract. Transform. Read.
Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
Extract. Transform. Read. A newsletter from PipelineToDE Hi past, present or future data professional! Despite crushing autocorrect scenarios, most AI code assistants like CoPilot miss a critical step when helping developers of any experience level: Validation. Arguably, leveraging an AI Agent to validate a code’s quality is on the user. But a surprising amount of experienced programmers are taking the worrying approach of believing an AI’s first “thought” when it comes to code that will...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! A data science manager recently gave me some blunt, liberating advice over coffee: “If a team lead really cares what cloud technology you know (AWS, GCP, etc.) and doesn’t consider transferable experience… run.” This critical advice, which informs the conclusion of my soon-to-be-released ebook on data engineering project development, cuts to the core of a major problem in data hiring: The...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present, or future data professional! For all of the latest tech trends that come and go, one idea has always persisted in the tech world: Longevity isn’t cool. I say this because I recently hit a professional milestone: 4 years with my current organization. My career trajectory offers a counter-narrative to the “job-hopping is the only way to succeed” mentality. My goal isn't to convince you to be a “lifer,” but to demonstrate...