Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
[ETR #50] 4 Years of DE Content In 1 Post
Extract. Transform. Read.A newsletter from Pipeline Hi past, present or future data professional! For the first time since the birth of the Internet, the prevalence of AI summaries has damaged Google’s Search business, possibly irreparably. And while this might simply be a sign the times they are a changin’ (I just watched that new Bob Dylan movie), it points to a harsher reality. These days search universally sucks; I’ve found this is especially true when readers, like yourself, want to dig deeper into my publication’s body of work. My goal when beginning Pipeline was to create a sort of public notebook, recording the practical lessons I learned on the job. But like old notebooks, pages get torn, tossed aside and buried. To help resurrect old data engineering content I believe is useful but overlooked, I went old school, making an index containing hundreds of searchable, scrollable hyperlinks in 1 post called, appropriately, “Every Pipeline Story Ever.” This effectively serves as the publication’s archive, allowing ready access to 250+ stories from November 2021 to present. That means you can explore older content like my primer on GCP’s logging query language or working with streaming data in Python. If you’ve read my project guide you’ll know I’m a fan of unique projects like when I helped a Wall Street banker scrape data from 3,000 companies. And if you want to know what the day in the life of a working data engineer is, you can read about my typical work day, with a European twist. As a bonus, I wrote a piece detailing the simple process I used to programmatically create this webpage. My only tools were Pandas, a few HTML tags and markdown syntax. And, to be honest, a bit of guidance from my pair programmer AI. My hope is to fight the ever-picky algorithms by allowing you, the reader, to choose how and when you consume. Take notes, Google. Thanks for ingesting and enjoy your trek through the archives, -Zach Quinn |
Extract. Transform. Read.
Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! It’s hardly controversial to say debugging is everyone’s least favorite part of programming. One widely-used debugging method is the rubber duck method, popularized in Pragmatic Programming, which suggests you talk through your code, aloud, to an inanimate object. Being able to speak intelligently about what prompted a technical decision is one of the most underrated data engineering skills. One...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! If you’re like me, in school you were always envious of your classmates that may not have applied themselves academically but were “good test takers.” Fortunately (for them at least), these folks would likely do well on what is quietly becoming the SAT of programming the GCA, or General Coding Assessment. Now, the General Coding Assessment isn’t any kind of board certifying test like the Bar...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! While many tech-oriented companies have (in one way or another) reneged on remote working arrangements, my employer made an extreme gesture to demonstrate its commitment to the ongoing office-less lifestyle: It removed an entire floor of our two-floor New Jersey office space. Other companies, like Spotify, have unveiled slogans like “Our employees aren’t children. Spotify will continue working...