Why Put Emojis In A Data Pipeline? 😎


Extract. Transform. Read.

A newsletter from Pipeline: Your Data Engineering Resource​

Hi past, present or future data professional!

I bet when you think of data engineering tools, you don’t think of smiley faces. But emojis, when used properly (and sparingly), can be a powerful way to emphasize logging messages and highlight infrastructure failures.

Failing in data engineering can make you :sad_face:. Professionally, I’ve made every code mistake imaginable, with the highlight being omitting a column and needing to process a 45 TB table—twice! Even as I gain experience, I still make (but recover from) plenty of mistakes, which I document on a yearly basis.

Since we’re a little more than halfway through the year, I’d encourage you to use this framework to honestly assess both your technical and interpersonal shortcomings as an aspiring data engineer.

Proactively identifying areas of improvement is growth—and areas for improvement will pay more dividends than cramming in upskilling sessions. It might even make you :smiling_face:

Here are this weeks un-embedded links:

P.S. – there’s a fun announcement coming in next week’s email.

Thanks for ingesting,

-Zach

Extract. Transform. Read.

Reaching 20k+ readers on Medium and over 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.

Read more from Extract. Transform. Read.

Hi fellow data professional! I’ve broken my own data project rule. I’ve used the same data over and over again. For 3 years. It sounds boring but that depth exposure may actually be one of the few moats that slows encroaching AI. A little context: I support subscriptions, newsletters and growth for my employer. Spoiler alert: These areas are all basically the same thing. And they use basically the same three data sets. While I have opportunities to jump to other projects, this has been my...

Hi fellow data professional! I had a very adult weekend after baby bedtime. I uncorked a bottle of wine, cracked open my laptop and… stayed up late making a dashboard tracking my assets and debts. While I learned some important high-level insights that will help me make financial decisions as I renovate and prepare to move into my home, I realized a basic development truth that could help anyone knee-deep in their own project. If your goal is commit or ship then the simplest implementation...

Hi fellow data professional! Next time you think you’ve tried everything in your job search, remember: I once worked with a guy who got hired at a national broadcast network on the strength of his parody rap. The intern, Jake, didn’t have a network or elite contacts, but he wanted an internship at The Tonight Show, a competitive role with over 10,000 applicants per semester. So, he recreated a shot-for-shot parody of a song previously performed on the show, rewritten with lyrics specifically...