Your API Builds Are Boring (Until Now)


Extract. Transform. Read.

A newsletter from Pipeline: Your Data Engineering Resource

Hi past, present and future data professional!

Tired of playing with the same 3 APIs? At the end of this email you’ll find a list of 13 offbeat APIs to make ETL interesting again.

But before you make your first request, read my cautionary tale of accidentally racking up $300 in charges on 1 API. Clearly, APIs can seem like black boxes offering unlimited data; to efficiently access that data, you need to think about how you’re “talking” with your API service. If you receive one too many “unauthorized” errors, you may not be reading the docs closely; this guide tells you to approach API documentation reading like an SAT reading comprehension test.

Before Reddit started acting like a budget airline carrier nickel-and-diming customers, it offered an API perfect for beginning developers. Finally, if you want to go beyond ETL, you can do so much more with APIs, like reading and deleting emails (except this one, I hope!).

Get your offbeat API guide here!

If you’re like me and are undefeated in IT phishing tests, here are this week’s embedded links:

Thanks for ingesting,

-Zach

Extract. Transform. Read.

Reaching 20k+ readers on Medium and over 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.

Read more from Extract. Transform. Read.

Hi fellow data professional! Once, during a virtual interview, I had to nod politely as my interviewer apologized for coughing after their cigarette. Oh, and to make this situation even more cringe—they were driving. Some industries design stressful interview processes to psychologically test a candidate’s poise under pressure. Luckily (for the most part) the software engineering field is not included in this basket of high-stress tests. Sure, we are subjected to moderate stress in the form...

Hi fellow data professional! On a recent holiday, a family member and I were strolling along a beach, talking about AI disruption (relaxing, I know). He, an attorney, assured me his job was AI-proof and jokingly offered to hire me when AI takes my data engineering job. If you ask executives at most companies, they’d find several flaws in that argument. Over 80% of technical executives, including Chief Data Officers and Chief AI Officers, consider data engineering to be an essential role...

Hi fellow data professional! Ken Jee, who you heard from last week, drops some sobering career advice in one of the earliest editions of AI Survival Guide: Making a senior-level tech role is no longer about advancement; it’s about survival. The post talks about the growing moat or "wall" between those breaking into the industry, those in entry-level roles and those in a mid-career phase. In the spirit of AI Survival Guide’s advice to bridge the gap separating the early and mid-career...