Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.
Your API Builds Are Boring (Until Now)
Extract. Transform. Read.A newsletter from Pipeline: Your Data Engineering ResourceHi past, present and future data professional! Tired of playing with the same 3 APIs? At the end of this email you’ll find a list of 13 offbeat APIs to make ETL interesting again. But before you make your first request, read my cautionary tale of accidentally racking up $300 in charges on 1 API. Clearly, APIs can seem like black boxes offering unlimited data; to efficiently access that data, you need to think about how you’re “talking” with your API service. If you receive one too many “unauthorized” errors, you may not be reading the docs closely; this guide tells you to approach API documentation reading like an SAT reading comprehension test. Before Reddit started acting like a budget airline carrier nickel-and-diming customers, it offered an API perfect for beginning developers. Finally, if you want to go beyond ETL, you can do so much more with APIs, like reading and deleting emails (except this one, I hope!). Get your offbeat API guide here! If you’re like me and are undefeated in IT phishing tests, here are this week’s embedded links:
Thanks for ingesting, -Zach |
Pipeline To DE
Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.
Extract. Transform. Read. A newsletter from Pipeline. Hi past, present or future data professional! This holiday season will be a little less bright thanks to my lack of personal GitHub commits. Like you, I began 2024 full of ideas and motivation that, let’s be honest, was depleted by the end of Q1 when I was cranking out enough code at work that would please even notorious code volume stickler Elon Musk. Despite my lacking output, I managed to hunker down to create useful “bespoke” (a.k.a....
Extract. Transform. Read. A newsletter from Pipeline. Hi past, present or future data professional! When I worked at Disney there was one line (aside from “Have a Magical Day”) that was borderline beaten into us: “We are all custodial employees.” The line meant, of course, to keep areas under your purview neat and presentable (“show ready” in Disney-speak). Using the same logic, I’d like to emphasize that while the various data roles (data analyst, data scientist, data engineer, etc.) have...
Extract. Transform. Read. A Newsletter From Pipeline Hi past, present or future data professional! Since today marks Thanksgiving in the US, I hope this reaches you before your eyes glaze over from the tryptophan-induced turkey coma we all inevitably slip into. While today is a day of gratitude, from a data engineering perspective, I’d like to focus, instead, on the under-the-radar tasks that can make a difference at this time of year—even if they don’t gain you any recognition at work. The...