Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
[ETR #51] Why AI Can Take Some DE Jobs
Extract. Transform. Read.A newsletter from Pipeline Hi past, present or future data professional! Well, it finally happened; AI has replaced a build I created and I’ve been made redundant. Thankfully, the person that created the AI integration was also me. And I did this on personal time so this isn’t an apocalyptic scenario. I’ve previously written about a handful of tools I created to optimize the “busy work” of blogging. One of the ways is by adding links to past relevant articles and newsletters so readers can rediscover content as it makes sense to do so. I did this by creating a Google Sheet with a connection to my data warehouse displaying article names and links. When I write a new piece I search titles by keywords. I recently trained an AI Agent (Google Gemini) to do this better. The key differentiator was the training data. Instead of asking Gemini to search the Internet and provide relevant links, I passed 250 links and instructed it to only link to that content. I add constraints like only add 5 links to not overwhelm the reader. As I mentioned, training data was the distinguishing factor for success; this is very good news for data engineers who work to create pipelines to provide the cleanest, most relevant data. This ultimately powers human and AI-driven insights and adds huge value to an org. To give yourself an edge as an AI-friendly engineer, I suggest:
When influencers/guru/your uncle tell you to “learn AI” what they should say is “master natural language coding to automate away chunks of your job and be the valuable human in the loop.” Only then can you be like many major corporations and spin “redundancy” in your favor. Thanks for ingesting, -Zach Quinn |
Extract. Transform. Read.
Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! One of the most loaded terms, after AI, is upskilling. It’s something everyone should always be doing, yet, only the most dedicated can consistently dedicate time to learning and expanding beyond their comfort zones. If you’re on the path to becoming a data professional, you’ve probably spent countless hours learning, only to find yourself wondering if you’re actually making progress. I’ve been...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! When I worked as a resume consultant, the toughest mental block for clients was identifying and expressing material contributions at work; avoiding this communication is why so many job hunters revert to regurgitating their job duties rather than clarifying the outcomes of their work. In addition to overcoming the hurdle of distilling a complex technical role for non-technical recruiters to...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! Data science just cracked the top 40… of jobs whose main functions are most likely to be replaced by AI. If you’re up to speed on your AI doomerism news you’ll know that at the end of July, Microsoft released a list of jobs across disciplines and industries that could be majorly disrupted by AI. On a more positive economic outlook, data engineering is specifically cited as a growing role in the...