Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
[ETR #51] Why AI Can Take Some DE Jobs
Extract. Transform. Read.A newsletter from Pipeline Hi past, present or future data professional! Well, it finally happened; AI has replaced a build I created and I’ve been made redundant. Thankfully, the person that created the AI integration was also me. And I did this on personal time so this isn’t an apocalyptic scenario. I’ve previously written about a handful of tools I created to optimize the “busy work” of blogging. One of the ways is by adding links to past relevant articles and newsletters so readers can rediscover content as it makes sense to do so. I did this by creating a Google Sheet with a connection to my data warehouse displaying article names and links. When I write a new piece I search titles by keywords. I recently trained an AI Agent (Google Gemini) to do this better. The key differentiator was the training data. Instead of asking Gemini to search the Internet and provide relevant links, I passed 250 links and instructed it to only link to that content. I add constraints like only add 5 links to not overwhelm the reader. As I mentioned, training data was the distinguishing factor for success; this is very good news for data engineers who work to create pipelines to provide the cleanest, most relevant data. This ultimately powers human and AI-driven insights and adds huge value to an org. To give yourself an edge as an AI-friendly engineer, I suggest:
When influencers/guru/your uncle tell you to “learn AI” what they should say is “master natural language coding to automate away chunks of your job and be the valuable human in the loop.” Only then can you be like many major corporations and spin “redundancy” in your favor. Thanks for ingesting, -Zach Quinn |
Extract. Transform. Read.
Reaching 20k+ readers on Medium and nearly 3k learners by email, I draw on my 4 years of experience as a Senior Data Engineer to demystify data science, cloud and programming concepts while sharing job hunt strategies so you can land and excel in data-driven roles. Subscribe for 500 words of actionable advice every Thursday.
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! While many tech-oriented companies have (in one way or another) reneged on remote working arrangements, my employer made an extreme gesture to demonstrate its commitment to the ongoing office-less lifestyle: It removed an entire floor of our two-floor New Jersey office space. Other companies, like Spotify, have unveiled slogans like “Our employees aren’t children. Spotify will continue working...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! The only thing worse than summer temperatures (if you’re in the western hemisphere, that is) is a summer job search. Conventionally, summer isn’t the best time to apply for work; you could probably tell this if you’re currently working and find yourself accepting an overwhelming amount of OOO cal invites. If you are braving the heat of the job market, I want to share a more targeted and...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! For the first time since the birth of the Internet, the prevalence of AI summaries has damaged Google’s Search business, possibly irreparably. And while this might simply be a sign the times they are a changin’ (I just watched that new Bob Dylan movie), it points to a harsher reality. These days search universally sucks; I’ve found this is especially true when readers, like yourself, want to dig...