Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.
[ETR #15] GCP's Secret App Every Engineer Needs
Extract. Transform. Read.A newsletter from PipelineSponsored by Basejump AI. Don't just query your data; chat with it. Learn more. Hi past, present or future data professional! If you’re a hybrid or remote worker (or online student) you know the FOMO that sets in when you leave your desk and something at work needs your immediate attention. Even though data engineering is a role that can be done from anywhere, having to open, set up and position a laptop isn’t ideal in all situations like when you’re working from the car or traveling 6,000 miles. One of my favorite recent GCP discoveries, the Google Cloud mobile app*, allows you to stay more tethered to activities in your GCP project than an alert email or a frenzied DM from your boss. In other words: I’ve been longing for this app–despite not knowing it even existed. Although Google Cloud mobile is limited in scope it is especially helpful for certain business-critical activities like:
One of the most significant variables when it comes to problem solving in a remote work environment is responsiveness. As an employee, I’m expected to be available during regular working hours (typically 9–5); as an engineer, I need to be “on alert” most of the day and within walking distance to my workstation to diagnose and fix any instances of data downtime. The Google Cloud mobile app provides me with more legible, comprehensive visibility for messages like logging entries than I would have on a mobile browser. Add to that the ability to execute job-related tasks like turn a running VM off and it certainly enhances my work and can help yours as well. Read my in-depth review, with screenshots, here. So you don’t get FOMO, here are this week’s links:
Questions? zach@pipelinetode.com *I am not receiving compensation from Google Cloud; this is an objective review. Until next time–thanks for ingesting, -Zach Quinn |
Pipeline To DE
Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! For years, a start-up cliche was being the “Uber” of (product, service, etc.). Now, it seems like any content platform wants to be the “Tik Tok” of a given subject area. Case in point for the latter: A fun app I came across called, fittingly, “Gittok.”* Like Tik Tok, Gittok feeds users an endless stream of distraction but instead of dance challenges it serves up a random GitHub repository, like...
Extract. Transform. Read. A newsletter from Pipeline For a STEM discipline, there is a lot of abstraction in data engineering, evident in everything from temporary SQL views to complex, multi-task AirFlow DAGs. Though perhaps most abstract of all is the concept of containerization, which is the process of running an application in a clean, standalone environment–which is the simplest definition I can provide. Since neither of us has all day, I won’t get too into the weeds on containerization,...
Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! From 2014-2017 I lived in Phoenix, Arizona and enjoyed the state’s best resident privilege: No daylight saving time. If you’re unaware (and if you're in the other 49 US states, you’re really unaware), March 9th was daylight saving, when we spring forward an hour. If you think this messes up your microwave and oven clocks, just wait until you check on your data pipelines. Even though data teams...