All Hands on Data #17
Happy iPhone 14 release week! Come and join us on our island as we look at our favorite articles of the week!
Lakehouse – The journey unifying Data Lake and Data Warehouse
The post highlights the complexities with managing your own data hosting and pipeline orchestration even with fully-mature products like the AWS suite. It’ll be interesting to see the subsequent posts regarding how the team implements their solution for creating a “data lakehouse” (a combination of data lake and data warehouse). - John Forstmeier
Forget about algorithms and models – Learn how to solve problems first
This is a great summation of what it means to actually solve problems. In reflection, the latest and greatest are not the thing that will make you a better problem solver, though they may be a better tool. A good problem solver can use any tool. - Eric Elsken
3 Tested Techniques to Recover Your Failing Models
The author does a good job of breaking down different ways to approach keeping your data relevant. I am just now starting to work in helping train a program and this is good information to keep in mind as we move forward. - Jon Davidson
How to Win an Election Using Big Data
With election season upon us for the midterms, Bill does a great job of looking at the role of data in elections. I’m not running a campaign. If I was, this article would be a great resource. - Steven Johnson
What if every dashboard self destructed?
As a disbeliever in most dashboards myself, I love the thought starter proposed by Randy. Would we be any worse off if entire data pipelines were wiped from existence when a dashboard no longer gets views? Would the incentive of losing data make us more likely to build more sustainable, purposeful dashboards? - Blake Burch
The Rise of DataOps
The idea and DataOps can be a little vague, and yet its usefulness in the data space grows daily. I found it interesting that Sankar believes a data team is more closely aligned with a manufacturing team than a software development team. DataOps takes learnings from software development and design (Agile and product thinking), as well as Lean manufacturing principles and DevOps. - Katt Baum