All Hands on Data #23
Are you ready for Halloween? If the state of your data architecture is starting to spook you, this week's articles might help.
3 Ways to Enhance Productivity with AI
What struck me as interesting about this article is that it is about the ways in which AI can make the life of the individual data scientist easier. According to the article, “many tasks [data scientists] spend their time working on are very different from the tasks they actually want to prioritize”. It is time to leverage AI to allow you to prioritize the work you feel matters. - Katt Baum
Emerging Architectures for Modern Data Infrastructure
In an updated 2020 post, A16Z reexamines the state of data infrastructure. While core features have remained fairly constant, and existing players have established strong market share, bigger changes have been made on the tooling front. Users are now being presented with a myriad of new tools, seemingly every day, for ways to pull and leverage their data from the “backbone” infrastructure resources. The article goes into detail in a number of different “blueprints” and is worth diving into! - John Forstmeier
Hollywood Decentralized: Meet the Artists Using AI To Dethrone Tinseltown
AI generated art has always been interesting to me - some of the wacky stuff I’ve seen from DALL-E to some of the beautifully composed pieces I’ve seen based on lyrics or song names. It’s either ridiculous and funny or impressive. I’d be very curious to see what a full length (or even short) film fully created with AI looks like, and it sounds like it won’t be long until I do! I was also drawn to this because the words to artwork is in the same vein as words to workflows, so it feels relevant to what the Shipyard team is currently working on. - Joseph McDermott
Fine, let’s talk about Data Contracts
Benn dissects the hottest buzzword in data right now - Data Contracts. He argues that data contracts should be more than “TSA for your warehouse”. Instead, existing data schemas could be leveraged to prevent bad data from getting in, or out, of your warehouse, building more trust in the organization. - Blake Burch
A complete guide to git for beginners
Anyone working in data will need to use git. After reading this you will have enough git commands under your belt to get up and running. Even if you’re not a git beginner, you still may find a few tips in here that are useful (I did) - Wes Poulsen
You Can’t Out-Architect Bad Data
As a QA specialist, it is nice to see a solid article reminding us that you can’t be perfect. The best approach is to set your system up to be able to react to issues that come up. You’ll never not have issues come up and the author does a good job pointing out the different areas where issues can come from. - Jon Davidson
Top 30 Machine Learning Influencers to Follow in 2023
The data field is ever changing. If you like to keep up with the most recent trends, it helps to follow leaders in the field. ML Techniques does a great job of outlining some of them to follow. - Steven Johnson
Event Review - Coalesce 2022
Monica does a great job at capturing all of the best sessions at dbt Coalesce 2022 and what you can take away from them. If you weren’t able to attend, this is the best way to cover the highlights and get up to speed. - Blake Burch