All Hands on Data #80
This week's AHoD covers the full data spectrum from Data Engineer to Analytics Engineer to BI Analyst. Check it out below!
AI product development is being held back by data engineering. It’s time to do something about it
While the article ultimately pitches the company's product, it does raise an interesting point: data analytics teams have previously been able to glean a large percentage of value from their data but with the advent of LLMs, that percentage has dropped. There will always be a need for these analytics teams but a lot of time, thought, and energy will be needed to properly integrate AI into data strategies going forward. - John Forstmeier
Decoding the Future: The Intersection of Advanced Analytics and Fraud Prevention in Revolutionizing Digital Payments
According to Lee, online payment fraud hit a whopping $48 billion in 2023! Businesses have fortified their defenses with AI and ML to spot fishy patterns and weird anomalies in transactions. This approach includes analyzing huge amounts of data and using algorithms to predict and prevent fraud, hopefully making digital payments safer for everyone. - Katt Baum
How AI Can Scale Data Analytics
This article lays some foundational ways you can combine the worlds of AI and data. With the microscopic focus on AI right now, it's important that folks realize that AI can help supplement data analytics, not replace it. - Angel Catalan
From Big Screens to Paper Printouts: Adapting Your Dashboard for Different Formats
Color, design, style, chart selection? All great things to consider when visualizing your data, but you might be forgetting one key aspect...the dashboard format for your client. There are so many different ways to view your dashboard - mobile, desktop...heck maybe even augmented reality! It's important to consider how your data might be viewed, and this article does a great job of breaking down each format. - Reed Cowan
Kubernetes for Data Engineers
This is a great quick intro to Kubernetes (if you're unfamiliar) as well as a small demo into how to get started. It is likely that at some point using Kubernetes may benefit your team as you no longer have to leverage tools like EC2 for deployment - Wes Poulsen
3 Reasons Why Working With Data Build Tool (dbt) Is Not "Just Doing SQL"
I've talked to a lot of people over the past 3 years about dbt. The conversation almost always gets to the point where the other person says, "Isn't that just a place to do SQL." You would think after getting that line multiple times that I would have a response, however I generally just agree and move on. Luis gives me some ammunition the next time this conversation comes up. If you have been thinking about converting your dbt Cloud instance into dbt Core, I just released a video outlining that process as well! - Steven Johnson