All Hands on Data #102

There's two types of data folk this week, those at Snowflake Summit and those that aren't. Whether you need to escape the madness of the conference or need a break from the FOMO, we've got you covered

Article Recommendations

Building a data pipeline using Snowflake primitives

I love simplifying things (that's why I love Shipyard) and the author makes the case that using features provided by Snowflake, you can effectively "flatten" your data architecture. It's super appealing, particularly for a pretty simple/straightforward pipeline, to have most of the architecture all live within the same application. No code (architecture) is good code (architecture). - John Forstmeier

Day 1 Summit Overview

Starting a new data job can feel like drinking from a fire hose of data. Figuring out a new company's infra, building relationships, and proving your worth all while jumping onto projects with barely any info? New hires need resources that skip the fancy talk and give them real-world help. 5X's recently concluded Day1 Summit offers valuable resources for new data hires. - Jagdish Purohit from 5X

Data Libraries - the Secret Sauce to Regulatory Environments

This article explores how well-managed data libraries play a crucial role in navigating regulatory compliance challenges and driving efficiencies. It underscores the significance of centralizing data for informed decision-making and streamlined compliance processes, offering practical tips for optimizing resource allocation and reducing redundancy. Whether grappling with compliance issues or aiming to enhance operational efficiency, this article provides valuable strategies for leveraging data organization effectively in a data-driven landscape. - Jon Davidson

Data by Design

While this strays from the typical articles we share, Data by Design is series of in-depth interactive articles that walk through the history of data visualization through the lens of colonialism. While I have yet to read through all of the material, it is extremely well researched and provides engaging perspectives that are worth digging into. - Blake Burch

Podcast Recommendations

Vanishing Gradients - May 30, 2024 - Episode 27: How to Build Terrible AI Systems

Hugo speaks with Jason Liu, an independent consultant who uses his expertise in recommendation systems to help fast-growing startups build out their RAG applications. Jason talks about leveraging large language models to build AI apps, consulting for startups on building production LLM systems, avoiding common pitfalls, and taking an inverted thinking approach to build robust low latency AI. He discusses the future of AI engineering roles and shares lessons on maintaining simplicity.

The Analytics Power Hour - May 27, 2024 - I've Got 99 Analytical Methodologies and Need to Pick Just One

In this lively discussion, data experts share their struggles with picking the right analytical methodology for any given business question. With humor and humility, they admit there are no easy answers, but offer great tips like start simple, check assumptions, explain uncertainty, and learn by doing.