All Hands on Data #57
AI, AI, oh my! Will AI save data? Check out that article as well as the other articles below centered around the topic of AI and LLMs.
Will AI Save Data?
David explores how AI is just a tool. It's not going to replace jobs. It's not inherently evil. We'll inevitably find ways to use it that make us more productive and reduce the amount of monotonous overhead associated with Data Engineering. In a state where the industry needs consolidation and simplification to work with data, shouldn't we be welcoming AI to usher in a more utopic state? - Blake Burch
Reimagining LLMs: one industry they will change forever (and no one will complain)
While many people panic about impending upheavals due to the introduction of productive LLMs, the author makes the case that in data engineering they could be immensely helpful. There are a lot of really boring and tedious tasks that data engineers could leverage LLMs for. My SQL illiteracy may finally be fully hidden. - John Forstmeier
How to Effectively Start Coding in the Era of ChatGPT
In many smaller companies, those tasked with working with data are often a team of one or a team of few. This oftentimes means having some coding knowledge, such as Python. This article does a terrific job of outlining how to learn coding basics, with the help of ChatGPT and other resources, without relying on them to do the work for you. Think of them as your 24/7 teaching assistant. - Shawn Fergus
The ChatGPT prompts every data engineer should know
This article is a fun blend of the newest AI trends and information our ideal persona would find useful - Angel Catalan
Harvard's New Computer Science Teacher Is a Chatbot
I agree with Harvard's approach to including AI as a teaching tool for early CS courses. While other AI chatbots like ChatGPT have been deemed "too helpful" to foster true learning, Harvard's in-house chat solution can hopefully find the sweet spot of being helpful without doing all the work when learning how to code. - Arynn Martin-Post
Closing the Gap Between Human Understanding and Machine Learning: Explainable AI as a Solution
Explainable AI (XAI) is not something I had read about before. XAI is an intriguing concept, especially for someone that greatly values transparency as a cornerstone of trust-building. How does one balance the effectiveness of complex models and their interpretability? Kadam provides some great guidelines on how to do just that. - Katt Baum