All Hands on Data #86
Welcome to version of 86 of All Hands on Data! This week we welcome our newest member of the AHoD team, Jack Ryan. See his first submission along with the rest of the teams below!
Top orchestration trends 2024
Low code data integration particularly is interesting based off the fact that at Shipyard our open source, low-code blue prints accelerate time to orchestration on the premise of this concept. It being a trend in 2024 points to putting at the forefront of the market. - Jack Ryan
Data and product to engineer ratio at 50 tech scaleups
In a throwback to early 2023, the author uses publicly-available data to look into 50 later-stage startup job makeup between engineering, data, and product. My big takeaway is that even for the companies that lean on data, at most only 5% of the headcount appears to be dedicated to the effort. Probably need some good data orchestration... ; ) - John Forstmeier
Can large language models detect sarcasm?
Fadelli discusses a research study done by Juliann Zhou to assess the ability of LLMs in detecting sarcasm. Sarcasm has been known to trip up LLMs during sentimental analysis. Zhou tested CASCADE (a context-driven model) and RCNN-RoBERTa (a model using neural network and transformer architecture) against Reddit comments and they are promising. Future experiments may explore augmenting transformers with more contextual information for better performance. - Katt Baum
These Words Make it Obvious That Your Text is Written By AI
As someone who posts to social media as part of their job, a common theme in the space is to use LLM to generate posts for you. However, I feel like it is pretty obvious when the post is written by a LLM versus a human. This article lays out some red flags to wave if you think you are reading something by a bot. - Steven Johnson
Having a Comprehensive Dashboard Strategy for Analytics Managers
I loved the comparison Gomes draws between open world video games and business analytics dashboards. Identifying standard needs vs edge cases (main vs side quests), creating a knowledge management system (adventure log), and improving the boards as users get more aquatinted with the tool (patches). - Katt Baum
How to craft the perfect data engineer resume and LinkedIn profile in 2024
This article offers some very practical tips on updating your LinkedIn profile and resume specifically for a data engineering role. Even though this is oriented for DE roles, it is not limited to that necessarily and is good general advice nonetheless - Wes Poulsen