If every meeting starts by debating the numbers, you've already lost.
Learn how to build time-saving shared metrics that drive better results.
https://jeffbailey.us/blog/2026/07/09/fundamentals-of-analytics-engineering/
#AnalyticsEngineering #SoftwareFundamentals #Programming #SoftwareEngineering
Learn how to build time-saving shared metrics that drive better results.
https://jeffbailey.us/blog/2026/07/09/fundamentals-of-analytics-engineering/
#AnalyticsEngineering #SoftwareFundamentals #Programming #SoftwareEngineering
Fundamentals of Analytics Engineering
Analytics engineering fundamentals: the role between data engineering and analysis, ELT, the transformation layer, testing, and the semantic layer.
jeffbailey.us
August 14, 2026 at 7:35 PM
If every meeting starts by debating the numbers, you've already lost.
Learn how to build time-saving shared metrics that drive better results.
https://jeffbailey.us/blog/2026/07/09/fundamentals-of-analytics-engineering/
#AnalyticsEngineering #SoftwareFundamentals #Programming #SoftwareEngineering
Learn how to build time-saving shared metrics that drive better results.
https://jeffbailey.us/blog/2026/07/09/fundamentals-of-analytics-engineering/
#AnalyticsEngineering #SoftwareFundamentals #Programming #SoftwareEngineering
Setting up #dbtcore in #apacheairflow? Stop. Another life is possible
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
Easiest way to run dbt Core! How to run dbt Core in Production with Orchestra #dbt #analytics
YouTube video by Orchestra
www.youtube.com
December 27, 2024 at 10:29 AM
Setting up #dbtcore in #apacheairflow? Stop. Another life is possible
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
🚀 We're hiring a Tech Lead for Analytics Engineering! 📍Remote | 🇺🇸 US only. Lead our next-gen analytics projects. #TechJobs #RemoteWork #AnalyticsEngineering educativ.net/jobs/job/306...
January 26, 2025 at 7:32 PM
🚀 We're hiring a Tech Lead for Analytics Engineering! 📍Remote | 🇺🇸 US only. Lead our next-gen analytics projects. #TechJobs #RemoteWork #AnalyticsEngineering educativ.net/jobs/job/306...
October 27, 2024 at 6:01 PM
Data analysts prepping reports before the next board meeting.
#dataengineering #analytics #analyticsengineering #meme
#dataengineering #analytics #analyticsengineering #meme
April 13, 2024 at 6:14 PM
Data analysts prepping reports before the next board meeting.
#dataengineering #analytics #analyticsengineering #meme
#dataengineering #analytics #analyticsengineering #meme
What other tips do you have for quality git commits?
#dataengineering #analyticsengineering #dataops #dataplatform #git
#dataengineering #analyticsengineering #dataops #dataplatform #git
April 2, 2024 at 9:43 AM
What other tips do you have for quality git commits?
#dataengineering #analyticsengineering #dataops #dataplatform #git
#dataengineering #analyticsengineering #dataops #dataplatform #git
The 1 most overlooked productivity tool for epic data professionals?
Password manager.
Now, stop whatever you are doing, download a free password manager, and save your credentials to your vault the next time you need to log in.
#dataengineering #analyticsengineering
Password manager.
Now, stop whatever you are doing, download a free password manager, and save your credentials to your vault the next time you need to log in.
#dataengineering #analyticsengineering
January 19, 2024 at 4:00 AM
The 1 most overlooked productivity tool for epic data professionals?
Password manager.
Now, stop whatever you are doing, download a free password manager, and save your credentials to your vault the next time you need to log in.
#dataengineering #analyticsengineering
Password manager.
Now, stop whatever you are doing, download a free password manager, and save your credentials to your vault the next time you need to log in.
#dataengineering #analyticsengineering
5 Qualities of Badass Analytics Engineers
1. Curiosity
2. Leadership
3. Consistency
4. Attention to detail
5. Critical thinking
#data #analytics #dataengineering #moderndatastack #analyticsengineering
1. Curiosity
2. Leadership
3. Consistency
4. Attention to detail
5. Critical thinking
#data #analytics #dataengineering #moderndatastack #analyticsengineering
January 17, 2024 at 6:00 AM
5 Qualities of Badass Analytics Engineers
1. Curiosity
2. Leadership
3. Consistency
4. Attention to detail
5. Critical thinking
#data #analytics #dataengineering #moderndatastack #analyticsengineering
1. Curiosity
2. Leadership
3. Consistency
4. Attention to detail
5. Critical thinking
#data #analytics #dataengineering #moderndatastack #analyticsengineering
Great walkthrough on building a robust data quality score using dbt + Elementary Data. Clear, actionable, and perfect for modern data teams. medium.com/@alexandroab... #DataEngineering #AnalyticsEngineering #dbt #DataQuality #Data
How to build a Data Quality Score with DBT + Elementary Data
A practical approach to quantify and visualize data reliability
medium.com
November 17, 2025 at 8:09 AM
Great walkthrough on building a robust data quality score using dbt + Elementary Data. Clear, actionable, and perfect for modern data teams. medium.com/@alexandroab... #DataEngineering #AnalyticsEngineering #dbt #DataQuality #Data
🔍 Tu dashboard se ve bien, pero los datos mienten
https://dzone.com/articles/mutation-testing-analytics
#AnalyticsEngineering #DataQuality #MutationTesting #TechTips
https://dzone.com/articles/mutation-testing-analytics
#AnalyticsEngineering #DataQuality #MutationTesting #TechTips
June 7, 2026 at 11:25 AM
🔍 Tu dashboard se ve bien, pero los datos mienten
https://dzone.com/articles/mutation-testing-analytics
#AnalyticsEngineering #DataQuality #MutationTesting #TechTips
https://dzone.com/articles/mutation-testing-analytics
#AnalyticsEngineering #DataQuality #MutationTesting #TechTips
The loop: code → review → handoff → skills update. Every session makes the next one smarter. One aggregation bug became a permanent rule enforced automatically.
@doriwilson.com broke it all down at Data Debug SF. Full writeup:
blog.reccehq.com/ai-skills-fo...
#DataEngineering #AnalyticsEngineering
@doriwilson.com broke it all down at Data Debug SF. Full writeup:
blog.reccehq.com/ai-skills-fo...
#DataEngineering #AnalyticsEngineering
A Practical Guide to AI Skills for Analytics Engineering
I built a self-improving AI skill system for analytics engineering at Recce. Here's the framework, a real bug it caught, and how we scaled it.
blog.reccehq.com
April 1, 2026 at 8:02 PM
The loop: code → review → handoff → skills update. Every session makes the next one smarter. One aggregation bug became a permanent rule enforced automatically.
@doriwilson.com broke it all down at Data Debug SF. Full writeup:
blog.reccehq.com/ai-skills-fo...
#DataEngineering #AnalyticsEngineering
@doriwilson.com broke it all down at Data Debug SF. Full writeup:
blog.reccehq.com/ai-skills-fo...
#DataEngineering #AnalyticsEngineering
Auto-diff every model on every PR?
You’ll get ⚠️ dozens of alerts, irrelevant!
CI without context = alert spam.
Real-world data work needs: what changed, why, and what to do.
Learn how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
You’ll get ⚠️ dozens of alerts, irrelevant!
CI without context = alert spam.
Real-world data work needs: what changed, why, and what to do.
Learn how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
June 24, 2025 at 3:01 AM
Auto-diff every model on every PR?
You’ll get ⚠️ dozens of alerts, irrelevant!
CI without context = alert spam.
Real-world data work needs: what changed, why, and what to do.
Learn how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
You’ll get ⚠️ dozens of alerts, irrelevant!
CI without context = alert spam.
Real-world data work needs: what changed, why, and what to do.
Learn how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
Data diff tells you something changed. but NOT:
❓ Was it expected?
⛏️ Worth investigating?
🔗 What depends on it?
Let’s stop mistaking output for insight.
See how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
❓ Was it expected?
⛏️ Worth investigating?
🔗 What depends on it?
Let’s stop mistaking output for insight.
See how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
June 17, 2025 at 3:00 AM
Data diff tells you something changed. but NOT:
❓ Was it expected?
⛏️ Worth investigating?
🔗 What depends on it?
Let’s stop mistaking output for insight.
See how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
❓ Was it expected?
⛏️ Worth investigating?
🔗 What depends on it?
Let’s stop mistaking output for insight.
See how 👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
"The value didn't justify the effort."
A Sr. Data Engineer at Swedish MediaTech after their Datafold PoC.
❌ Heavy setup → Noisy results → Alert fatigue → No way to start small
Comparsion: datarecce.io/blog/recce-v...
#DataEngineering #DataValidation #analyticsengineering
A Sr. Data Engineer at Swedish MediaTech after their Datafold PoC.
❌ Heavy setup → Noisy results → Alert fatigue → No way to start small
Comparsion: datarecce.io/blog/recce-v...
#DataEngineering #DataValidation #analyticsengineering
June 11, 2025 at 8:00 AM
"The value didn't justify the effort."
A Sr. Data Engineer at Swedish MediaTech after their Datafold PoC.
❌ Heavy setup → Noisy results → Alert fatigue → No way to start small
Comparsion: datarecce.io/blog/recce-v...
#DataEngineering #DataValidation #analyticsengineering
A Sr. Data Engineer at Swedish MediaTech after their Datafold PoC.
❌ Heavy setup → Noisy results → Alert fatigue → No way to start small
Comparsion: datarecce.io/blog/recce-v...
#DataEngineering #DataValidation #analyticsengineering
Don’t start with what changed. Start with what SHOULD change!
Because not every diff is a problem, and not every problem shows up as a diff.
👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
Because not every diff is a problem, and not every problem shows up as a diff.
👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
June 10, 2025 at 3:49 AM
Don’t start with what changed. Start with what SHOULD change!
Because not every diff is a problem, and not every problem shows up as a diff.
👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
Because not every diff is a problem, and not every problem shows up as a diff.
👉 datarecce.io/blog/more-th...
#dataengineering #datadiff #analyticsengineering #datavalidation
Type 2: Renamed
Same data, new name.
SELECT user_id AS id FROM {{ ref("users") }}
✅ id is just an alias of user_id
#analyticsengineering #sql #datamodeling
Same data, new name.
SELECT user_id AS id FROM {{ ref("users") }}
✅ id is just an alias of user_id
#analyticsengineering #sql #datamodeling
May 22, 2025 at 3:24 AM
Type 2: Renamed
Same data, new name.
SELECT user_id AS id FROM {{ ref("users") }}
✅ id is just an alias of user_id
#analyticsengineering #sql #datamodeling
Same data, new name.
SELECT user_id AS id FROM {{ ref("users") }}
✅ id is just an alias of user_id
#analyticsengineering #sql #datamodeling
Understanding how columns are transformed in a dbt model is critical for impact analysis, QA, and trust in your pipeline
Here are the 5 column transformation types you should know...
🧵👇
#dbt #dataengineering #analyticsengineering
Here are the 5 column transformation types you should know...
🧵👇
#dbt #dataengineering #analyticsengineering
May 22, 2025 at 3:24 AM
Understanding how columns are transformed in a dbt model is critical for impact analysis, QA, and trust in your pipeline
Here are the 5 column transformation types you should know...
🧵👇
#dbt #dataengineering #analyticsengineering
Here are the 5 column transformation types you should know...
🧵👇
#dbt #dataengineering #analyticsengineering
Stop duplicating dashboards to preview the impact of dbt model changes!
With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity.
medium.com/inthepipelin...
#dbt #DataOps #SQL #data #analyticsengineering
With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity.
medium.com/inthepipelin...
#dbt #DataOps #SQL #data #analyticsengineering
Stop duplicating dashboards just to preview dbt changes
Share data impact with stakeholders instantly: one click, zero guesswork
medium.com
May 15, 2025 at 12:56 AM
Stop duplicating dashboards to preview the impact of dbt model changes!
With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity.
medium.com/inthepipelin...
#dbt #DataOps #SQL #data #analyticsengineering
With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity.
medium.com/inthepipelin...
#dbt #DataOps #SQL #data #analyticsengineering
Recce is open-source, so you can review the full code:
github.com/datarecce/re...
We also accept:
- issues
- feature requests
- bug fixes
#DataEngineering #dbt #Recce #DataRecce #CI #SQL #DataQuality #AnalyticsEngineering
github.com/datarecce/re...
We also accept:
- issues
- feature requests
- bug fixes
#DataEngineering #dbt #Recce #DataRecce #CI #SQL #DataQuality #AnalyticsEngineering
GitHub - DataRecce/recce: The data-validation toolkit for enhanced dbt (data build tool) PR review
The data-validation toolkit for enhanced dbt (data build tool) PR review - DataRecce/recce
github.com
January 24, 2025 at 5:55 AM
Recce is open-source, so you can review the full code:
github.com/datarecce/re...
We also accept:
- issues
- feature requests
- bug fixes
#DataEngineering #dbt #Recce #DataRecce #CI #SQL #DataQuality #AnalyticsEngineering
github.com/datarecce/re...
We also accept:
- issues
- feature requests
- bug fixes
#DataEngineering #dbt #Recce #DataRecce #CI #SQL #DataQuality #AnalyticsEngineering
Dive deeper 👉 medium.com/inthepipelin...
What’s the biggest challenge you face when implementing and maintaining your dbt project?
#dbt #DataEngineering #DataInfrastructure #analytics #AnalyticsEngineering
What’s the biggest challenge you face when implementing and maintaining your dbt project?
#dbt #DataEngineering #DataInfrastructure #analytics #AnalyticsEngineering
dbt best practices in action at Cal-ITP’s data-infra project
Cal-ITP uses a standardized PR template and automated report for comprehensive PR review. See their process in-action with example PRs
medium.com
December 30, 2024 at 2:48 AM
Dive deeper 👉 medium.com/inthepipelin...
What’s the biggest challenge you face when implementing and maintaining your dbt project?
#dbt #DataEngineering #DataInfrastructure #analytics #AnalyticsEngineering
What’s the biggest challenge you face when implementing and maintaining your dbt project?
#dbt #DataEngineering #DataInfrastructure #analytics #AnalyticsEngineering
Analytics engineers don't work alone - data validation involves stakeholders and PR reviewers
With Recce, Share your complete data validation environment with your team and review data impact together:
medium.com/inthepipelin...
#data #dbt #dataengineering #analyticsengineering
With Recce, Share your complete data validation environment with your team and review data impact together:
medium.com/inthepipelin...
#data #dbt #dataengineering #analyticsengineering
Enhanced dbt PR Review with Reproducible Data Validation Environments
You have a reproducible data pipeline, now you can have a reproducible data validation environment
medium.com
November 27, 2024 at 8:02 AM
Analytics engineers don't work alone - data validation involves stakeholders and PR reviewers
With Recce, Share your complete data validation environment with your team and review data impact together:
medium.com/inthepipelin...
#data #dbt #dataengineering #analyticsengineering
With Recce, Share your complete data validation environment with your team and review data impact together:
medium.com/inthepipelin...
#data #dbt #dataengineering #analyticsengineering
Node-selection is extremely useful for saving time and resources when building your dbt project.
Now you can use the same logic to scope your automated data checks for validating modeling changes in PR review
medium.com/inthepipelin...
#dbt #DataEngineering #AnalyticsEngineering #data
Now you can use the same logic to scope your automated data checks for validating modeling changes in PR review
medium.com/inthepipelin...
#dbt #DataEngineering #AnalyticsEngineering #data
Leverage Node-Selection for Data Validation Checks in dbt PR Reviews
Automate data checks on resource groups for comprehensive dbt PR review
medium.com
July 10, 2024 at 9:38 AM
Node-selection is extremely useful for saving time and resources when building your dbt project.
Now you can use the same logic to scope your automated data checks for validating modeling changes in PR review
medium.com/inthepipelin...
#dbt #DataEngineering #AnalyticsEngineering #data
Now you can use the same logic to scope your automated data checks for validating modeling changes in PR review
medium.com/inthepipelin...
#dbt #DataEngineering #AnalyticsEngineering #data
This post about Makefile for dbt got some good feedback!
The best thing was the alternative suggestions:
- Task
- Click
- Invoke
What are you using to as a task runner / custom CLI interface fot dbt (or your data tool of choice)?
#DataEngineering #AnalyticsEngineering #Data #SQL #Analytics
The best thing was the alternative suggestions:
- Task
- Click
- Invoke
What are you using to as a task runner / custom CLI interface fot dbt (or your data tool of choice)?
#DataEngineering #AnalyticsEngineering #Data #SQL #Analytics
Do you use a makefile to manage your #dbt commands?
Mainly used for compiling code, you can actually use a makefile to run any commands
A makefile a great way to
- reduce command fatigue
- group commands
- abstract your common tasks
medium.com/inthepipelin...
#dataengineering #analytics #data
Mainly used for compiling code, you can actually use a makefile to run any commands
A makefile a great way to
- reduce command fatigue
- group commands
- abstract your common tasks
medium.com/inthepipelin...
#dataengineering #analytics #data
How to use a Makefile to speed up your dbt project workflow
Learn how to use a makefile to reduce dbt command fatigue and group related commands for easy reuse and sharing.
medium.com
June 19, 2024 at 1:01 AM
This post about Makefile for dbt got some good feedback!
The best thing was the alternative suggestions:
- Task
- Click
- Invoke
What are you using to as a task runner / custom CLI interface fot dbt (or your data tool of choice)?
#DataEngineering #AnalyticsEngineering #Data #SQL #Analytics
The best thing was the alternative suggestions:
- Task
- Click
- Invoke
What are you using to as a task runner / custom CLI interface fot dbt (or your data tool of choice)?
#DataEngineering #AnalyticsEngineering #Data #SQL #Analytics
Reviewing PRs with Recce CI is as easy as 1-2-3:
1. Download the Recce CI state file from your PR comment
2. Launch Recce in review mode
3. Review the checklist results comparing your two dbt environments
datarecce.io/docs/guides/...
#dbt #dataengineering #analyticsengineering
1. Download the Recce CI state file from your PR comment
2. Launch Recce in review mode
3. Review the checklist results comparing your two dbt environments
datarecce.io/docs/guides/...
#dbt #dataengineering #analyticsengineering
May 2, 2024 at 8:52 AM
Reviewing PRs with Recce CI is as easy as 1-2-3:
1. Download the Recce CI state file from your PR comment
2. Launch Recce in review mode
3. Review the checklist results comparing your two dbt environments
datarecce.io/docs/guides/...
#dbt #dataengineering #analyticsengineering
1. Download the Recce CI state file from your PR comment
2. Launch Recce in review mode
3. Review the checklist results comparing your two dbt environments
datarecce.io/docs/guides/...
#dbt #dataengineering #analyticsengineering
Zero to #dbt with 'Spodbtify'
Learn more about analytics engineering with Spotify's Million Playlist Dataset Part 1:
- download the dataset (30GB of json!)
- duckdb + jq for exploration
- convert to 5.7GB parquet
medium.com/inthepipelin...
#dataengineering #analyticsengineering
Learn more about analytics engineering with Spotify's Million Playlist Dataset Part 1:
- download the dataset (30GB of json!)
- duckdb + jq for exploration
- convert to 5.7GB parquet
medium.com/inthepipelin...
#dataengineering #analyticsengineering
From Zero to dbt: How to Analyze and Build Data Models from Spotify’s Million Playlist Data
Part 1: Analyze the 30GB json dataset with DuckDb and jq, then convert to Parquet to prep for dbt
medium.com
April 16, 2024 at 2:32 AM
Zero to #dbt with 'Spodbtify'
Learn more about analytics engineering with Spotify's Million Playlist Dataset Part 1:
- download the dataset (30GB of json!)
- duckdb + jq for exploration
- convert to 5.7GB parquet
medium.com/inthepipelin...
#dataengineering #analyticsengineering
Learn more about analytics engineering with Spotify's Million Playlist Dataset Part 1:
- download the dataset (30GB of json!)
- duckdb + jq for exploration
- convert to 5.7GB parquet
medium.com/inthepipelin...
#dataengineering #analyticsengineering