🛠️ Software Engineering Craft at #CommunityOverCode Sydney, 18–19 Nov
War stories: replacing Jenkins -> Airflow, shipping DAGs as Bazel targets, the hidden depth of snapshots, collations in Apache Spark & Spring Boot code an AI agent can read.
#ApacheAirflow #ApacheSpark #DevEx #ChurConf @apache.org
War stories: replacing Jenkins -> Airflow, shipping DAGs as Bazel targets, the hidden depth of snapshots, collations in Apache Spark & Spring Boot code an AI agent can read.
#ApacheAirflow #ApacheSpark #DevEx #ChurConf @apache.org
October 27, 2026 at 6:05 AM
🛠️ Software Engineering Craft at #CommunityOverCode Sydney, 18–19 Nov
War stories: replacing Jenkins -> Airflow, shipping DAGs as Bazel targets, the hidden depth of snapshots, collations in Apache Spark & Spring Boot code an AI agent can read.
#ApacheAirflow #ApacheSpark #DevEx #ChurConf @apache.org
War stories: replacing Jenkins -> Airflow, shipping DAGs as Bazel targets, the hidden depth of snapshots, collations in Apache Spark & Spring Boot code an AI agent can read.
#ApacheAirflow #ApacheSpark #DevEx #ChurConf @apache.org
Apache fixes 12 Apache Kylin vulnerabilities, including critical CVE-2026-64959, plus Apache Airflow SSH flaws. Upgrade Kylin to 5.0.5 now.
#ApacheKylin #ApacheAirflow #ApacheAnswer #CVE202664959 #CVE202668571 #CVE202694134 #SQLInjection #CyberSecurity
#ApacheKylin #ApacheAirflow #ApacheAnswer #CVE202664959 #CVE202668571 #CVE202694134 #SQLInjection #CyberSecurity
Apache Fixes 12 Kylin Flaws, Including Critical SQL Injection, Plus Airflow and Answer Bugs
TL;DR On October 16, 2026, Apache disclosed 12 Apache Kylin vulnerabilities, including a critical SQL injection flaw, CVE-2026-64959. Version 5.0.5 fixes all of them. Meanwhile, Apache Airflow patched three provider flaws, and Apache Answer users should watch for a fixed release. Why It Matters Apache Kylin is an analytics engine that runs fast queries over large data sets. It often holds sensitive business data.
securityonline.info
October 19, 2026 at 12:25 AM
Apache fixes 12 Apache Kylin vulnerabilities, including critical CVE-2026-64959, plus Apache Airflow SSH flaws. Upgrade Kylin to 5.0.5 now.
#ApacheKylin #ApacheAirflow #ApacheAnswer #CVE202664959 #CVE202668571 #CVE202694134 #SQLInjection #CyberSecurity
#ApacheKylin #ApacheAirflow #ApacheAnswer #CVE202664959 #CVE202668571 #CVE202694134 #SQLInjection #CyberSecurity
CVE-2026-86473 - apache airflow
When users sign out of Apache Airflow using a bearer token in the Authorization header, the system only clears the browser cookie and leaves the token active…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
When users sign out of Apache Airflow using a bearer token in the Authorization header, the system only clears the browser cookie and leaves the token active…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
CVE-2026-86473: Apache Airflow logout does not revoke bearer token
When users sign out of Apache Airflow using a bearer token in the Authorization header, the system only clears the browser cookie and leaves the token.
stackflag.com
September 21, 2026 at 7:20 PM
CVE-2026-86473 - apache airflow
When users sign out of Apache Airflow using a bearer token in the Authorization header, the system only clears the browser cookie and leaves the token active…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
When users sign out of Apache Airflow using a bearer token in the Authorization header, the system only clears the browser cookie and leaves the token active…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
If you answer "Copy-paste 50 Python files" in an Airflow interview, the interview is over. 💀
Here’s how real Data Engineers turn 50 database tables into 50 automated DAGs using Dynamic DAG Generation (without crashing the Scheduler): 👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
Here’s how real Data Engineers turn 50 database tables into 50 automated DAGs using Dynamic DAG Generation (without crashing the Scheduler): 👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
Airflow Interview Question : Dynamic DAG Generation in Airflow: How to Turn 50 Tables Into 50 DAGs…
Stop copy-pasting DAG files. Here’s how senior data engineers generate dozens (or hundreds) of Airflow DAGs from a single script.
medium.com
August 23, 2026 at 1:10 PM
If you answer "Copy-paste 50 Python files" in an Airflow interview, the interview is over. 💀
Here’s how real Data Engineers turn 50 database tables into 50 automated DAGs using Dynamic DAG Generation (without crashing the Scheduler): 👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
Here’s how real Data Engineers turn 50 database tables into 50 automated DAGs using Dynamic DAG Generation (without crashing the Scheduler): 👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
"Your Airflow DAG ran twice for the same date and corrupted the production database."
This single scenario trips up 80% of Data Engineers in technical interviews.
Here is why it happens (and how to fix it):
👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
This single scenario trips up 80% of Data Engineers in technical interviews.
Here is why it happens (and how to fix it):
👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
Data Enginner Interview Question : Why your Airflow Pipeline Ran Twice?
Data Enginner Interview Question : Why your Airflow Pipeline Ran Twice? Did Your Data Just Double? 😱 Picture this: it’s 2 AM, your Airflow DAG for daily_revenue_metrics fails halfway through …
medium.com
August 21, 2026 at 4:26 AM
"Your Airflow DAG ran twice for the same date and corrupted the production database."
This single scenario trips up 80% of Data Engineers in technical interviews.
Here is why it happens (and how to fix it):
👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
This single scenario trips up 80% of Data Engineers in technical interviews.
Here is why it happens (and how to fix it):
👇
medium.com/@sriwworldof...
#DataEngineering #ApacheAirflow
How do you wait for hours in @ApacheAirflow without wasting worker slots or freezing DAG execution
This is a classic Senior Data Engineer interview question.
Here is the breakdown of poke vs reschedule vs deferrable operators 🧵👇
This is a classic Senior Data Engineer interview question.
Here is the breakdown of poke vs reschedule vs deferrable operators 🧵👇
August 15, 2026 at 3:35 AM
How do you wait for hours in @ApacheAirflow without wasting worker slots or freezing DAG execution
This is a classic Senior Data Engineer interview question.
Here is the breakdown of poke vs reschedule vs deferrable operators 🧵👇
This is a classic Senior Data Engineer interview question.
Here is the breakdown of poke vs reschedule vs deferrable operators 🧵👇
Airflow task says "RUNNING" for 4 hours, but nothing is happening? 💀
You're dealing with a Zombie Task.
The worker process died (OOM / Pod eviction), but the metadata database never got the message.
Here is how to catch & prevent them 🧵 👇
#DataEngineering #ApacheAirflow
You're dealing with a Zombie Task.
The worker process died (OOM / Pod eviction), but the metadata database never got the message.
Here is how to catch & prevent them 🧵 👇
#DataEngineering #ApacheAirflow
August 14, 2026 at 10:27 AM
Airflow task says "RUNNING" for 4 hours, but nothing is happening? 💀
You're dealing with a Zombie Task.
The worker process died (OOM / Pod eviction), but the metadata database never got the message.
Here is how to catch & prevent them 🧵 👇
#DataEngineering #ApacheAirflow
You're dealing with a Zombie Task.
The worker process died (OOM / Pod eviction), but the metadata database never got the message.
Here is how to catch & prevent them 🧵 👇
#DataEngineering #ApacheAirflow
Writing a Python for loop in your Airflow DAG to create dynamic tasks looks clean... until your scheduler CPU hits 100%.
Top-level loop calls run at Parse Time (every ~30s), choking your Airflow cluster.
Here is why you should use Dynamic Task Mapping (.expand())
#DataEngineering #ApacheAirflow
Top-level loop calls run at Parse Time (every ~30s), choking your Airflow cluster.
Here is why you should use Dynamic Task Mapping (.expand())
#DataEngineering #ApacheAirflow
August 13, 2026 at 4:32 AM
Writing a Python for loop in your Airflow DAG to create dynamic tasks looks clean... until your scheduler CPU hits 100%.
Top-level loop calls run at Parse Time (every ~30s), choking your Airflow cluster.
Here is why you should use Dynamic Task Mapping (.expand())
#DataEngineering #ApacheAirflow
Top-level loop calls run at Parse Time (every ~30s), choking your Airflow cluster.
Here is why you should use Dynamic Task Mapping (.expand())
#DataEngineering #ApacheAirflow
If your Apache Airflow pipeline alerting only uses on_failure_callback, your monitoring is half blind.
A task running 10x longer than usual won't trigger a failure alert—it will just silently delay your entire data platform.
Here is why you need sla_miss_callback 🧵👇
#DataEngineering #ApacheAirflow
A task running 10x longer than usual won't trigger a failure alert—it will just silently delay your entire data platform.
Here is why you need sla_miss_callback 🧵👇
#DataEngineering #ApacheAirflow
August 12, 2026 at 5:27 PM
If your Apache Airflow pipeline alerting only uses on_failure_callback, your monitoring is half blind.
A task running 10x longer than usual won't trigger a failure alert—it will just silently delay your entire data platform.
Here is why you need sla_miss_callback 🧵👇
#DataEngineering #ApacheAirflow
A task running 10x longer than usual won't trigger a failure alert—it will just silently delay your entire data platform.
Here is why you need sla_miss_callback 🧵👇
#DataEngineering #ApacheAirflow
Migrating to #ApacheAirflow Dataset scheduling? Be mindful of existing DAGs use of template variables.
tododataengineering.com/2024/11/26/a...
#dataengineering #data #databs #python
tododataengineering.com/2024/11/26/a...
#dataengineering #data #databs #python
Apache Airflow Template Variables and Dataset scheduled DAGs. · #TODO data engineering
tododataengineering.com
December 19, 2024 at 5:05 PM
Migrating to #ApacheAirflow Dataset scheduling? Be mindful of existing DAGs use of template variables.
tododataengineering.com/2024/11/26/a...
#dataengineering #data #databs #python
tododataengineering.com/2024/11/26/a...
#dataengineering #data #databs #python
🔄 Migrando de AWS Glue a Apache Airflow, ahorra Costos y gana Mayor Flexibilidad
👉 ciberninjas.com/migrando-aws...
#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad
👉 ciberninjas.com/migrando-aws...
#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad
ciberninjas.com
February 17, 2025 at 4:42 PM
🔄 Migrando de AWS Glue a Apache Airflow, ahorra Costos y gana Mayor Flexibilidad
👉 ciberninjas.com/migrando-aws...
#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad
👉 ciberninjas.com/migrando-aws...
#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad
SF Bay Area #BigData fans: discover #Elasticsearch Ingest Node and #ApacheAirflow at tomorrow night's meetup http://meetu.ps/2X8Q1s
Login to Meetup | Meetup
Not a Meetup member yet? Log in and find groups that host online or in person events and meet people in your local community who share your interests.
meetu.ps
November 14, 2024 at 11:38 PM
SF Bay Area #BigData fans: discover #Elasticsearch Ingest Node and #ApacheAirflow at tomorrow night's meetup http://meetu.ps/2X8Q1s
Discover #Elasticsearch Ingest Nodes & @ApacheAirflow at next week's Data Ingest Meetup: @Elastic HQ, Mountain View http://www.meetup.com/SF-Bay-Area-Data-Ingest-Meetup/events/231024947/
Login to Meetup | Meetup
Not a Meetup member yet? Log in and find groups that host online or in person events and meet people in your local community who share your interests.
www.meetup.com
November 14, 2024 at 11:36 PM
Discover #Elasticsearch Ingest Nodes & @ApacheAirflow at next week's Data Ingest Meetup: @Elastic HQ, Mountain View http://www.meetup.com/SF-Bay-Area-Data-Ingest-Meetup/events/231024947/
CVE-2026-33264 - apache airflow
A bug in Apache Airflow allowed malicious DAG authors to execute code on the Airflow server, potentially leading to unauthorized access or data breaches. To…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
A bug in Apache Airflow allowed malicious DAG authors to execute code on the Airflow server, potentially leading to unauthorized access or data breaches. To…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
CVE-2026-33264: Apache Airflow: Unrestricted Code Execution via Malicious DAG
A bug in Apache Airflow allowed malicious DAG authors to execute code on the Airflow server, potentially leading to unauthorized access or data breaches.
stackflag.com
July 7, 2026 at 4:22 PM
CVE-2026-33264 - apache airflow
A bug in Apache Airflow allowed malicious DAG authors to execute code on the Airflow server, potentially leading to unauthorized access or data breaches. To…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
A bug in Apache Airflow allowed malicious DAG authors to execute code on the Airflow server, potentially leading to unauthorized access or data breaches. To…
Too many irrelevant or confusing CVEs? Use stackflag.com
#apacheairflow #apachefoundation #CVE #infosec
Setting up #dbtcore in #apacheairflow? Stop. Another life is possible
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
Easiest way to run dbt Core! How to run dbt Core in Production with Orchestra #dbt #analytics
YouTube video by Orchestra
www.youtube.com
December 27, 2024 at 10:29 AM
Setting up #dbtcore in #apacheairflow? Stop. Another life is possible
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
www.youtube.com/watch?v=-XDu...
#dataengineering #analyticsengineering
📣 Demandez l'programme !!!
Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme
"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?
D'ici là, bisous.
#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT
Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme
"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?
D'ici là, bisous.
#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT
Programme des GeoDataDays
www.geodatadays.fr
May 14, 2024 at 8:46 PM
📣 Demandez l'programme !!!
Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme
"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?
D'ici là, bisous.
#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT
Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme
"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?
D'ici là, bisous.
#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT
To vendo tutorial de apacheairflow e o maluco tem a voz igual a do Hermes de Hermes e Renato
February 24, 2025 at 7:35 PM
To vendo tutorial de apacheairflow e o maluco tem a voz igual a do Hermes de Hermes e Renato
Couler provides the following:
- Simplicity: Unified interface and imperative programming style for defining workflows with automatic construction of directed acyclic graph (DAG).
- Extensibility: Extensible to support various workflow engines @argoproj @tektoncd @ApacheAirflow.
- Simplicity: Unified interface and imperative programming style for defining workflows with automatic construction of directed acyclic graph (DAG).
- Extensibility: Extensible to support various workflow engines @argoproj @tektoncd @ApacheAirflow.
November 20, 2024 at 2:00 AM
Couler provides the following:
- Simplicity: Unified interface and imperative programming style for defining workflows with automatic construction of directed acyclic graph (DAG).
- Extensibility: Extensible to support various workflow engines @argoproj @tektoncd @ApacheAirflow.
- Simplicity: Unified interface and imperative programming style for defining workflows with automatic construction of directed acyclic graph (DAG).
- Extensibility: Extensible to support various workflow engines @argoproj @tektoncd @ApacheAirflow.
Fabric Insider Ep. 9 with Wee Hyong Tok
Video 📺 youtu.be/nDPufHNSC5Y
#MicrosoftFabric #DataIntegration #FabricDataFactory #ETL #ApacheAirflow #DBT #CopyJob #FabricInsider #ADF #SSIS #DataEngineering #BusinessIntelligence #FabricAnalytics #MigrationToFabric #AIAgents
Video 📺 youtu.be/nDPufHNSC5Y
#MicrosoftFabric #DataIntegration #FabricDataFactory #ETL #ApacheAirflow #DBT #CopyJob #FabricInsider #ADF #SSIS #DataEngineering #BusinessIntelligence #FabricAnalytics #MigrationToFabric #AIAgents
Fabric Insider Ep. 9 — Data Integration, Migration & Future of ETL Microsoft Fabric | Wee Hyong Tok
YouTube video by RADACAD
youtu.be
July 2, 2026 at 7:08 PM
Fabric Insider Ep. 9 with Wee Hyong Tok
Video 📺 youtu.be/nDPufHNSC5Y
#MicrosoftFabric #DataIntegration #FabricDataFactory #ETL #ApacheAirflow #DBT #CopyJob #FabricInsider #ADF #SSIS #DataEngineering #BusinessIntelligence #FabricAnalytics #MigrationToFabric #AIAgents
Video 📺 youtu.be/nDPufHNSC5Y
#MicrosoftFabric #DataIntegration #FabricDataFactory #ETL #ApacheAirflow #DBT #CopyJob #FabricInsider #ADF #SSIS #DataEngineering #BusinessIntelligence #FabricAnalytics #MigrationToFabric #AIAgents
Apache Airflow 2.1.4 now available. Building DAG workflows https://www.linkedin.com/posts/kaxil_apacheairflow-airflow-dataengineering-activity-6845125976339345408-Uckq/ #Data #BigData #dataengineering
Kaxil Naik on LinkedIn: #apacheairflow #airflow #dataengi...
We’ve just released Apache Airflow 2.1.4 🎉🎉
📦 PyPI: http...
www.linkedin.com
November 24, 2024 at 2:37 PM
Apache Airflow 2.1.4 now available. Building DAG workflows https://www.linkedin.com/posts/kaxil_apacheairflow-airflow-dataengineering-activity-6845125976339345408-Uckq/ #Data #BigData #dataengineering
Blog alert!
A new part in our series on the DP-700 exam. This time, we touch on Apache Airflow.
#DP700
#MicrosoftFabric
#MicrosoftLearn
#ApacheAirflow
A new part in our series on the DP-700 exam. This time, we touch on Apache Airflow.
#DP700
#MicrosoftFabric
#MicrosoftLearn
#ApacheAirflow
DP-700 training: Configure Dataflow Gen2 workspace settings (Apache Airflow)
Welcome to another instalment in the DP-700 learn series. This time we're going to talk about Apache Airflow settings. It's a little bit of a misnomer in the header, maybe, but we have to follow the titles Microsoft offers in the official curriculum. Now, before we dig into the fun techy stuff, let's familiarise ourselves with what Apache Airflow is. I was hoping that it had something to do with air conditioning, but alas.
sqlreitse.com
June 9, 2026 at 3:00 PM
Blog alert!
A new part in our series on the DP-700 exam. This time, we touch on Apache Airflow.
#DP700
#MicrosoftFabric
#MicrosoftLearn
#ApacheAirflow
A new part in our series on the DP-700 exam. This time, we touch on Apache Airflow.
#DP700
#MicrosoftFabric
#MicrosoftLearn
#ApacheAirflow
📌 Accede al análisis completo de los schedulers en #Airflow 3 y descubre todos los detalles de su funcionamiento con ejemplos:
➡️ blog.damavis.com/airflow-3-sc...
#BigData #Software #ApacheAirflow
➡️ blog.damavis.com/airflow-3-sc...
#BigData #Software #ApacheAirflow
Airflow 3: Scheduling, Timetables y Event-Driven pipelines
Analizamos cómo funcionan los schedulers y los diferentes enfoques para programar, ejecutar y orquestar flujos de trabajo en Airflow 3 a través de ejemplos
blog.damavis.com
June 4, 2026 at 7:30 AM
📌 Accede al análisis completo de los schedulers en #Airflow 3 y descubre todos los detalles de su funcionamiento con ejemplos:
➡️ blog.damavis.com/airflow-3-sc...
#BigData #Software #ApacheAirflow
➡️ blog.damavis.com/airflow-3-sc...
#BigData #Software #ApacheAirflow
En esta nueva manera en la que funcionan los schedulers, todo se estructura alrededor de tres conceptos fundamentales:
🔹 Time-driven scheduling
🔹 Data-driven scheduling
🔹 Event-driven scheduling
#BigData #Software #Airflow #ApacheAirflow
🔹 Time-driven scheduling
🔹 Data-driven scheduling
🔹 Event-driven scheduling
#BigData #Software #Airflow #ApacheAirflow
June 4, 2026 at 7:30 AM
En esta nueva manera en la que funcionan los schedulers, todo se estructura alrededor de tres conceptos fundamentales:
🔹 Time-driven scheduling
🔹 Data-driven scheduling
🔹 Event-driven scheduling
#BigData #Software #Airflow #ApacheAirflow
🔹 Time-driven scheduling
🔹 Data-driven scheduling
🔹 Event-driven scheduling
#BigData #Software #Airflow #ApacheAirflow
⚙️ ¿Cómo funciona el scheduler?
🔹 El scheduler de #Airflow no ejecuta las tareas directamente
🔹 Su función es evaluar condiciones operativas, decidir el momento de inicio y delegar la ejecución
#BigData #Sofware #ApacheAirflow
🔹 El scheduler de #Airflow no ejecuta las tareas directamente
🔹 Su función es evaluar condiciones operativas, decidir el momento de inicio y delegar la ejecución
#BigData #Sofware #ApacheAirflow
June 4, 2026 at 7:30 AM
⚙️ ¿Cómo funciona el scheduler?
🔹 El scheduler de #Airflow no ejecuta las tareas directamente
🔹 Su función es evaluar condiciones operativas, decidir el momento de inicio y delegar la ejecución
#BigData #Sofware #ApacheAirflow
🔹 El scheduler de #Airflow no ejecuta las tareas directamente
🔹 Su función es evaluar condiciones operativas, decidir el momento de inicio y delegar la ejecución
#BigData #Sofware #ApacheAirflow