#Dataengineering
Chat noir très attentif au moindre bruit, assez timide. Celui d'une voisine. Bon signe ?

#Recrutement #DataEngineering #JdR #Chat #ChatNoir ...
November 7, 2026 at 1:51 PM
Never Restart a Failed AI Pipeline Again | Union.ai on Google Cloud
google.smh.re
November 9, 2026 at 7:44 AM
💼 Quantiphi is hiring a Data Engineer - Senior - USA
Location: 🇺🇸 New York, New York, United States

#DataEngineering #DataEngineeringjob #hiring #techjob #jobs #careers

https://datasciencejobs.com/jobs/data-engineer-senior-quantiphi-united-states-7/
November 6, 2026 at 8:00 PM
S3 Tables now migrates Apache Hive to Iceberg as a managed API call. No pipelines to build, sync while production runs, pay only for data copied.

Weeks of migration work just became an afternoon.

#Iceberg #DataEngineering

ift.tt/TZ2hjLf
November 4, 2026 at 11:39 PM
❄️ Snowflake backup sets now cover 🧊 Iceberg tables (GA since Nov 4). That says something about the architecture 😎

#Snowflake #SnowflakeSquad #ApacheIceberg #DataEngineering #Lakehouse #DisasterRecovery
November 9, 2026 at 7:49 AM
November 4, 2026 at 8:58 PM
Seattle and NYC, I’m Coming!

Been awhile since I’ve been to these cities so make sure to come join us at these Open Lakehouse & AI meetups where I’ll discussing the latest on V3, V4 and the REST Spec. Jaz will be talking Ontologies.
#ApacheIceberg #OpenLakehouse #DataEngineering #AgenticAI
November 6, 2026 at 11:16 PM
Learn how a data engineer rebuilt mobile game attribution using SQL, unified install data, revenue cohorts, and organic uplift modeling. #dataengineering
How I Built a Mobile Game Attribution Model Using SQL and Organic Uplift
hackernoon.com
November 8, 2026 at 6:49 PM
Learn how a data engineer rebuilt mobile game attribution using SQL, unified install data, revenue cohorts, and organic uplift modeling. #dataengineering
How I Built a Mobile Game Attribution Model Using SQL and Organic Uplift
hackernoon.com
November 8, 2026 at 6:49 PM
"AI doesn't magically eliminate ambiguity. It can industrialize ambiguity at machine speed, which is dangerous."

joereis.substack.com/p/the-great-... #ai #latestage #dataengineering
November 3, 2026 at 1:56 PM
Why the people who look after your data should be in the room when you talk about AI governance

mrneilbryan.substack.com/p/why-the-pe...

#AIGovernance #DataEngineering #DataGovernance #ResponsibleAI
Why the people who look after your data should be in the room when you talk about AI governance
I keep noticing who isn’t there: the data engineers, the DBAs and the infrastructure people.
mrneilbryan.substack.com
November 7, 2026 at 9:20 AM
No timestamp, no trail?
I saw 1 question about syncing without a change timestamp. Compare keys and row hashes across complete snapshots to spot net changes—not every event. How do you track updates?

#dataengineering #database
November 9, 2026 at 4:53 AM
A green run can hide gaps.
1 reader suggested tying checks to each run. Compare expected IDs with confirmed writes for that run, then inspect missing IDs before retrying. What do you check first?

#dataengineering #datapipelines
November 8, 2026 at 12:23 AM
AI-curated dataset: Public Suffix List, domain-boundary rules including co.uk and hosted platforms. MPL 2.0.

For web analysts: compare distinct-site counts using ICANN-only versus full rules before grouping URLs.

https://publicsuffix.org/list/
#OpenData #DataEngineering
November 7, 2026 at 2:03 PM
❄️ Master Snowflake Data Engineering with DBT & Airflow!
👉 Course highlights:
✅ Expert trainers (live & real-time)
✅ Job-focused training
✅ Hands-on live projects
✅ Daily recorded sessions
✅ One-on-one sessions available
📱 WhatsApp: +91 7032290546

#Visualpath #AgenticAI #DataEngineering
November 9, 2026 at 11:55 AM
Where do you actually store Bronze, Silver and Gold?

In a dbt and warehouse stack, Bronze lives as files in object storage, because it's rarely queried. Silver and Gold live in the warehouse, because that's where the SQL work and the dashboards are.

#dataengineering #databs
November 9, 2026 at 12:00 PM
What AI can already do in data engineering:

- write ingestion scripts and API calls
- scaffold DAGs and dbt models
- explain error logs and suggest fixes

If that's most of your working day, start learning the parts of the job it can't do.

#dataengineering #databs
November 8, 2026 at 3:56 PM
The project isn’t late, the clock just disagrees. 😜🙃🤣😂
We are still confused, but at least strongly typed confused . 😁😄😃🤣😅😂
That is funny
www.instagram.com/reel/DdZYFWp...
Programmers are also human on Instagram: "This guy casually looses 20TB an hour. But 'if the join fits in memory, it belongs in postgres' #dataengineering #programminghumor #programmingmemes #larp #...
75K likes, 477 comments - programmersarealsohuman on September 17, 2026: "This guy casually looses 20TB an hour. But 'if the join fits in memory, it belongs in postgres' #dataengineering #programmin...
www.instagram.com
November 7, 2026 at 8:15 PM
If you want a data engineering job, these are the tools to learn:

- Apache Spark
- Python and SQL
- dbt and Airflow
- Kafka and real-time pipelines

This is the core of the job.

#dataengineering #databs
November 6, 2026 at 12:01 PM
AI can write a pipeline. It can't decide what happens when a source API changes overnight.

Someone still has to design the architecture, keep cloud costs under control and own the pipeline when it breaks. And every AI product needs reliable, fresh data underneath it.

#dataengineering #databs
November 8, 2026 at 3:56 PM
Pipelines that show green can still ship wrong numbers. Here is how banks can catch silent data failures before regulatory reports break. #dataengineering
Building Data Observability for Banking Pipelines
hackernoon.com
November 5, 2026 at 5:39 PM
November 3, 2026 at 2:27 PM
Will AI take your job as a data engineer? It'll take some of your tasks. Not the job.

AI already writes decent Python, generates Airflow DAGs and drafts Terraform in seconds. The boilerplate part of data engineering is shrinking fast, and junior roles feel it first.

#dataengineering #databs
November 8, 2026 at 3:56 PM
Your reports are only as reliable as the pipeline that feeds them.

We help you build data pipelines in Microsoft Fabric that keep running ⬇️

Get in touch (link in the comments).

#fabric #dataengineering #onelake #powerbi
November 6, 2026 at 10:06 AM