#data-engineering
November 11, 2026 at 6:37 PM
It's so sucks that we live in a cyberpunk dystopia, because otherwise the idea of having logging and telemetry on literally everything would be awesome. Data collection and monitoring is a really good way to do a lot of awesome stuff. Knowing the state of things lets you do so much fun engineering.
November 14, 2026 at 1:24 PM
I'll field data engineering questions for the next 30 seconds.
November 13, 2026 at 2:48 PM
Matteo Vaccari claims that with agentic engineering we need to re-orient our testing strategy with broader-scope tests represented as data rather than code.

martinfowler.com/articles/tes...
Tests as data
Effective ways to write automated tests in AI-generated codebases
martinfowler.com
November 11, 2026 at 3:23 PM
Data engineering needs a good story, like in BI, it's all about the story you tell with the data.

That's why my focus is on the craft of writing a good story for each essay. What's your approach to telling a good story with data or about data?
November 13, 2026 at 10:07 AM
-Engineering Post 1/

"In rural OR’s Morrow County, an investigative report by Rolling Stone uncovered a troubling environmental collision between hyperscale cloud computing & local drinking water — linking massive Amazon Web Services data centers to supercharged groundwater nitrate contamination."
November 15, 2026 at 10:19 PM
A New York Times analysis of university and federal data found that the Trump administration, in its broader dismantling of the American scientific machinery, has undermined opportunities for young scientists.

Schools are admitting less PhD students, which directly affects research output.
November 14, 2026 at 7:00 PM
DataGrokr: Data Modernization, AI and Cloud Engineering for Mid-Market Companies

DataGrokr is a data modernization, AI, and cloud engineering company that helps mid-market companies turn their data into a dependable foundation for growth.

Website: www.datagrokr.co
Email: hello@datagrokr.co
November 15, 2026 at 5:01 PM
HELLO I AM A HEALTHCARE REVENUE CYCLE TECHNOLOGY PROFESSIONAL WITH A BACKGROUND IN SOLUTIONS ENGINEERING, AI ADOPTION, TECHNICAL ACCOUNT MANAGEMENT, DATA ANALYSIS, AND A DEGREE IN DATA SCIENCE PLEASE JOB NOW PLEASE
November 12, 2026 at 2:23 AM
Also nothing wrong with being a
sociologist....like I'd rather data scientist was data engineering. Describes it better tbh.
November 15, 2026 at 11:15 AM
Happy #VoyagerWasAlmostLostButSmartPeopleSavedIt day to all who celebrate!
November 15, 2026 at 2:37 AM
AI technology hallucinates, which may be a bad thing when your life depends on it.

"OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws"

"...large language models will always produce plausible but false outputs..."

www.computerworld.com/article/4059...
OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws
In a landmark study, OpenAI researchers reveal that large language models will always produce plausible but false outputs, even with perfect data, due to fundamental statistical and computational limi...
www.computerworld.com
November 13, 2026 at 4:05 PM
AI technology hallucinates, which may be a bad thing when your life depends on it.

"OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws"

"...large language models will always produce plausible but false outputs..."

www.computerworld.com/article/4059...
OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws
In a landmark study, OpenAI researchers reveal that large language models will always produce plausible but false outputs, even with perfect data, due to fundamental statistical and computational limi...
www.computerworld.com
November 14, 2026 at 10:49 AM
China holds 80% of underwater data center patents in past 20 years, can boost AI energy use - Interesting Engineering
China holds 80% of underwater data center patents in past 20 years, can boost AI energy use - Interesting Engineering
China holds 80% of underwater data center patents in past 20 years, can boost AI energy use  Interesting Engineering
interestingengineering.com
November 14, 2026 at 12:13 PM
Will We Put Data Centers in Space?
Discussion | hackernews | Author: simonebrunozzi

#Space
Will We Put Data Centers in Space?
How soon could AI data centers move to orbit? Forethought analyzes launch costs, cooling physics, and other engineering and governance factors needed to make space compute viable.
www.forethought.org
November 14, 2026 at 6:39 PM
Here’s another example of the error.

Basically, computers are not *actually* as deterministic and reliable as we think, they require a lot of careful engineering work to get usable, reliable data.

These errors seem small but they’re the difference in you paying off your loan and not!
November 15, 2026 at 1:52 AM
• Lead BigQuery migration, establishing Ondo's unified data warehouse and reporting.
• Design and build repeatable ETL/ELT pipelines for on-chain and off-chain data.
• Partner with Data Science, Engineering, Risk to scale analytical infrastructure.
(2/3)
November 15, 2026 at 12:00 PM
Data Engineering Workspace Packaging Pattern (paid)

Takeaways:
- Standardize the runtime (Docker/DuckDB) to ensure consistency across dev and prod.
- Use domain isolation to allow independent team deployments.
- Abstract technical complexity into versioned packages to reduce code duplication.
Data Engineering Workspace Packaging Pattern
Package data engineering workflows into portable, team-independent workspaces that enable autonomous development and reduce code duplication across enterprise data platforms.
www.dedp.online
November 11, 2026 at 11:12 AM
do these seasoned developers seriously not realise that training data from the big ai companies is not moderated and could very easily literally contain leaked copyrighted proprietary code that could be used potentially verbatim in their "reverse engineering" projects? fucking hell
November 14, 2026 at 1:10 PM
just applied to a software engineering job

feels strange doing so as I've held a data scientist/analyst title in my last 3 jobs. OTOH, most modern data science (and the part I'm most excited by) involves a lot of traditional software engineering (plus I've written a lot of C# & TS in the past year)
November 11, 2026 at 9:27 PM
🎯 Seeking 5+ years of data engineering experience with BigQuery, strong SQL, and high data quality standards.
🌍 Remote
💰 ~160k–200k USD (est.)

👉 Apply here: https://t.me/web30_jobs

#datascience #engineer #senior #aws
(3/3)
November 15, 2026 at 12:00 PM
🚀 New Remote Job Alert!
💼 Position: Director, Data and AI Platform Engineering Lead
🏢 Company: Macquarie Group
🌍 Location: Sidney (Hybrid)
📁 Category: Software Development
🛠️ Skills: DATA ENGINEERING, ENTERPRISE DATA MANAGEMENT, CLOUD PLATFORMS, ARTIFICIAL INTELLIGENCE, PLATFORM ENGINEERING...
November 15, 2026 at 2:45 PM
being from a mechanical engineering background myself I will say that it is infact part data and part theater.
November 13, 2026 at 9:48 AM