#DataPipelines
LightNews LightNews
shadowphantomsda.bsky.social
Temporal Pipeline Rupture

#aiart #industustrialart #datapipelines #synthart
May 23, 2025 at 11:09 AM
businessbruder.bsky.social
Wir skalieren deine datapipelines
April 20, 2026 at 1:29 PM
manasdutta.bsky.social
& repeat.

what did you ship today? 👇
#buildinpublic #ai #datapipelines #opensource #vistai
April 26, 2026 at 4:47 PM
hpgrahsl.bsky.social
On my way to London 🇬🇧 for #DevoxxUK. Very excited to talk about 🔒 End-to-End 🔑 #Encryption 🔓for #Streaming #DataPipelines tomorrow.

Join me if that's interesting to you 👇

www.devoxx.co.uk/talk/?id=18778
May 6, 2025 at 3:43 PM
dataomni.bsky.social
🏢 Deploy Your Way

Run OpenETL on-premise, cloud, or hybrid. Maximum flexibility for your infrastructure needs.

One engine, endless possibilities.

#ETL #DeploymentFlexibility #OpenSource #DataPipelines #CloudComputing #OnPremise #HybridCloud #DataEngineering #OpenETL #DataOmni #BuildInPublic
July 17, 2025 at 8:01 AM
rladiesmelb.bsky.social
Tired of rerunning everything every time you change a line of code? 😩

The {targets} package automates your #Rstats workflow—only running what’s needed, tracking dependencies, keeping your analysis reproducible & efficient.

⏩ books.ropensci.org/targets/
#RStats #ReproducibleResearch #DataPipelines
The {targets} R package user manual
Will Landau
books.ropensci.org
August 12, 2025 at 11:01 PM
secasc.bsky.social
💻In the latest researcher spotlight, 2025-26 Global Change Research Fellow Graham Louis shares his work on flexible #DataPipelines for #SustainableAgriculture and management!

🚜Read more: https://loom.ly/jyysse8
April 1, 2026 at 4:06 PM
dataomni.bsky.social
⚙️ Smart Pipelines

Auto data type detection & handling for clean, efficient processing. No more type mismatches.

Smarter pipelines. Fewer surprises.

#SmartPipelines #ETL #DataAutomation #OpenSource #DataOmni #DataEngineering #OpenETL #DataPipelines #DataQuality #PythonETL #BuildInPublic
July 15, 2025 at 6:26 PM
dataomni.bsky.social
🧾 Granular Task Logging

Track transformations, analyze execution metrics & debug pipeline issues with detailed logs.

Precision & transparency built in.

#ETL #TaskLogging #DataPipelines #OpenSource #DebuggingTools #DataOmni #OpenETL #Logging #Observability #BuildInPublic
July 18, 2025 at 4:01 AM
internaciarekruto.bsky.social
Hiring DATA ENGINEER at Chennai
#DataPipelines #etlprocesses #etldeveloper #BusinessIntelligence #BusinessIntelligenceTools #DataIntegration #bianalysts #BusinessIntelligenceAnalyst #sqldeveloper #dataengineer #PythonForETL #APIDevelopment #chennaijobs #InternationalRecruiters #Internaciarekruto
May 7, 2025 at 10:43 PM
wumu.bsky.social
im writing datapipelines at work today and the graph it generates looks like a tech tree. my mind cannot escape factori
October 22, 2024 at 7:06 PM
rmarkdown.bsky.social
rixpress: An R package for building multi-language, reproducible analytics pipelines 🔁📦 Quick 2-min intro video 🎥
👉 reddit.com/r/datascienc...

#RStats #DataScience ##Python #DataPipelines
From the datascience community on Reddit: rixpress: an R package to set up multi-language reproducible analytics pipelines (2 Minute intro video)
Explore this post and more from the datascience community
reddit.com
July 21, 2025 at 2:47 PM
iwebdatascraping.bsky.social
#LeveragingStockMovement with #NewsSentiment (NLP) enables investors to predict market trends & optimize trading strategies efficiently.

www.iwebdatascraping.com/stock-moveme...

#AIData #WebScraping #ModelTraining #MachineLearning #RetrievalAugmentedGeneration #DataPipelines #SmartData
September 1, 2025 at 4:57 AM
ellen-friedman.bsky.social
Exciting opportunity to do work with this excellent group. If this is your field of study, do consider applying
#data #ML #machinelearning #datapipelines
mersault.bsky.social Sebastian @mersault.bsky.social · Feb 3
We have a PhD opening in Berlin on "Responsible Data Engineering", with a focus on efficiently creating, maintaining and evaluating datasets and pipelines for ML use cases.

This is a fully-funded position at the newly founded DEEM Lab, as part of @bifold.berlin .

deem.berlin#jobs-2225
February 3, 2025 at 8:54 AM
hpgrahsl.bsky.social
🤩 Very much looking forward to presenting on this #cryptography topic and #opensource project I initiated a while back. If you care about #security for your most sensitive data that's processed in #streaming #datapipelines join me @devoxx.uk 👇
devoxx.uk Devoxx UK @devoxx.uk · Apr 11
Boost your data security with @hpgrahsl.bsky.social ’s talk ‘’End-to-End Encryption for Streaming Data Pipelines.’’ Learn how Kryptonite for Kafka enhances confidentiality with client-side cryptography and protects your sensitive data.

View talk @ buff.ly/QkIN6Su
April 15, 2025 at 5:39 AM
dataomni.bsky.social
🧠 Python & Spark SQL Transforms

Use Python for custom logic or Spark SQL for distributed processing. Mix both for maximum control.

Build fast. Iterate faster.

#PythonETL #SparkSQL #DataTransformation #DataPipelines #ETL #OpenSource #OpenETL #DataOmni #BigData #FlexibleEngineering #BuildInPublic
July 16, 2025 at 3:30 AM
kattasairamesh.bsky.social
☁️ Azure Data Engineering with Data Factory – Free Demo!
📅 21–28 June | 🕢 7:30 AM IST

🎙️ With Mr. Venkat Reddy

🔗Register Link : tr.ee/Nn91HY

🎓 More demos: linktr.ee/ITcoursesFre...

#AzureDataEngineering #DataFactory #CloudComputing #ETL #DataPipelines #TechTraining #NareshIT #FreeCourse
June 21, 2025 at 9:46 AM
srikanthmogili.bsky.social
☁️ Azure Data Engineering with Data Factory – Free Demo!
📅 21–28 June | 🕢 7:30 AM IST

🎙️ With Mr. Venkat Reddy

🔗 tr.ee/Nn91HY
🎓 More demos: linktr.ee/ITcoursesFre...

#AzureDataEngineering #DataFactory #CloudComputing #ETL #DataPipelines #TechTraining #NareshIT #FreeCourse
June 21, 2025 at 9:56 AM
infoq.com
#LinkedIn has launched a unified integrations platform to standardize & reconcile hiring data across systems.

• 72% faster onboarding
• Improved data consistency and completeness
• Scalable AI-driven hiring

🔗 bit.ly/4uBmGbA

#EvolutionaryArchitecture #DataPipelines #DataAnalytics #InfoQ
May 8, 2026 at 1:24 PM
tabsdata.com
Introducing Tabsdata: Pub/Sub for Tables

We’re officially out of stealth mode! 🚀 Tabsdata is now available for everyone to explore.

Check out our full announcement on LinkedIn: www.linkedin.com/posts/arvind...

#Tabsdata #DataIntegration #DataEngineering #DataManagement #DataPipelines #ETL
Arvind Prabhakar on LinkedIn: #tabsdata #dataintegration #dataengineering #datamanagement #datapipelines…
Introducing Tabsdata: Pub/Sub for Tables After months of dedicated development and refinement, Tucu (Alejandro Abdelnur) and I are excited to announce that…
www.linkedin.com
February 5, 2025 at 8:18 PM
infoq.com
In this #InfoQ article, Vignesh Durai explains how agentic and multimodal AI systems can be engineered using #ApacheCamel & #LangChain4j.

The solution combines LLM-based reasoning, retrieval-augmented generation (RAG), and image classification.

🔗 Read now: bit.ly/4wbTpWL

#AI #LLMs #DataPipelines
April 27, 2026 at 12:55 PM
opsmatters.com
The latest update for #Integrateio includes "Governed Data Pipelines: Meeting SOC 2 and Regulatory Requirements" and "Sync Your Ometria Contacts Anywhere: Announcing the Integrate.io Ometria Connector".

#ETL #DataAnalytics #DataPipelines https://opsmtrs.com/3qsMuqZ
Integrate
Integrate’s cloud-based, easy-to-use, data integration service makes it easy to move, process and transform more data, faster, reducing preparation time so businesses can unlock insights quickly.
opsmtrs.com
September 21, 2026 at 2:55 AM
kmcd.dev
🪧 Unknown Fields in Protobuf: How Protobuf unknown fields enable seamless schema evolution and robust middleware.
https://kmcd.dev/posts/protobuf-unknown-fields/
#Protobuf #Grpc #Api #Microservices #Datapipelines #Connectrpc #Go #Typescript #Architecture
Unknown Fields in Protobuf
How Protobuf unknown fields enable seamless schema evolution and robust middleware.
kmcd.dev
April 16, 2026 at 6:50 PM
infoq.com
Atlassian introduced Lithium - an in-house #ETL platform designed to meet the requirements of dynamic data movement.

📢 InfoQ spoke with Niraj Mishra, Principal Engineer, about Lithium’s implementation and future.

🔗 Read more: bit.ly/40yb77E

#DataPipelines #ApacheKafka #ApacheFlink #InfoQ
January 31, 2025 at 11:16 AM
opsmatters.com
The latest update for #Integrateio includes "Agentic #DataIntegration, Explained: From Static Pipelines to Autonomous Data Flows" and "Schema Drift: Why It Breaks Pipelines and How #AI Agents Fix It Automatically".

#ETL #DataAnalytics #DataPipelines https://opsmtrs.com/3qsMuqZ
Integrate
Integrate’s cloud-based, easy-to-use, data integration service makes it easy to move, process and transform more data, faster, reducing preparation time so businesses can unlock insights quickly.
opsmtrs.com
August 3, 2026 at 5:20 AM