#OpenCrawling
Welcome Rafa Haro (Elastic Principal Engineer, Apache ManifoldCF & Stanbol PMC) as OpenCrawling Lead Architect! 🎉

Already landed:
✅ Per-doc Kafka ordering
✅ Single-JVM JUnit ITs
✅ Zero-drop .DLT retries

opencrawling.org/blog/welcomi...

#OpenSource #Java
Engineering Scale & Reliability: Welcoming Rafa Haro as Lead Architect - OpenCrawling
Principal Software Engineer at Elastic and Apache ManifoldCF & Apache Stanbol PMC Member Rafa Haro joins OpenCrawling as Lead Architect, immediately hardening Kafka document ordering, JUnit integratio...
opencrawling.org
November 16, 2026 at 9:58 PM
OpenCrawling Elasticsearch Output Connector

TIL about the Open Ingestion Standard. Standards, standards everywhere.

opencrawling.org/blog/introdu...
Dense Vector Search, Quantized HNSW & Zero-Trust kNN Pre-Filtering: Announcing the Elasticsearch 8.x & 9.x Output Connector
Discover OpenCrawling's native Elasticsearch 8.x and 9.x Output Connector (oc-elasticsearch-output-connector). Built on the official Elastic Java API Client 9.4 (Rest5Client) with automatic…
opencrawling.org
November 17, 2026 at 1:56 PM
Announcing the native Elasticsearch 8.x & 9.x Output Connector in OpenCrawling! 🚀

✔ Elastic Java Client 9.4 (Rest5Client)
✔ Auto dense_vector & BBQ HNSW
✔ Zero-Trust kNN pre-filtering for MCP

opencrawling.org/blog/introdu...

Thanks to @michaelcizmar.bsky.social

#AI #RAG #Elasticsearch
Dense Vector Search, Quantized HNSW & Zero-Trust kNN Pre-Filtering: Announcing the Elasticsearch 8.x & 9.x Output Connector
Discover OpenCrawling's native Elasticsearch 8.x and 9.x Output Connector (oc-elasticsearch-output-connector). Built on the official Elastic Java API Client 9.4 (Rest5Client) with automatic dense_vect...
opencrawling.org
November 9, 2026 at 4:14 PM
From Sun Microsystems & Alfresco to co-creating RESTHeart and now shaping the future of Zero-Trust AI ingestion. ⚡

Welcome Maurizio Turatti (@mkjsix) to OpenCrawling as Strategy & Enterprise Architecture Advisor! 🚀

opencrawling.org/blog/welcomi...

#OpenSource #Java #AI
Welcoming Maurizio Turatti as Strategy & Enterprise Architecture Advisor - OpenCrawling
Distinguished software architect, co-founder of SoftInstigate, and co-creator of RESTHeart Maurizio Turatti joins OpenCrawling to advise on enterprise architecture, system scalability, and the Open In...
opencrawling.org
October 27, 2026 at 10:09 AM
Welcoming Davide Polato to OpenCrawling as Contributor for Apache Storm & StormCrawler! 🚀

Davide brings deep stream processing expertise to drive distributed web crawling integration & test determinism.

Read more 👇
opencrawling.org/blog/welcomi...
Welcoming Davide Polato as Contributor for Apache Storm & StormCrawler - OpenCrawling
OpenCrawling welcomes Apache Storm and StormCrawler contributor Davide Polato to the team to drive distributed web crawling integration, topology test determinism, and streaming pipeline reliability.
opencrawling.org
October 8, 2026 at 9:10 PM
Toxic PDFs crashing your RAG pipeline? 💥

OpenCrawling now runs Apache Tika 4.1.0 with PipesForkParser process isolation!

• Isolated child JVMs
• 30s watchdog timeouts
• Bounded heaps
• Zero-Trust Zip Slip defense

👉 opencrawling.org/blog/introdu...

#ApacheTika #DataEngineering #OpenSource
October 3, 2026 at 1:17 PM
People ask: Michael, how do we feed Alfresco, Documentum & FileNet into AI?

1 Explain it like I’m five!
2 We built the OASIS CMIS Connector.
Java 25, Zero-Trust ACLs... That’s what she said.

👉 opencrawling.org/blog/introdu...

#TheOffice #CMIS #EnterpriseAI #OpenCrawling #RAG #Java25 #OpenSource
October 3, 2026 at 1:04 PM
Enterprise knowledge lives in workflows, not just static PDFs! ⚡

Alfresco Process Services is now native in OpenCrawling:
• Active & historic BPMN crawls
• Dynamic typed variables
• Candidate group ACLs
• Secure MCP Server

👉 opencrawling.org/blog/introdu...

#AI #RAG #BPMN #OpenSource
October 2, 2026 at 9:15 PM
Crawl once, fan out everywhere! 🌊⚡

Apache SeaTunnel is now native in OpenCrawling:
• Fan out to 100+ targets (Iceberg, ClickHouse, Milvus, Qdrant)
• Decoupled Kafka stream + Zeta REST v2
• CDC DELETE tombstones to prevent RAG hallucinations

opencrawling.org/blog/introdu...

#AI #RAG
October 1, 2026 at 7:25 AM
Scale enterprise RAG with web crawling! 🕸️

Apache StormCrawler is now native in OpenCrawling:
• StormCrawler 3.7 & Storm 3.1
• Dual-stream UPSERT & DELETE tombstones
• Java 25 Virtual Threads

Read more: opencrawling.org/blog/introdu...

#AI #RAG
September 29, 2026 at 4:44 PM
Migrating enterprise search crawlers to AI & RAG pipelines shouldn't mean starting from scratch. 🌉

Introducing oc-mcf-migrator in OpenCrawling! 🚀

Convert to OIS YAML, and import Apache ManifoldCF workloads with zero guesswork.

opencrawling.org/blog/introdu...

#OpenSource #AI #RAG #Search
September 24, 2026 at 12:15 PM
Tired of deploying heavy search clusters for RAG? ⚡
Introducing the Luxir Output Connector in OpenCrawling! 🚀

✔ 1024-dim dense vector kNN + BM25 hybrid ranking
✔ Zero client dependencies
✔ OIS deletion tombstones & Zero-Trust ACLs

opencrawling.org/blog/introdu...

#AI #RAG #Search #VectorSearch
September 24, 2026 at 12:34 PM
#OpenCrawling released the @ApacheSolr Output Connector (oc-solr-output-connector)! OpenCrawling now natively streams enterprise document repositories into #Apache #Solr 10.x and 9.x
opencrawling.org/blog/introdu...
Solr 10 Dense Vector Search & HNSW Quantization: Announcing the Apache Solr Output Connector in OpenCrawling
Discover OpenCrawling's native Apache Solr Output Connector (oc-solr-output-connector). Built with SolrJ 10 native JDK HTTP Client, solr.DenseVectorField, HNSW quantization, efSearch tuning, and REST ...
opencrawling.org
September 4, 2026 at 5:01 AM
🚀 Merged to main: OpenCrawling x Vespa Output Connector!

Stream enterprise docs directly into Vespa.ai with HTTP/2 feeding, hybrid vector+BM25 search! ⚡️

Big thanks to Luis Cabaceira for this contribution! 🙌

📖 opencrawling.org/blog/introdu...

#OpenCrawling #VespaAI #VectorSearch #AI #OpenSource
August 7, 2026 at 1:23 PM
Sub-millisecond vector search & payload ACL pre-filtering is LIVE in OpenCrawling!

The official Qdrant Output Connector brings high-speed gRPC point streaming, scalar quantization, & zero-leak enterprise RAG to Qdrant collections.

📖 opencrawling.org/blog/introdu...

#Qdrant #Java #RAG #OpenSource
July 29, 2026 at 8:45 PM
The official OpenCrawling Java Client SDK (v1.0.0) is LIVE on Maven Central! ☕🎉

Programmatically manage web crawlers, AI ingestion jobs, Copilot templates, & AIOps diagnostics with a fluent Java 25 & Spring Boot 4 client ⚡

opencrawling.org/blog/introdu...

#Java #SpringBoot #OpenSource #RAG
July 28, 2026 at 8:19 PM
Building data connectors shouldn't require writing hundreds of lines of boilerplate 🛠️

Introducing OpenCrawling Maven Archetypes! Scaffold ready-to-build Repository, Output, and Transformation connectors in seconds 🚀

opencrawling.org/blog/introdu...

#Maven #Java25 #SpringBoot #OpenSource #RAG #AI
Introducing Maven Connector Archetypes: Scaffold Custom Connectors in Seconds
Instantly scaffold standardized Repository, Output, and Transformation connectors for OpenCrawling with Maven Archetypes and Docker Compose overlays.
opencrawling.org
July 26, 2026 at 9:16 PM
⚙️ Connect your Flowable & Camunda BPMN engines directly to your AI vector search pipelines!

OpenCrawling's new native connectors index process definitions, execution histories, and identity ACLs for Zero-Trust RAG.

Read the engineering article 👇
opencrawling.org/blog/introdu...

#AI #RAG #BPMN
Natively Connecting Flowable & Camunda BPMN Engines to Enterprise RAG
OpenCrawling now natively supports the top open-source BPMN workflow engines: Flowable and Camunda. Stream process definitions, execution histories, and task variables into AI pipelines with full ACL ...
opencrawling.org
July 24, 2026 at 9:11 PM
Agnosticism is in our DNA. OpenCrawling acts as a pluggable, cross-platform bridge:
🔌 Any Repository,
🧠 Any AI Model
🧬 Any Destination

Join Our Community!
opencrawling.org

#OpenStandard #DataFederation #IngestionPipeline #AISecurity #MCP #RAG #VectorSearch
July 11, 2026 at 9:09 PM
Enterprise AI has a data ingestion crisis: unscalable pipelines, and critical document security (ACL) leaks. Launching the Open Ingestion Standard (OIS) and OpenCrawling!

www.open4dev.com/journal/2026...

#Java25 #RAG #AISecurity #ZeroTrust #VectorDatabase #SpringBoot #MCP #ModelContextProtocol
Beyond the Silos: Announcing the Open Ingestion Standard (OIS) and OpenCrawling — Open4Dev
Introducing the Open Ingestion Standard (OIS) and the reference implementation OpenCrawling.
www.open4dev.com
July 10, 2026 at 9:45 PM
We are thrilled to announce the official release of the Qdrant Output Connector ( oc-qdrant-output-connector ) ! OpenCrawling now natively connects enterprise document repositories to Qdrant —the…
The Qdrant Output Connector
We are thrilled to announce the official release of the Qdrant Output Connector ( oc-qdrant-output-connector ) ! OpenCrawling now natively connects enterprise document repositories to Qdrant —the…
clawbeat.co
August 15, 2026 at 6:20 PM
We are thrilled to announce the official release of the Qdrant Output Connector ( oc-qdrant-output-connector ) ! OpenCrawling now natively connects enterprise document repositories to Qdrant —the…
The Qdrant Output Connector
We are thrilled to announce the official release of the Qdrant Output Connector ( oc-qdrant-output-connector ) ! OpenCrawling now natively connects enterprise document repositories to Qdrant —the…
clawbeat.co
August 14, 2026 at 4:48 PM