#openmldb
OpenMLDB can handle about 12,500 queries per second with sub‑millisecond latency, beating SparkSQL and ClickHouse by 23× and PostgreSQL/MySQL by 3.57×, according to recent benchmarks. Read more: https://getnews.me/openmldb-boosts-real-time-sql-ml-query-performance/ #openmldb #sql #ml
September 22, 2025 at 8:17 AM
Mashkhal A. Sidiq, Aras A. Salih, Samrand M. Hassan: Optimization techniques for SQL+ML queries: A performance analysis of real-time feature computation in OpenMLDB https://arxiv.org/abs/2509.15529 https://arxiv.org/pdf/2509.15529 https://arxiv.org/html/2509.15529
September 22, 2025 at 6:30 AM
OpenMLDB as the execution engine) has been deployed in over 100 real-world scenarios on 4Paradigm's Sage Studio platform, handling up to a trillion-dimensional feature space and enabling millisecond-level feature updates. We demonstrate how [5/6 of https://arxiv.org/abs/2504.00786v1]
April 2, 2025 at 5:56 AM
airflow-provider-openmldb 0.0.1

A openmldb provider package built by 4paradigm.

Author: Huang Wei
🏠Homepage
December 26, 2025 at 6:00 PM
Optimization techniques for SQL+ML queries: A performance analysis of real-time feature computation in OpenMLDB
In this study, we optimize SQL+ML queries on top of OpenMLDB, an open-source database that seamlessly integrates offline and online feature computations. The work used feature-rich synthetic dataset experiments in Docker, which acted like production environments that processed 100 to 500 records per batch and 6 to 12 requests per batch in parallel. Efforts have been concentrated in the areas of better query plans, cached execution plans, parallel processing, and resource management. The experimental results show that OpenMLDB can support approximately 12,500 QPS with less than 1 ms latency, outperforming SparkSQL and ClickHouse by a factor of 23 and PostgreSQL and MySQL by 3.57 times. This study assessed the impact of optimization and showed that query plan optimization accounted for 35% of the performance gains, caching for 25%, and parallel processing for 20%. These results illustrate OpenMLDB's capability for time-sensitive ML use cases, such as fraud detection, personalized recommendation, and time series forecasting. The system's modular optimization framework, which combines batch and stream processing without interference, contributes to its significant performance gain over traditional database systems, particularly in applications that require real-time feature computation and serving. This study contributes to the understanding and design of high-performance SQL+ML systems and highlights the need for specialized SQL optimization for ML workloads.
arxiv.org
September 22, 2025 at 5:08 AM