A common interface to stream, query & slice remote Parquet, #PyTables, #HDF5, #Zarr & #Blosc2 data over HTTP/S3:
⚡️ Zero full downloads
⚡️ Cloud index pushdown
⚡️ DuckDB/Polars streaming!
Read the tour: blosc.org/posts/remote...
Compress Better, Stream Smarter 🚀
A common interface to stream, query & slice remote Parquet, #PyTables, #HDF5, #Zarr & #Blosc2 data over HTTP/S3:
⚡️ Zero full downloads
⚡️ Cloud index pushdown
⚡️ DuckDB/Polars streaming!
Read the tour: blosc.org/posts/remote...
Compress Better, Stream Smarter 🚀
Stay tuned!
Stay tuned!
Starred
github.com/pydata/numexpr
Starred
github.com/pydata/numexpr
Leverage hdf5plugin (hdf5plugin.readthedocs.io) to integrate Blosc2 as a filter within HDF5. Create and read data using popular Python wrappers like h5py or PyTables, while achieving excellent performance! 💨
Compress Better!
Leverage hdf5plugin (hdf5plugin.readthedocs.io) to integrate Blosc2 as a filter within HDF5. Create and read data using popular Python wrappers like h5py or PyTables, while achieving excellent performance! 💨
Compress Better!
Discussion | hackernews | Author: tosh
Discussion | hackernews | Author: tosh
Check out other NumFocus sponsored projects at numfocus.org/sponsored-pr....
Check out other NumFocus sponsored projects at numfocus.org/sponsored-pr....
Plus, you can now sponsor Vega's development: app.hubspot.com/payments/GyP...
Plus, you can now sponsor Vega's development: app.hubspot.com/payments/GyP...
Key Updates:
• Improved CI experience: Smoother build process on GitHub's test-arm
• Enhanced testing framework: New tests for external error handling
• Code quality checks: Fixes to improve expressions and pytables
Key Updates:
• Improved CI experience: Smoother build process on GitHub's test-arm
• Enhanced testing framework: New tests for external error handling
• Code quality checks: Fixes to improve expressions and pytables
• Improved testing with `tm.external_error_raised`.
• Refactored code using `ruff checks` for better readability.
• Fixed formatting and best practice issues in expression and pytables modules.
• Improved testing with `tm.external_error_raised`.
• Refactored code using `ruff checks` for better readability.
• Fixed formatting and best practice issues in expression and pytables modules.
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
https://github.com/MarkRoddy/duckdb-pytables
If you’ve ever wanted to run:
> SELECT * FROM hit_the_rest_api()
This will be up your alley. Some more details 👇
https://github.com/MarkRoddy/duckdb-pytables
If you’ve ever wanted to run:
> SELECT * FROM hit_the_rest_api()
This will be up your alley. Some more details 👇
webapps.stackexchange.com/a/44927/116555
TL;DR: trick r-devel into sending both digests and individual messages to your inbox.
Filter out the individual messages by default, but easily retrieve them to reply in-thread if needed 🤯
webapps.stackexchange.com/a/44927/116555
TL;DR: trick r-devel into sending both digests and individual messages to your inbox.
Filter out the individual messages by default, but easily retrieve them to reply in-thread if needed 🤯
PyTables is a mature, production-grade library for storing and querying hierarchical, large-scale datasets in HDF5 from Python.
https://gitrated.com/PyTables/PyTables
PyTables is a mature, production-grade library for storing and querying hierarchical, large-scale datasets in HDF5 from Python.
https://gitrated.com/PyTables/PyTables