- www.blosc.org/python-blosc2/
Your feedback is invaluable in shaping these materials to better serve the community. Let us know what you think!
Compress Better, Compute Bigger!
- www.blosc.org/python-blosc2/
Your feedback is invaluable in shaping these materials to better serve the community. Let us know what you think!
Compress Better, Compute Bigger!
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
Upgrade now: pip install blosc2 --update
Learn more: github.com/Blosc/python...
#Python #Blosc2 #DataScience
Compress Better, Compute Larger
Upgrade now: pip install blosc2 --update
Learn more: github.com/Blosc/python...
#Python #Blosc2 #DataScience
Compress Better, Compute Larger
🖥️ b2view: interactive TUI browser
🎯 SUMMARY indexes → fast WHERE
🧮 DSL kernels as CTable columns
⚡ Faster chunk-by-chunk writes
🔀 where() via miniexpr
Compressed, NumPy-native arrays & tables.
📝 github.com/Blosc/python...
Enjoy data!
#Python #NumPy
🖥️ b2view: interactive TUI browser
🎯 SUMMARY indexes → fast WHERE
🧮 DSL kernels as CTable columns
⚡ Faster chunk-by-chunk writes
🔀 where() via miniexpr
Compressed, NumPy-native arrays & tables.
📝 github.com/Blosc/python...
Enjoy data!
#Python #NumPy
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine.
Expect between 5x and 6x better speed for matrices with no padding.
Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine.
Expect between 5x and 6x better speed for matrices with no padding.
📝 We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
📝 We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
$ conda -c conda-forge install python-blosc2 mkl
will let you fully utilize your CPUs?
⏩ Advanced SIMD
⏩ Multiple cores
⏩ Leverage caches efficiently
www.blosc.org/python-blosc...
Do not let your hardware sit idle; put it to work for you. Kudos to @conda-forge.org team! 🤟
The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨
ironarray.io/blog/miniexp...
Enjoy!
The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨
ironarray.io/blog/miniexp...
Enjoy!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
See how: github.com/Blosc/python-blosc2/blob/main/examples/ndarray/jit-numpy-funcs.py
#DataScience #Python #Compression
Compress Better, Compute Bigger!
This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...
Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...
Enjoy!
This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...
Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...
Enjoy!
Continuing our "not an island" mood: stream remote datasets (HDF5, Zarr, B2Z) over HTTP/S3 lazily, and compute across formats in one expression: b2z + zarr * h5! Plus tiered caching & Win ARM64 wheels.
github.com/Blosc/python...
Compress Better, Compute Bigger 🚀
Continuing our "not an island" mood: stream remote datasets (HDF5, Zarr, B2Z) over HTTP/S3 lazily, and compute across formats in one expression: b2z + zarr * h5! Plus tiered caching & Win ARM64 wheels.
github.com/Blosc/python...
Compress Better, Compute Bigger 🚀
We've updated our recent blog post:
Check it out! 👇
www.blosc.org/posts/blosc2...
Compress Better, Compute Bigger
#Python #DataScience #Performance #OpenSource
We've updated our recent blog post:
Check it out! 👇
www.blosc.org/posts/blosc2...
Compress Better, Compute Bigger
#Python #DataScience #Performance #OpenSource
This is the new b2view Text User Interface that comes with latest Python-Blosc2 release.
github.com/Blosc/python...
Enjoy!
This is the new b2view Text User Interface that comes with latest Python-Blosc2 release.
github.com/Blosc/python...
Enjoy!
Upgrade now: pip install blosc2 --update
Learn more: github.com/Blosc/python...
#Python #Blosc2 #DataScience
Upgrade now: pip install blosc2 --update
Learn more: github.com/Blosc/python...
#Python #Blosc2 #DataScience
v4.0 integrates `miniexpr`: computing on cache-friendly blocks instead of RAM-heavy chunks.
🚀 Result? Massive speedups for memory-bound tasks (up to 4.5x in Cat2Cloud).
See benchmarks:
ironarray.io/blog/miniexp...
#Python #HPC #DataEngineering
v4.0 integrates `miniexpr`: computing on cache-friendly blocks instead of RAM-heavy chunks.
🚀 Result? Massive speedups for memory-bound tasks (up to 4.5x in Cat2Cloud).
See benchmarks:
ironarray.io/blog/miniexp...
#Python #HPC #DataEngineering
CTable.sort_by(view=True)[:k] and NDArray.iter_sorted(start=-k) read just that slice from the index sidecar instead of sorting everything: up to ~74× less time, ~193× less peak memory.
blosc.org/python-blosc...
Enjoy data!
#Python
CTable.sort_by(view=True)[:k] and NDArray.iter_sorted(start=-k) read just that slice from the index sidecar instead of sorting everything: up to ~74× less time, ~193× less peak memory.
blosc.org/python-blosc...
Enjoy data!
#Python
One lazy API for unite all remote data: browse B2Z/Zarr/HDF5 hierarchies over S3/GCS/HTTP, slice only what you need, cache in RAM or on disk, and export portable snapshots.
b2view demo below👇
github.com/Blosc/python...
Compress Better, Compute Bigger 🚀
One lazy API for unite all remote data: browse B2Z/Zarr/HDF5 hierarchies over S3/GCS/HTTP, slice only what you need, cache in RAM or on disk, and export portable snapshots.
b2view demo below👇
github.com/Blosc/python...
Compress Better, Compute Bigger 🚀
¡Unlock new levels of data manipulation with #Blosc2! 🚀
We've tamed the complexity of fancy indexing to make it intuitive, efficient, and consistent with NumPy's behavior.
👉 www.blosc.org/posts/blosc2...
Enjoy
#Python #DataScience #BigData #NumPy #Performance
¡Unlock new levels of data manipulation with #Blosc2! 🚀
We've tamed the complexity of fancy indexing to make it intuitive, efficient, and consistent with NumPy's behavior.
👉 www.blosc.org/posts/blosc2...
Enjoy
#Python #DataScience #BigData #NumPy #Performance
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
🚀 Outperforms NumPy by 10x ~ 100x for large computations
🐍 Integrates seamlessly with the Python data science ecosystem
💻 Works both in-memory and on-disk with minimal performance differences
ironarray.io/blog/compute...
See an introduction to the shiny new compute engine at: www.blosc.org/python-blosc...
Looking forward to what you can build with Python-Blosc2 3.0!
** Compress Better, Compute Bigger! **
See an introduction to the shiny new compute engine at: www.blosc.org/python-blosc...
Looking forward to what you can build with Python-Blosc2 3.0!
** Compress Better, Compute Bigger! **
We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!👇️
Notebook - github.com/Blosc/python...)
We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!👇️
Notebook - github.com/Blosc/python...)
Newton-Raphson runs 2.7× faster on the browser! 💨
With #Pyodide, it’s not just Python in the browser: it’s the PyData stack 📊 too, #Blosc2 tacking compression 📦 + computing 🧮 duties.
Demo 👇
blosc.org/demos/newton...
Newton-Raphson runs 2.7× faster on the browser! 💨
With #Pyodide, it’s not just Python in the browser: it’s the PyData stack 📊 too, #Blosc2 tacking compression 📦 + computing 🧮 duties.
Demo 👇
blosc.org/demos/newton...