#irods
try iRODS with the s3 bridge. I'm told it is a pleasant experience compared to the alternatives.

Should be doubly so with llms handling its eccentricities.
September 25, 2026 at 5:39 AM
iRODS Development Update: September 2026
Hello reader, For the server, we identified that the ObjStat API can return information about replicas that are not marked good. Work to correct that is nearing completion. We've fixed a logical quotas bug where it would count similarly-named collections. We've fixed a delay server bug which resulted in it connecting as the local rodsadmin. The S3 resource plugin has been updated to detect and report when a file upload exceeds the 10,000 part limit. Visit the GitHub repository to learn more. Aside from that, we've also fixed three issues involving shared memory. For the Python iRODS client, we've exposed the `RULE_EXEC_CONTEXT` column for GenQuery1. Work to fix a bug involving unexpected preservation of flags across session objects is nearing completion as well. For the HTTP API, support for physical quotas and logical quotas has been added. We've also fixed a long-standing bug involving reserved characters and application/x-www-form-urlencoded. Thanks for reading. ### September Technology Working Group * Imaging Working Group * working on an OMERO integration * working meeting * Thur, September 17, 2026, 10am ET * Community Office Hours * third Wednesday of every month * Wed, September 16, 2026, 930am ET * 5.1.0 * 1 bug / 5 open, 207 closed * New Development Work * no updates * Active Development Work * iRODS Server * updating ObjStat API to prefer good replicas as originally intended * fixed bug in logical quotas where it would count similarly-named collections * fixed bug in which delay server would connect as rodsadmin instead of requested user * Build and Packaging * added support for Ubuntu 26.04 * S3 Resource Plugin * updated plugin to detect when upload will exceed the 10000 part limit * based on thread count and circular buffer size * when detected, reports detailed error message * fixed 3 cases where shared memory is leaked * Python iRODS Client (PRC) * completed work for automated testing of the PAM Interactive auth scheme * added support for querying the RULE_EXEC_CONTEXT column via GenQuery * fixing issue where admin settings are preserved across independent sessions * iRODS HTTP API * added support for physical quotas * added support for built-in logical quotas * updated server to parse application/x-www-form-urlencoded data correctly * iRODS System Tray * released 0.1.0 * https://github.com/irods-contrib/irods_client_system_tray/releases/tag/0.1.0 * Background Items * Logical Quotas Rule Engine Plugin * last update: August 2026 * released 5.1.1 and 5.1.0 for iRODS 5 * released 4.3.5.1 and 4.3.4.1 for iRODS 4.3 * Globus Connector * last update: August 2026 * released 5.1.0 * iRODS S3 API * last update: August 2026 * released 0.6.0 * irods4j * last update: August 2026 * fixed handling of SHARED_SECRET payload for TLS * motivated by https://github.com/iterate-ch/cyberduck/issues/18152 * released 0.7.0 * R client (rirods) * last update: August 2026 * released 0.3.0 * no functional changes * updated maintainer information for CRAN * Audit AMQP Rule Engine Plugin * last update: June 2026 * updating ELK stack, used for training * implementing long-lived AMQP connection * implementing multi-endpoint support * exposing many new configuration options * https://github.com/irods/irods_rule_engine_plugin_audit_amqp/pull/185 * Policy Composition * last update: April 2026 * released 0.1.0 * PAM Interactive Authentication Plugin * last update: March 2026 * released 0.1.1 (for 4.3.5) * Python Rule Engine Plugin * last update: March 2026 * released 4.3.5.0 * Indexing Capability * last update: March 2026 * released 4.3.5.0 * Metadata Guard Rule Engine Plugin * last update: March 2026 * released 4.3.5.0 * CURL Microservices Plugin * last update: March 2026 * released 4.3.5.0 * Storage Tiering Capability * last update: March 2026 * released 4.3.5.0 * Docker-based Testing Environment * last update: March 2026 * added options for testing upgrade logic in an automated fashion * Cyberduck * last update: March 2026 * released 9.4.0 * includes irods4j-backed implementation * requires a minimum server version of iRODS 4.3.2 * idrop * last update: March 2026 * switched from maven-assembly plugin to maven-shade plugin for building uber JARs * added OS-specific build scripts for Linux and Windows * HTTP API Python Wrapper * last update: March 2026 * released 0.1.0 * https://pypi.org/project/irods-http/ * Automated Ingest Capability * last updated: January 2026 * added automated testing via GitHub Actions * Metalnx * last updated: November 2025 * released 3.1.1 * Docker-based Development Environment * last update: August 2025 * genericizing EL Dockerfiles * Zone Management Tool * last update: August 2025 * released 0.4.1 * intern has resolved build failures * Jargon * last update: August 2025 * updated to support change in rcGeneralAdmin for adding groups in iRODS 4.3.4+ * NFSRODS * last update: July 2025 * released 2.3.1 * Mungefs * last update: April 2025 * updating CMake policy requirements for newer versions of CMake * migrated externals package to use system-provided libarchive and ZeroMQ * CockroachDB Database Plugin * last update: September 2024 * CRDB license has changed * iRODS Kubernetes Testing Environment * last update: April 2024 * v9 of the build and test infrastructure * can stand up iRODS Providers and Consumers * can run core tests * running in RENCI K8s cluster, but could run on any cluster * iRODS Password Booth * last update: February 2024 * CherryPy web application, uses PRC to let users modify their own password * iRODS Command Line Interface (CLI) * last update: September 2023 * added support for many basic operations * ls, mv, tree, mkdir, get, put, cd, pwd, touch, etc * presented at UGM 2023 * Logical Locking * last update: August 2021 * read-locks to be implemented * New RPC API framework * last update: July 2021 * leverages design from Authentication Working Group * supports synchronous and asynchronous operations * refactored into parallel_collection_operation base class * supports pre/post operations and an object operation * Hard Links Rule Engine Plugin * last update: July 2021 * awaiting more use cases before release * AWS S3 Lambda * last update: July 2020 * Publishing Capability * last update: August 2020 * needs more README * awaiting CI * Parallel Filesystem Integration * last update: March 2020 * iRODS API plugin * have split BeeGFS and Lustre implementations into aggregator and listener * testing against known configurations * Discussion * iRODS Consortium AI Policy v20260723 * Plan is to publish this on the website * iRODS Consortium Mission * The mission of the iRODS Consortium is to ensure the sustainability of the integrated Rule-Oriented Data System (iRODS) and to further its adoption and continued evolution. To this end, the Consortium works to standardize the definition, development, and release of iRODS-based data middleware technologies, evangelize iRODS among potential users, promote new advances in iRODS, and expand the adoption of iRODS-based data middleware technologies through the development and release of iRODS as open-source, mission-critical, production-level software. * iRODS Consortium Artificial Intelligence (AI) Policy * The iRODS Consortium has a responsibility to develop and maintain the iRODS technologies at a quality suitable for mission-critical, production-level deployments. * The Consortium takes no position on the particular software and design tools used to meet that bar of quality.
irods.org
September 23, 2026 at 12:13 AM
iRODS Development Update: September 2026

irods.org/2026/09/irod...

#irods #s3 #python #http
iRODSiRODS
irods.org
September 22, 2026 at 11:17 AM
iRODS Community Office Hours
Wed, Sept 16 - 930a EDT / 330pm CEST
Ask / Discuss / Learn / Not Recorded

Zoom: renci.zoom.us/j/9268609054...
September 16, 2026 at 1:48 AM
Which of these is irods + the s3 bridge?
September 4, 2026 at 6:50 PM
Scripps Research joins the iRODS Consortium

irods.org/2026/08/scri...
iRODSiRODS
irods.org
August 31, 2026 at 5:45 PM
Scripps Research joins the iRODS Consortium
Scripps Research has become the newest member of the iRODS Consortium, the membership-based organization that leads development and support of the integrated Rule-Oriented Data System (iRODS). The amount of data produced by biomedical research has increased rapidly over the past few decades. At Scripps Research, scientists using techniques such as cryo-electron microscopy (cryo-EM), other advanced microscopy, genomic sequencing, or nuclear magnetic resonance need ways to effectively manage and store the vast amounts of data produced by these approaches. The High Performance Computing (HPC) core at Scripps Research works with scientists across disciplines, providing compute, storage and archival capabilities. The HPC core is now implementing iRODS within their data management systems. iRODS is an open-source, policy-based software used by research, commercial, and government organizations around the world. The iRODS software allows you to store, manage and share large amounts of data, including their metadata, between different organizations and platforms and provides a mechanism for defining rules for their storage, processing, and distribution. iRODS is designed to support collaboration, interoperability, and scalability of data infrastructures. The iRODS software has been deployed at thousands of locations worldwide for long-term management of data in various industries such as the oil and gas industry, biosciences, physical sciences, archives, and media and entertainment. Through the HPC core, data administrators representing each domain—such as cryo-EM, genomics, and more—will be able to use iRODS to manage their data. Once initial analysis is completed, raw data will be automatically moved though iRODS to more cost-effective archival storage, while remaining accessible to users when needed. "We are very happy to welcome Scripps Research and their impressive history of scientific discovery to the Consortium." says Terrell Russell, Executive Director of the iRODS Consortium. "We look forward to helping think through hard problems and to continue learning from some of the best practitioners in the world." "The iRODS Consortium hosts regular meetings with its members, which is a really beneficial opportunity for our team," says JC Ducom, the HPC manager at Scripps Research. "These meetings allow us to ask questions, solve problems, share knowledge and ultimately implement best practices with the help of the consortium’s expertise." ## About the iRODS Consortium The iRODS Consortium is a membership organization that supports the development of the integrated Rule-Oriented Data System (iRODS), free open source software for data virtualization, data discovery, workflow automation, and secure collaboration. The iRODS Consortium provides a production-ready iRODS distribution and iRODS training, professional integration services, and support. The world’s top researchers in life sciences, geosciences, and information management use iRODS to control their data. The development team of the iRODS Consortium is based at the Renaissance Computing Institute (RENCI), which is affiliated with the University of North Carolina at Chapel Hill, USA. To learn more about iRODS and the iRODS Consortium, please visit irods.org. ## About Scripps Research Scripps Research is an independent, nonprofit biomedical research institute ranked one of the most influential in the world for its impact on innovation by Nature Index. We are advancing human health through profound discoveries that address pressing medical concerns around the globe. Our drug discovery and development division, Calibr-Skaggs, works hand-in-hand with scientists across disciplines to bring new medicines to patients as quickly and efficiently as possible, while teams at Scripps Research Translational Institute harness genomics, digital medicine and cutting-edge informatics to understand individual health and render more effective healthcare. Scripps Research also trains the next generation of leading scientists at our Skaggs Graduate School, consistently named among the top 10 US programs for chemistry and biological sciences. Learn more at www.scripps.edu.
irods.org
September 1, 2026 at 12:13 AM
iRODS Development Update: August 2026
Hello reader, We've made it through another month, which means it's time for the development update. First, slides and videos from the 2026 iRODS User Group Meeting are now available. All videos and presentation material can be found at https://irods.org/library. More specifically, https://irods.org/library is a new tool that makes it easy to find all the presentations, slides, videos, and other information from all past user group meetings back to 2009. We had the pleasure of working with three interns this summer. Through their hard work comes a brand new GUI-based ingest tool for the system tray (Windows) and menu bar (MacOS). The tool is built for ease-of-use and is released as 0.1.0. Learn more by watching the interns' presentations and visiting the GitHub repository at https://github.com/irods-contrib/irods_client_system_tray. iRODS 5.1.0 is still creeping towards a release. Support for Ubuntu 26.04 is complete and work to tighten the screws is in progress. With that comes a new vault path random scheme style that removes the filename from the physical path. The quality of stacktraces has been improved by moving the responsibility of logging them from the main server process to the agent factory. `istream` has been updated to report iRODS error codes on failure and `ils` has been updated to handle file permission errors. The work to improve testing of PAM Interactive authentication in the Python iRODS client (PRC) has been merged. This work makes sure that multi-step authentication flows are supported and operating as intended. irods4j 0.7.0 is now available. This release fixes a bug involving TLS and server redirects. See the release notes at https://github.com/irods/irods4j/releases/tag/0.7.0 to learn more. During the user group meeting, we had a discussion regarding the iRODS Consortium's yet-to-exist policy on AI usage. That has resulted in draft wording located under the Discussion section. We look forward to community feedback. Thanks for reading. ### August Technology Working Group * Imaging Working Group * working on an OMERO integration * working meeting * Thur, August 20, 2026, 10am ET * Community Office Hours * third Wednesday of every month * Wed, August 19, 2026, 930am ET * 5.1.0 * 1 bug / 5 open, 196 closed * New Development Work * https://irods.org/library/ * webpage that makes it easy to find past UGM presentations, slides, and videos * interns putting finishing touches on new project and preparing presentations * Active Development Work * iRODS Server * fixed ils core dump caused by file permission issues * working on improving logging of database error messages * merged new random scheme style option that removes filename from physical path * https://github.com/irods/irods/pull/9040 * improved stacktrace quality by having the agent factory log stacktrace files * updated istream to report iRODS error codes on failure * Build and Packaging * Ubuntu 26.04 support is almost done * Logical Quotas Rule Engine Plugin * released 5.1.1 and 5.1.0 for iRODS 5 * released 4.3.5.1 and 4.3.4.1 for iRODS 4.3 * S3 Resource Plugin * released 5.1.0 * working on supporting uploads that would require more than the 10000-part limit * applies to the current scheme * circular buffers will be drained immediately * does not need to be large enough to hold the entire part in memory * retries on part upload failures are disabled * no mechanism to have the client resend them * Globus Connector * released 5.1.0 * Python iRODS Client (PRC) * working on automated testing for PAM Interactive auth scheme * iRODS HTTP API * released 0.7.0 * iRODS S3 API * released 0.6.0 * irods4j * fixed handling of SHARED_SECRET payload for TLS * motivated by https://github.com/iterate-ch/cyberduck/issues/18152 * released 0.7.0 * R client (rirods) * released 0.3.0 * no functional changes * updated maintainer information for CRAN * Background Items * Audit AMQP Rule Engine Plugin * last update: June 2026 * updating ELK stack, used for training * implementing long-lived AMQP connection * implementing multi-endpoint support * exposing many new configuration options * https://github.com/irods/irods_rule_engine_plugin_audit_amqp/pull/185 * iRODS GenQuery2 API Plugin * last update: June 2026 * project is EOL, archived May 2026 * NetCDF Microservices Plugin * last update: June 2026 * project is EOL, archived May 2026 * Policy Composition * last update: April 2026 * released 0.1.0 * PAM Interactive Authentication Plugin * last update: March 2026 * released 0.1.1 (for 4.3.5) * Python Rule Engine Plugin * last update: March 2026 * released 4.3.5.0 * Indexing Capability * last update: March 2026 * released 4.3.5.0 * Metadata Guard Rule Engine Plugin * last update: March 2026 * released 4.3.5.0 * CURL Microservices Plugin * last update: March 2026 * released 4.3.5.0 * Storage Tiering Capability * last update: March 2026 * released 4.3.5.0 * Docker-based Testing Environment * last update: March 2026 * added options for testing upgrade logic in an automated fashion * Cyberduck * last update: March 2026 * released 9.4.0 * includes irods4j-backed implementation * requires a minimum server version of iRODS 4.3.2 * idrop * last update: March 2026 * switched from maven-assembly plugin to maven-shade plugin for building uber JARs * added OS-specific build scripts for Linux and Windows * HTTP API Python Wrapper * last update: March 2026 * released 0.1.0 * https://pypi.org/project/irods-http/ * Automated Ingest Capability * last updated: January 2026 * added automated testing via GitHub Actions * Metalnx * last updated: November 2025 * released 3.1.1 * Docker-based Development Environment * last update: August 2025 * genericizing EL Dockerfiles * Zone Management Tool * last update: August 2025 * released 0.4.1 * intern has resolved build failures * Jargon * last update: August 2025 * updated to support change in rcGeneralAdmin for adding groups in iRODS 4.3.4+ * NFSRODS * last update: July 2025 * released 2.3.1 * Mungefs * last update: April 2025 * updating CMake policy requirements for newer versions of CMake * migrated externals package to use system-provided libarchive and ZeroMQ * CockroachDB Database Plugin * last update: September 2024 * CRDB license has changed * iRODS Kubernetes Testing Environment * last update: April 2024 * v9 of the build and test infrastructure * can stand up iRODS Providers and Consumers * can run core tests * running in RENCI K8s cluster, but could run on any cluster * iRODS Password Booth * last update: February 2024 * CherryPy web application, uses PRC to let users modify their own password * iRODS Command Line Interface (CLI) * last update: September 2023 * added support for many basic operations * ls, mv, tree, mkdir, get, put, cd, pwd, touch, etc * presented at UGM 2023 * Logical Locking * last update: August 2021 * read-locks to be implemented * New RPC API framework * last update: July 2021 * leverages design from Authentication Working Group * supports synchronous and asynchronous operations * refactored into parallel_collection_operation base class * supports pre/post operations and an object operation * Hard Links Rule Engine Plugin * last update: July 2021 * awaiting more use cases before release * AWS S3 Lambda * last update: July 2020 * Publishing Capability * last update: August 2020 * needs more README * awaiting CI * Parallel Filesystem Integration * last update: March 2020 * iRODS API plugin * have split BeeGFS and Lustre implementations into aggregator and listener * testing against known configurations * Discussion * iRODS Consortium AI Policy v20260723 * iRODS Consortium Mission * The mission of the iRODS Consortium is to ensure the sustainability of the integrated Rule-Oriented Data System (iRODS) and to further its adoption and continued evolution. To this end, the Consortium works to standardize the definition, development, and release of iRODS-based data middleware technologies, evangelize iRODS among potential users, promote new advances in iRODS, and expand the adoption of iRODS-based data middleware technologies through the development and release of iRODS as open-source, mission-critical, production-level software. * iRODS Consortium Artificial Intelligence (AI) Policy * The iRODS Consortium has a responsibility to develop and maintain the iRODS technologies at a quality suitable for mission-critical, production-level deployments. * The Consortium takes no position on the particular software and design tools used to meet that bar of quality.
irods.org
August 26, 2026 at 12:13 AM
The primary use case is the automatic, hands-free ingest of incoming instrument data (e.g. images) into an iRODS Zone without filling up available storage on the client machine attached to the instrument.

Designed for use on Windows and MacOS.
August 23, 2026 at 7:30 PM
iRODS Client System Tray v0.1.0 is released!

This system tray application monitors a set of configured local directories and uploads files to the configured iRODS Collections. Built by our interns this summer.

github.com/irods-contri...
GitHub - irods-contrib/irods_client_system_tray: System Tray / Menu Bar application for iRODS Ingest
System Tray / Menu Bar application for iRODS Ingest - irods-contrib/irods_client_system_tray
github.com
August 23, 2026 at 7:30 PM
2026 iRODS Summer Internships are complete!

3 of 3 - Srujan Ponnapalli (NC State)

www.youtube.com/watch?v=BFLL...
2026 iRODS Summer Internship: System Tray App
YouTube video by The iRODS Consortium
www.youtube.com
August 21, 2026 at 9:17 PM
2026 iRODS Summer Internships are complete!

2 of 3 - Ryan Nguyen (UNC-Chapel Hill)

www.youtube.com/watch?v=QnNt...
2026 iRODS Summer Internship: System Tray Application
YouTube video by The iRODS Consortium
www.youtube.com
August 21, 2026 at 9:17 PM
2026 iRODS Summer Internships are complete!

1 of 3 - Larry Zhao (NC State)

www.youtube.com/watch?v=60nz...
2026 iRODS Summer Internship: System Tray Application for iRODS Ingest
YouTube video by The iRODS Consortium
www.youtube.com
August 21, 2026 at 9:17 PM
iRODS UGM2026 Slides and Videos are published.

irods.org/ugm2026/

40 talks.
iRODSiRODS
irods.org
August 4, 2026 at 5:15 PM
iRODS Development Update: July 2026
Hello reader, The iRODS User Group Meeting has come and gone. Big thanks to our sponsors, the speakers, and all attendees for making the conference a success. Videos will be posted in the near future. This month's development update highlights several software releases leading up to the conference. iRODS S3 resource plugin 5.1.0 is available. This release implements support for trailing checksums, the ability to read checksums directly from the storage device, and fixes bugs for archive mode and cache file usage. See the release notes at https://github.com/irods/irods_resource_plugin_s3/releases/tag/5.1.0 for more details. Four new releases of the iRODS Logical Quotas rule engine plugin are available. The plugin has been updated for iRODS 5, 4.3.5, and 4.3.4. It addresses bugs related to quota updates, server redirects, and permissions. See https://github.com/irods/irods_rule_engine_plugin_logical_quotas/releases for more information. iRODS HTTP API 0.7.0 has been released. It addresses a number of bugs and also re-purposes an existing configuration property. See the release notes at https://github.com/irods/irods_client_http_api/releases/tag/0.7.0 to learn more. iRODS Globus Connector 5.1.0 is available. This release improves the buildsystem, addresses build warnings, and adds a new configuration property for improving the performance of checksum calculations. The release notes are can be found at https://github.com/irods/irods_client_globus_connector/releases/tag/5.1.0. Thanks for reading.
irods.org
July 23, 2026 at 12:12 AM
iRODS Development Update: July 2026

irods.org/2026/07/irod...

#irods #cpp #s3 #http #globus
iRODSiRODS
irods.org
July 22, 2026 at 12:39 PM
iRODS Storage Tiering Rule Engine Plugin v5.1.0 is released!

This release makes it so that the plugin can calculate checksums without triggering a permission denied error.

github.com/irods/irods_...

#irods #cpp #tiering
Release 5.1.0 · irods/irods_capability_storage_tiering
This release makes it so that the plugin can calculate checksums without triggering a permission denied error. Fixed Fix permission denied error when rodsadmin user performs checksum operation (#3...
github.com
June 25, 2026 at 11:18 AM
iRODS Globus Connector v5.1.0 is released!

This release cleans up the buildsystem, addresses build warnings, and adds a new configuration property for improving the performance of checksum calculations.

github.com/irods/irods_...

#irods #cpp #globus
Release 5.1.0 · irods/irods_client_globus_connector
This release cleans up the buildsystem, addresses build warnings, and adds a new configuration property for improving the performance of checksum calculations. Changed Clean up header includes (#4...
github.com
June 25, 2026 at 11:18 AM
iRODS S3 Resource Plugin v5.1.0 is released!

This release implements support for trailing checksums, the ability to read checksums directly from the storage device, and fixes bugs for archive mode and cache file usage.

github.com/irods/irods_...

#irods #cpp #s3
Release 5.1.0 · irods/irods_resource_plugin_s3
This release implements support for trailing checksums, the ability to read checksums directly from the storage device, and fixes bugs for archive mode and cache file usage. Fixed Fix build by con...
github.com
June 25, 2026 at 11:18 AM
iRODS Logical Quotas Plugin v4.3.4.1 is released!
iRODS Logical Quotas Plugin v4.3.5.1 is released!
iRODS Logical Quotas Plugin v5.1.1 is released!

github.com/irods/irods_...

#irods #cpp #quotas
Release 5.1.1 · irods/irods_rule_engine_plugin_logical_quotas
This release reverts a commit to fix the logical_quotas_get_collection_status operation. Fixed Revert logic that unnecessarily escapes single quotes in GenQuery (#157).
github.com
June 21, 2026 at 4:00 AM