Had such a great time talking SolidQueue batches, yrby and Rails in general with David!
@jpcamara.com joins me this week to talk about bringing batches to Solid Queue, cutting performance overhead from 200% to 10%, among other topics.
Plus, how RailsConf helped get a long-awaited feature shipped.
Listen here: therubyonrailspodcast.com/558
Plus, how RailsConf helped get a long-awaited feature shipped.
Listen here: therubyonrailspodcast.com/558
therubyonrailspodcast.com
October 28, 2026 at 7:40 PM
Had such a great time talking SolidQueue batches, yrby and Rails in general with David!
For those who missed them, these are the online hosted slides from my March 2026 Montreal.rb talk: Solid Queue: Rails ActiveJob DB-based Queuing Backend. They only work in a desktop browser.
docs.google.com/presentation...
#ruby #rails #solidqueue
docs.google.com/presentation...
#ruby #rails #solidqueue
Solid Queue: Rails ActiveJob DB-based Queuing Backend - Montreal.rb 2026-03-18
Solid Queue: Rails ActiveJob DB-based Queuing Backend Andy Maleh • Senior Software Engineer • Eltropy Canada • MS in Software Engineering • RubyConf/RailsConf Speaker • Fukuoka Prefecture Future IT In...
docs.google.com
October 21, 2026 at 10:21 PM
For those who missed them, these are the online hosted slides from my March 2026 Montreal.rb talk: Solid Queue: Rails ActiveJob DB-based Queuing Backend. They only work in a desktop browser.
docs.google.com/presentation...
#ruby #rails #solidqueue
docs.google.com/presentation...
#ruby #rails #solidqueue
The October 2026 Montreal.rb Ruby Meetup "A Peek Under the Hood of Solid Queue (by Robert Jakubowicz) + Book Club" is happening on Wednesday, October 21st
RSVP: www.meetup.com/montrealrb/e...
#ruby #meetup #rails #solidqueue #montrealrb #softwareengineering #programming #dev
RSVP: www.meetup.com/montrealrb/e...
#ruby #meetup #rails #solidqueue #montrealrb #softwareengineering #programming #dev
A Peek Under the Hood of Solid Queue (by Robert Jakubowicz) + Book Club, Wed, Oct 21, 2026, 6:30 PM | Meetup
This meetup will include a book club discussion at the end for the O'Reilly book "Designing Data-Intensive Applications" 2nd edition. Read the first 60 pages for this meetu
www.meetup.com
October 12, 2026 at 3:22 PM
The October 2026 Montreal.rb Ruby Meetup "A Peek Under the Hood of Solid Queue (by Robert Jakubowicz) + Book Club" is happening on Wednesday, October 21st
RSVP: www.meetup.com/montrealrb/e...
#ruby #meetup #rails #solidqueue #montrealrb #softwareengineering #programming #dev
RSVP: www.meetup.com/montrealrb/e...
#ruby #meetup #rails #solidqueue #montrealrb #softwareengineering #programming #dev
Ha! @rosa.codes kindly merged my batch support PR for Mission Control Jobs last month, and I didn't even realize it! So if you're using SolidQueue batches, MissionControl has you covered github.com/rails/missio...
Release v1.3.0 · rails/mission_control-jobs
Relevant changes in this release are support for batches (thanks @jpcamara!) and sorting failed jobs in descending order, a very requested change 😊
What's Changed
Document authentication via route...
github.com
October 9, 2026 at 2:10 PM
Ha! @rosa.codes kindly merged my batch support PR for Mission Control Jobs last month, and I didn't even realize it! So if you're using SolidQueue batches, MissionControl has you covered github.com/rails/missio...
Two things have been seriously getting on my nerves:
The lack of a good dashboard for Rails’ default background job system, SolidQueue.
Having to jump through hoops to integrate existing dashboards into an admin panel.
The SolidQueue added to Tramway right into admin area.
The lack of a good dashboard for Rails’ default background job system, SolidQueue.
Having to jump through hoops to integrate existing dashboards into an admin panel.
The SolidQueue added to Tramway right into admin area.
October 6, 2026 at 12:45 PM
Two things have been seriously getting on my nerves:
The lack of a good dashboard for Rails’ default background job system, SolidQueue.
Having to jump through hoops to integrate existing dashboards into an admin panel.
The SolidQueue added to Tramway right into admin area.
The lack of a good dashboard for Rails’ default background job system, SolidQueue.
Having to jump through hoops to integrate existing dashboards into an admin panel.
The SolidQueue added to Tramway right into admin area.
If you know of some good SolidQueue torture tests, I'd love to take a look at them in any case.
September 29, 2026 at 7:50 PM
If you know of some good SolidQueue torture tests, I'd love to take a look at them in any case.
Here’s the SolidQueue batches 2.5 year architectural journey, filled with O(n^2) algorithms, hot row contention, excessive jobs, and much in between.
There’s a strong chance you’ll learn a thing or two - I certainly did 😮💨
jpcamara.com/2026/08/31/s...
There’s a strong chance you’ll learn a thing or two - I certainly did 😮💨
jpcamara.com/2026/08/31/s...
SolidQueue Batches: evolution and architecture
When Rosa first released SolidQueue, she did a fantastic talk on the internals of how it works and what trade-offs she made when building it. You should give it a watch. It’s where I first learned how...
jpcamara.com
August 31, 2026 at 10:35 AM
Here’s the SolidQueue batches 2.5 year architectural journey, filled with O(n^2) algorithms, hot row contention, excessive jobs, and much in between.
There’s a strong chance you’ll learn a thing or two - I certainly did 😮💨
jpcamara.com/2026/08/31/s...
There’s a strong chance you’ll learn a thing or two - I certainly did 😮💨
jpcamara.com/2026/08/31/s...
The docs on SolidQueue batches are… solid 😉
In addition, I wrote up this blog post to dig in a bit further on how to use batches in SolidQueue, including some code inspiration - like splitting a RubyLLM chat into parallel sub agents using batches
jpcamara.com/2026/08/24/a...
In addition, I wrote up this blog post to dig in a bit further on how to use batches in SolidQueue, including some code inspiration - like splitting a RubyLLM chat into parallel sub agents using batches
jpcamara.com/2026/08/24/a...
A Guide to using Batches in SolidQueue
SolidQueue is the default queue system shipped with Ruby on Rails. It’s a great choice for your jobs, and works out of the box with Postgres, SQLite and MySQL.
It took two and a half years, but as of ...
jpcamara.com
August 24, 2026 at 12:09 PM
The docs on SolidQueue batches are… solid 😉
In addition, I wrote up this blog post to dig in a bit further on how to use batches in SolidQueue, including some code inspiration - like splitting a RubyLLM chat into parallel sub agents using batches
jpcamara.com/2026/08/24/a...
In addition, I wrote up this blog post to dig in a bit further on how to use batches in SolidQueue, including some code inspiration - like splitting a RubyLLM chat into parallel sub agents using batches
jpcamara.com/2026/08/24/a...
“Babe, wake up. They merged Batch support into SolidQueue” 👀 👀 👀
Have been waiting for this email for a couple of years!
Have been waiting for this email for a couple of years!
August 21, 2026 at 2:09 PM
“Babe, wake up. They merged Batch support into SolidQueue” 👀 👀 👀
Have been waiting for this email for a couple of years!
Have been waiting for this email for a couple of years!
I finally merged
@jpcamara.com's PR github.com/rails/solid_... to add job batches to Solid Queue. It only took two and a half years! 🤣 It's true artisanal code, though our own industrial revolution has helped take it to the finish line 😅✨️
@jpcamara.com's PR github.com/rails/solid_... to add job batches to Solid Queue. It only took two and a half years! 🤣 It's true artisanal code, though our own industrial revolution has helped take it to the finish line 😅✨️
Batch Support by jpcamara · Pull Request #142 · rails/solid_queue
Support for batches in SolidQueue!
Batches are a powerful feature in Sidekiq Pro and GoodJob which help with job coordination. A "Batch" is a collection of jobs, and when those jobs meet ...
github.com
August 21, 2026 at 12:01 PM
I finally merged
@jpcamara.com's PR github.com/rails/solid_... to add job batches to Solid Queue. It only took two and a half years! 🤣 It's true artisanal code, though our own industrial revolution has helped take it to the finish line 😅✨️
@jpcamara.com's PR github.com/rails/solid_... to add job batches to Solid Queue. It only took two and a half years! 🤣 It's true artisanal code, though our own industrial revolution has helped take it to the finish line 😅✨️
To me a more interesting comparison would be ActiveJob on SolidQueue vs ActiveJob on Sidekiq, since then you would be comparing two different back-end of the same "user-action".
What you did is more of a Sidekiq/SolidQueue+ActiveJob comparison and we already know that Sidekiq beats AJ by a lot.
What you did is more of a Sidekiq/SolidQueue+ActiveJob comparison and we already know that Sidekiq beats AJ by a lot.
November 18, 2024 at 9:57 PM
To me a more interesting comparison would be ActiveJob on SolidQueue vs ActiveJob on Sidekiq, since then you would be comparing two different back-end of the same "user-action".
What you did is more of a Sidekiq/SolidQueue+ActiveJob comparison and we already know that Sidekiq beats AJ by a lot.
What you did is more of a Sidekiq/SolidQueue+ActiveJob comparison and we already know that Sidekiq beats AJ by a lot.
Below are the Slides and GitHub repo of the talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend".
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
March 20, 2026 at 7:40 PM
Below are the Slides and GitHub repo of the talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend".
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Below are the Slides and GitHub repo of the talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend".
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Solid Queue: Rails ActiveJob DB-based Queuing Backend - Montreal.rb 2026-03-18
Solid Queue: Rails ActiveJob DB-based Queuing Backend Andy Maleh • Senior Software Engineer • Eltropy Canada • MS in Software Engineering • RubyConf/RailsConf Speaker • Fukuoka Prefecture Future IT In...
docs.google.com
March 20, 2026 at 7:40 PM
Below are the Slides and GitHub repo of the talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend".
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Google Slides:
docs.google.com/presentation...
GitHub Repo:
github.com/AndyObtiva/s...
#ruby #rails #rubyonrails #solidqueue #queuingbackend #messagequeues
Just a reminder that we are having the Montreal.rb March 2026 Ruby Meetup talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend" this Wed (Mar 18, 2026) at 6:30pm at Anticafe, Montreal, Quebec, Canada.
www.meetup.com/montrealrb/e...
#ruby #rails #rubyonrails #solidqueue #dev #programming
www.meetup.com/montrealrb/e...
#ruby #rails #rubyonrails #solidqueue #dev #programming
Solid Queue: Rails ActiveJob DB-based Queuing Backend, Wed, Mar 18, 2026, 6:30 PM | Meetup
**This event is planned without a speaker. You can volunteer to present this topic. If no volunteers come forward before the event date, it will be presented by the Montrea
www.meetup.com
March 17, 2026 at 2:37 AM
Just a reminder that we are having the Montreal.rb March 2026 Ruby Meetup talk "Solid Queue: Rails ActiveJob DB-based Queuing Backend" this Wed (Mar 18, 2026) at 6:30pm at Anticafe, Montreal, Quebec, Canada.
www.meetup.com/montrealrb/e...
#ruby #rails #rubyonrails #solidqueue #dev #programming
www.meetup.com/montrealrb/e...
#ruby #rails #rubyonrails #solidqueue #dev #programming
Ruby Boxを有効にしてRailsアプリケーションを実行するのを試行錯誤してるんだけど SolidQueue::Processes っていう定数名を見付けて solid_queue/processes を勝手にrequireしようとしてそんなファイル無いって死ぬの、なにこれ俺が悪いの? そもそもそのファイルが無いのが悪くない?? っていうかこの仕組みなんなの(知ってるよZeitworkだよね) requireくらい書いてくれないか???
January 4, 2026 at 5:27 AM
Ruby Boxを有効にしてRailsアプリケーションを実行するのを試行錯誤してるんだけど SolidQueue::Processes っていう定数名を見付けて solid_queue/processes を勝手にrequireしようとしてそんなファイル無いって死ぬの、なにこれ俺が悪いの? そもそもそのファイルが無いのが悪くない?? っていうかこの仕組みなんなの(知ってるよZeitworkだよね) requireくらい書いてくれないか???
SolidQueue, the default ActiveJob's adapter in Rails, is very cool. But there is a catch - it needs 1Gb RAM to make all things out of the box working fine. That means it's not good for Heroku default Dynos. Surprise - github.com/rails/solid_...
#rails #solidqueue #activejob #heroku
#rails #solidqueue #activejob #heroku
Need advice on Solid Queue's memory usage · Issue #330 · rails/solid_queue
Ruby: 3.3.4 Rails: 7.2.1 Solid Queue: 0.7.0, 0.8.2 I run a Rails App on AWS EC2 instance with 1G of memory. I notice the solid queue process takes up 15-20% of the instance's memory, which becomes ...
github.com
October 10, 2025 at 12:13 AM
SolidQueue, the default ActiveJob's adapter in Rails, is very cool. But there is a catch - it needs 1Gb RAM to make all things out of the box working fine. That means it's not good for Heroku default Dynos. Surprise - github.com/rails/solid_...
#rails #solidqueue #activejob #heroku
#rails #solidqueue #activejob #heroku
We'll also have the one-and-only @rosa.codes, Maintainer of #SolidQueue!
June 13, 2025 at 4:27 PM
We'll also have the one-and-only @rosa.codes, Maintainer of #SolidQueue!
Mostly `POST /errors` to 5 projects, with occasional `GET /login`.
Used Locust with 50 users.
CPU hit ~60%, so it can handle more.
Didn’t set WEB_CONCURRENCY, so likely 1 Puma worker.
SolidQueue config attached.
Used Locust with 50 users.
CPU hit ~60%, so it can handle more.
Didn’t set WEB_CONCURRENCY, so likely 1 Puma worker.
SolidQueue config attached.
April 29, 2025 at 7:46 AM
Mostly `POST /errors` to 5 projects, with occasional `GET /login`.
Used Locust with 50 users.
CPU hit ~60%, so it can handle more.
Didn’t set WEB_CONCURRENCY, so likely 1 Puma worker.
SolidQueue config attached.
Used Locust with 50 users.
CPU hit ~60%, so it can handle more.
Didn’t set WEB_CONCURRENCY, so likely 1 Puma worker.
SolidQueue config attached.
I recently stress-tested an app I'm about to launch (an error tracker). It runs on SolidQueue (with SQLite) and SQLite. It handles ~2.5M writes/day (with 37–38 RPS) on 2 vCPU, 4 GB.
My other prod apps also use SQLite, but their load isn't nearly as interesting compared to this stress test.
My other prod apps also use SQLite, but their load isn't nearly as interesting compared to this stress test.
April 28, 2025 at 9:38 PM
I recently stress-tested an app I'm about to launch (an error tracker). It runs on SolidQueue (with SQLite) and SQLite. It handles ~2.5M writes/day (with 37–38 RPS) on 2 vCPU, 4 GB.
My other prod apps also use SQLite, but their load isn't nearly as interesting compared to this stress test.
My other prod apps also use SQLite, but their load isn't nearly as interesting compared to this stress test.
It's always great to see @rosa and she talked about her #solidqueue implementation at #rubycommunityconference in #krakow.
She also gave a shout-out to @bensheldon's #goodjob and mentioned how @getajobmike's @sidekiq is blazingly fast.
#ruby #rails #queue […]
[Original post on ruby.social]
She also gave a shout-out to @bensheldon's #goodjob and mentioned how @getajobmike's @sidekiq is blazingly fast.
#ruby #rails #queue […]
[Original post on ruby.social]
February 28, 2025 at 5:32 PM
It's always great to see @rosa and she talked about her #solidqueue implementation at #rubycommunityconference in #krakow.
She also gave a shout-out to @bensheldon's #goodjob and mentioned how @getajobmike's @sidekiq is blazingly fast.
#ruby #rails #queue […]
[Original post on ruby.social]
She also gave a shout-out to @bensheldon's #goodjob and mentioned how @getajobmike's @sidekiq is blazingly fast.
#ruby #rails #queue […]
[Original post on ruby.social]
I Love You, Redis, but I'm Leaving You for SolidQueue [Discussion]
I Love You, Redis, but I'm Leaving You for SolidQueue
I Love You, Redis, but I'm Leaving You for SolidQueue
www.simplethread.com
January 14, 2026 at 12:52 PM
I Love You, Redis, but I'm Leaving You for SolidQueue [Discussion]