Solid Queue v1.0 Released
Solid Queue 1.0 was released at Rails World, featuring batch operations and recurring jobs. HEY processes 20 million jobs daily, with plans for further enhancements and migrating Basecamp 4.
Read original article
Solid Queue 1.0 has been officially released, coinciding with the Rails World conference. This major update follows the initial version 0.1.1 released in December 2023 and includes significant enhancements, such as safe batch operations for job management, bulk job enqueueing, recurring jobs, improved logging, and lifecycle hooks. The migration of HEY, the email and calendar service, from Resque to Solid Queue has been completed, with HEY currently processing around 20 million jobs daily using a robust infrastructure of 800 workers and multiple VMs. The production setup utilizes a separate database for Solid Queue, optimized for performance with substantial CPU and memory resources. The team has expressed gratitude to community contributors who assisted with PostgreSQL and SQLite support. Looking ahead, the focus will shift back to Mission Control – Jobs, with plans for further scalability improvements and the migration of Basecamp 4, which handles a significantly higher job volume.
- Solid Queue 1.0 was released just before Rails World.
- The update includes features like batch operations, bulk enqueueing, and recurring jobs.
- HEY processes approximately 20 million jobs daily with a complex infrastructure.
- The Solid Queue database is optimized with dedicated resources for performance.
- Future plans include enhancing Mission Control – Jobs and migrating Basecamp 4.
Related
BlockQueue: SQLite-powered pub/sub for lean, fast messaging
Block Queue is a lightweight, cost-effective messaging system using a pub/sub mechanism, built on SQLite3 and NutsDB, supporting Turso Database and PostgreSQL, with high performance and open-source availability.
Show HN: PgQueuer – Transform PostgreSQL into a Job Queue
PgQueuer is a Python job queue library using PostgreSQL, offering efficient concurrency, real-time notifications, and easy installation via pip. It includes examples for consumers and producers, with additional resources available.
Scaling Rails and Postgres to Users at Microsoft: Lessons and Takeaways
Andrew Atkinson discusses scaling Ruby on Rails applications with PostgreSQL, emphasizing ActiveRecord optimization, Sidekiq for background jobs, and addressing challenges like high concurrency and seasonal traffic in educational software.
0 commentsRelated
BlockQueue: SQLite-powered pub/sub for lean, fast messaging
Block Queue is a lightweight, cost-effective messaging system using a pub/sub mechanism, built on SQLite3 and NutsDB, supporting Turso Database and PostgreSQL, with high performance and open-source availability.
Show HN: PgQueuer – Transform PostgreSQL into a Job Queue
PgQueuer is a Python job queue library using PostgreSQL, offering efficient concurrency, real-time notifications, and easy installation via pip. It includes examples for consumers and producers, with additional resources available.
Scaling Rails and Postgres to Users at Microsoft: Lessons and Takeaways
Andrew Atkinson discusses scaling Ruby on Rails applications with PostgreSQL, emphasizing ActiveRecord optimization, Sidekiq for background jobs, and addressing challenges like high concurrency and seasonal traffic in educational software.