taskqueue: Task Queue for Parallel Computing Based on PostgreSQL

Implements a task queue system for asynchronous parallel computing using 'PostgreSQL' <https://www.postgresql.org/> as a backend. Designed for embarrassingly parallel problems where tasks do not communicate with each other. Dynamically distributes tasks to workers, handles uneven load balancing, and allows new workers to join at any time. Particularly useful for running large numbers of independent tasks on high-performance computing (HPC) clusters with 'SLURM' <https://slurm.schedmd.com/> job schedulers.

Version: 0.2.0
Depends: R (≥ 4.1.0)
Imports: settings, stats, stringr, RPostgres, ggplot2, whisker, rlang, shiny, DBI, ssh
Suggests: knitr, rmarkdown, testthat (≥ 3.0.0)
Published: 2025-12-03
DOI: 10.32614/CRAN.package.taskqueue (may not be active yet)
Author: Bangyou Zheng [aut, cre]
Maintainer: Bangyou Zheng <bangyou.zheng at csiro.au>
BugReports: https://github.com/byzheng/taskqueue/issues
License: MIT + file LICENSE
URL: https://taskqueue.bangyou.me/, https://github.com/byzheng/taskqueue
NeedsCompilation: no
Citation: taskqueue citation info
CRAN checks: taskqueue results

Documentation:

Reference manual: taskqueue.html , taskqueue.pdf
Vignettes: Getting Started with taskqueue (source)
PostgreSQL Setup for taskqueue (source)
Simple Workflow with tq_apply (source)
SSH Setup for taskqueue (source)

Downloads:

Package source: taskqueue_0.2.0.tar.gz
Windows binaries: r-devel: not available, r-release: not available, r-oldrel: not available
macOS binaries: r-release (arm64): taskqueue_0.2.0.tgz, r-oldrel (arm64): taskqueue_0.2.0.tgz, r-release (x86_64): taskqueue_0.2.0.tgz, r-oldrel (x86_64): taskqueue_0.2.0.tgz

Linking:

Please use the canonical form https://CRAN.R-project.org/package=taskqueue to link to this page.