Last updated on 2025-12-20 11:50:28 CET.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.4.0 | 15.69 | 308.76 | 324.45 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.4.0 | 8.96 | 209.65 | 218.61 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.4.0 | 23.00 | 432.52 | 455.52 | ERROR | |
| r-devel-linux-x86_64-fedora-gcc | 0.4.0 | 22.00 | 409.12 | 431.12 | ERROR | |
| r-devel-windows-x86_64 | 0.4.0 | 18.00 | 293.00 | 311.00 | OK | |
| r-patched-linux-x86_64 | 0.4.0 | 15.65 | 318.37 | 334.02 | OK | |
| r-release-linux-x86_64 | 0.4.0 | 13.22 | 320.29 | 333.51 | OK | |
| r-release-macos-arm64 | 0.4.0 | OK | ||||
| r-release-macos-x86_64 | 0.4.0 | 9.00 | 267.00 | 276.00 | OK | |
| r-release-windows-x86_64 | 0.4.0 | 17.00 | 291.00 | 308.00 | OK | |
| r-oldrel-macos-arm64 | 0.4.0 | OK | ||||
| r-oldrel-macos-x86_64 | 0.4.0 | 9.00 | 252.00 | 261.00 | OK | |
| r-oldrel-windows-x86_64 | 0.4.0 | 22.00 | 408.00 | 430.00 | OK |
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [04:34:34.601] [mlr3] Running benchmark with 4 resampling iterations
INFO [04:34:35.052] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [04:34:35.178] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [04:34:35.269] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [04:34:35.331] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [04:34:35.461] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [31s/26s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [04:35:15.844] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:16.066] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:16.482] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:16.788] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:17.014] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:17.649] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:18.419] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:19.139] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [04:35:33.180] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:33.470] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:36:21.954] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:37:07.635] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:37:54.913] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:37:55.527] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:37:56.108] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:37:56.576] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [04:38:02.992] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [04:38:03.304] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [04:38:03.401] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [04:38:03.440] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [04:38:03.484] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [04:38:03.525] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [04:38:14.839] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:38:15.436] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:38:17.831] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:38:19.646] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:38:21.515] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:38:21.603] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:38:21.674] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:38:21.754] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:14:08.036] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:14:08.187] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:14:08.239] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:14:08.321] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:14:08.368] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:14:08.419] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [21s/26s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:14:46.817] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:14:47.065] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:14:47.467] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:14:47.966] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:14:48.636] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:14:50.798] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:14:51.711] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:14:52.463] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:15:05.770] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:15:06.086] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:15:36.226] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:16:02.426] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:16:27.328] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:16:28.173] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:16:28.888] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:16:29.710] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:16:37.241] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:16:37.512] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:16:37.675] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:16:37.771] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:16:37.876] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:16:37.943] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:16:51.178] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:16:51.687] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:16:53.590] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:16:55.315] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:16:57.040] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:16:57.215] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:16:57.390] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:16:57.565] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:47:23.935] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:47:24.373] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:47:24.547] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:47:24.706] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:47:24.916] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:47:25.144] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [39s/60s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:48:54.201] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:48:54.633] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:48:55.104] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:48:55.361] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:48:55.763] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:48:56.823] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:48:58.203] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:48:59.155] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:49:18.130] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:49:18.501] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:50:24.321] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:51:30.411] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:52:27.909] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:52:28.654] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:52:29.615] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:52:30.401] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:52:44.843] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:52:45.753] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:52:46.283] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:52:46.425] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:52:46.569] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:52:46.704] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:53:14.324] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:53:15.141] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:53:19.623] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:53:23.466] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:53:27.593] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:53:27.809] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:53:27.965] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:53:28.585] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [12:29:47.604] [mlr3] Running benchmark with 4 resampling iterations
INFO [12:29:48.169] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [12:29:48.379] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [12:29:48.530] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [12:29:48.705] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [12:29:48.827] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [32s/38s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [12:31:02.997] [mlr3] Running benchmark with 6 resampling iterations
INFO [12:31:03.448] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:31:03.939] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:31:04.407] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:31:04.974] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:31:06.127] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:31:07.534] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:31:09.666] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [12:31:38.197] [mlr3] Running benchmark with 6 resampling iterations
INFO [12:31:38.683] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [12:32:32.496] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [12:33:52.735] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [12:34:40.029] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:34:42.002] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:34:43.050] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:34:43.906] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [12:34:53.463] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [12:34:53.799] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [12:34:54.025] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [12:34:54.108] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [12:34:54.168] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [12:34:54.254] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [12:35:11.892] [mlr3] Running benchmark with 6 resampling iterations
INFO [12:35:12.188] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [12:35:15.711] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [12:35:19.075] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [12:35:22.988] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:35:23.284] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:35:23.464] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:35:23.717] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc