Last updated on 2025-12-13 13:48:46 CET.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.1.7 | 6.54 | 84.07 | 90.61 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.1.7 | 4.69 | 59.75 | 64.44 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.1.7 | 12.00 | 127.01 | 139.01 | ERROR | |
| r-devel-linux-x86_64-fedora-gcc | 0.1.7 | 11.00 | 116.14 | 127.14 | ERROR | |
| r-devel-windows-x86_64 | 0.1.7 | 9.00 | 83.00 | 92.00 | ERROR | |
| r-patched-linux-x86_64 | 0.1.7 | 6.13 | 74.13 | 80.26 | ERROR | |
| r-release-linux-x86_64 | 0.1.7 | 6.07 | 74.71 | 80.78 | ERROR | |
| r-release-macos-arm64 | 0.1.7 | OK | ||||
| r-release-macos-x86_64 | 0.1.7 | 4.00 | 59.00 | 63.00 | OK | |
| r-release-windows-x86_64 | 0.1.7 | 8.00 | 83.00 | 91.00 | OK | |
| r-oldrel-macos-arm64 | 0.1.7 | OK | ||||
| r-oldrel-macos-x86_64 | 0.1.7 | 4.00 | 71.00 | 75.00 | OK | |
| r-oldrel-windows-x86_64 | 0.1.7 | 11.00 | 105.00 | 116.00 | ERROR |
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [04:30:32.783] [mlr3] Running benchmark with 36 resampling iterations
INFO [04:30:32.845] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [04:30:32.905] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [04:30:32.936] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [04:30:33.033] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [04:30:33.072] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [04:30:33.111] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [04:30:33.149] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [04:30:33.215] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [04:30:33.268] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [04:30:33.326] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [04:30:33.360] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [04:30:33.393] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [04:30:33.426] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [04:30:33.493] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [04:30:33.546] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [04:30:33.606] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [04:30:33.716] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [04:30:33.833] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [04:30:33.928] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [04:30:33.957] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [04:30:33.985] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [04:30:34.018] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [04:30:34.056] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [04:30:34.093] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [04:30:34.131] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [04:30:34.189] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [04:30:34.246] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [04:30:34.302] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [04:30:34.340] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [04:30:34.404] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [04:30:34.435] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [04:30:34.474] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [04:30:34.514] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [04:30:34.553] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [04:30:34.627] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [04:30:34.692] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [04:30:34.778] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [17:08:10.121] [mlr3] Running benchmark with 36 resampling iterations
INFO [17:08:10.142] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [17:08:10.185] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [17:08:10.228] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [17:08:10.295] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [17:08:10.353] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [17:08:10.382] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [17:08:10.410] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [17:08:10.496] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [17:08:10.570] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [17:08:10.645] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [17:08:10.669] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [17:08:10.710] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [17:08:10.756] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [17:08:10.811] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [17:08:10.855] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [17:08:10.936] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [17:08:11.102] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [17:08:11.185] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [17:08:11.285] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [17:08:11.342] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [17:08:11.407] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [17:08:11.455] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [17:08:11.491] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [17:08:11.518] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [17:08:11.559] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [17:08:11.639] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [17:08:11.685] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [17:08:11.728] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [17:08:11.769] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [17:08:11.826] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [17:08:11.896] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [17:08:11.926] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [17:08:11.955] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [17:08:11.981] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [17:08:12.073] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [17:08:12.158] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [17:08:12.250] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [09:56:14.113] [mlr3] Running benchmark with 36 resampling iterations
INFO [09:56:14.167] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [09:56:14.271] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [09:56:14.379] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [09:56:14.554] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [09:56:14.798] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [09:56:14.990] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [09:56:15.205] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [09:56:15.373] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [09:56:15.563] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [09:56:15.848] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [09:56:16.033] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [09:56:16.087] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [09:56:16.142] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [09:56:16.251] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [09:56:16.738] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [09:56:17.014] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [09:56:17.504] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [09:56:18.322] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [09:56:18.507] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [09:56:18.617] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [09:56:18.699] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [09:56:18.775] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [09:56:18.906] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [09:56:19.058] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [09:56:19.206] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [09:56:19.361] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [09:56:19.745] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [09:56:19.985] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [09:56:20.063] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [09:56:20.198] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [09:56:20.243] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [09:56:20.502] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [09:56:20.584] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [09:56:20.716] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [09:56:20.886] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [09:56:21.060] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [09:56:21.350] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [00:47:12.014] [mlr3] Running benchmark with 36 resampling iterations
INFO [00:47:12.169] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [00:47:12.542] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [00:47:12.854] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [00:47:13.076] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [00:47:13.900] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [00:47:13.972] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [00:47:14.123] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [00:47:15.883] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [00:47:16.044] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [00:47:16.155] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [00:47:16.231] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [00:47:16.307] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [00:47:16.433] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [00:47:16.624] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [00:47:16.781] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [00:47:17.248] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [00:47:17.851] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [00:47:18.565] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [00:47:19.561] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [00:47:19.769] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [00:47:20.010] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [00:47:20.269] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [00:47:20.518] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [00:47:20.707] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [00:47:21.001] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [00:47:21.294] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [00:47:21.689] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [00:47:21.941] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [00:47:22.041] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [00:47:22.249] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [00:47:22.384] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [00:47:22.539] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [00:47:22.765] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [00:47:22.984] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [00:47:23.423] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [00:47:23.841] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [00:47:24.264] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in 'mlr3benchmark-Ex.R' failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [17:36:26.611] [mlr3] Running benchmark with 36 resampling iterations
INFO [17:36:26.639] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [17:36:26.682] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [17:36:26.722] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [17:36:26.759] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [17:36:26.803] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [17:36:26.846] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [17:36:26.887] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [17:36:26.984] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [17:36:27.066] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [17:36:27.142] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [17:36:27.174] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [17:36:27.210] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [17:36:27.248] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [17:36:27.316] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [17:36:27.364] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [17:36:27.413] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [17:36:27.518] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [17:36:27.598] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [17:36:27.690] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [17:36:27.732] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [17:36:27.765] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [17:36:27.797] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [17:36:27.828] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [17:36:27.861] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [17:36:27.899] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [17:36:27.982] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [17:36:28.070] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [17:36:28.121] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [17:36:28.147] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [17:36:28.178] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [17:36:28.212] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [17:36:28.252] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [17:36:28.310] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [17:36:28.358] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [17:36:28.462] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [17:36:28.554] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [17:36:28.673] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [16:04:29.336] [mlr3] Running benchmark with 36 resampling iterations
INFO [16:04:29.374] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [16:04:29.450] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [16:04:29.522] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [16:04:29.588] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [16:04:29.667] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [16:04:29.718] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [16:04:29.778] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [16:04:29.922] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [16:04:30.067] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [16:04:30.171] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [16:04:30.205] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [16:04:30.236] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [16:04:30.296] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [16:04:30.432] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [16:04:30.533] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [16:04:30.633] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [16:04:30.842] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [16:04:31.038] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [16:04:31.245] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [16:04:31.326] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [16:04:31.389] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [16:04:31.449] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [16:04:31.523] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [16:04:31.594] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [16:04:31.669] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [16:04:31.800] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [16:04:31.956] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [16:04:32.089] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [16:04:32.166] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [16:04:32.243] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [16:04:32.313] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [16:04:32.394] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [16:04:32.511] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [16:04:32.592] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [16:04:32.762] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [16:04:32.919] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [16:04:33.160] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-patched-linux-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [15:53:10.230] [mlr3] Running benchmark with 36 resampling iterations
INFO [15:53:10.263] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [15:53:10.322] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [15:53:10.410] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [15:53:10.486] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [15:53:10.552] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [15:53:10.599] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [15:53:10.636] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [15:53:10.748] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [15:53:10.825] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [15:53:10.898] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [15:53:10.949] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [15:53:11.019] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [15:53:11.054] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [15:53:11.167] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [15:53:11.226] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [15:53:11.282] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [15:53:11.479] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [15:53:11.639] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [15:53:11.770] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [15:53:11.836] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [15:53:11.895] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [15:53:11.956] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [15:53:12.019] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [15:53:12.056] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [15:53:12.127] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [15:53:12.251] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [15:53:12.374] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [15:53:12.486] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [15:53:12.546] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [15:53:12.595] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [15:53:12.657] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [15:53:12.715] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [15:53:12.753] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [15:53:12.819] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [15:53:12.970] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [15:53:13.121] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [15:53:13.258] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-release-linux-x86_64
Version: 0.1.7
Check: examples
Result: ERROR
Running examples in 'mlr3benchmark-Ex.R' failed
The error most likely occurred in:
> ### Name: autoplot.BenchmarkAggr
> ### Title: Plots for BenchmarkAggr
> ### Aliases: autoplot.BenchmarkAggr
>
> ### ** Examples
>
> if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) {
+ library(mlr3)
+ library(mlr3learners)
+ library(ggplot2)
+
+ set.seed(1)
+ task = tsks(c("iris", "sonar", "wine", "zoo"))
+ learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost"))
+ learns$classif.xgboost$param_set$values$nrounds = 50
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3)))
+ obj = as_benchmark_aggr(bm)
+
+ # mean and error bars
+ autoplot(obj, type = "mean", level = 0.95)
+
+ if (requireNamespace("PMCMRplus", quietly = TRUE)) {
+ # critical differences
+ autoplot(obj, type = "cd",style = 1)
+ autoplot(obj, type = "cd",style = 2)
+
+ # post-hoc friedman-nemenyi
+ autoplot(obj, type = "fn")
+ }
+
+ }
INFO [19:14:17.688] [mlr3] Running benchmark with 36 resampling iterations
INFO [19:14:17.723] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [19:14:17.762] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [19:14:17.802] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [19:14:17.849] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [19:14:17.896] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [19:14:17.949] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [19:14:17.996] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3)
INFO [19:14:18.106] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3)
INFO [19:14:18.212] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3)
INFO [19:14:18.293] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [19:14:18.325] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [19:14:18.358] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [19:14:18.392] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [19:14:18.467] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [19:14:18.548] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [19:14:18.599] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3)
INFO [19:14:18.738] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3)
INFO [19:14:18.854] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3)
INFO [19:14:19.006] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3)
INFO [19:14:19.045] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3)
INFO [19:14:19.088] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3)
INFO [19:14:19.128] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3)
INFO [19:14:19.170] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3)
INFO [19:14:19.208] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3)
INFO [19:14:19.256] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3)
INFO [19:14:19.364] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3)
INFO [19:14:19.482] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3)
INFO [19:14:19.573] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3)
INFO [19:14:19.599] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3)
INFO [19:14:19.627] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3)
INFO [19:14:19.653] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3)
INFO [19:14:19.687] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3)
INFO [19:14:19.722] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3)
INFO [19:14:19.757] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3)
INFO [19:14:19.866] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3)
INFO [19:14:20.009] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3)
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
Warning in check.deprecation(deprecated_train_params, match.call(), ...) :
Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version.
Warning in check.custom.obj(params, objective) :
Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version.
INFO [19:14:20.181] [mlr3] Finished benchmark
Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead.
Execution halted
Flavor: r-oldrel-windows-x86_64