Back to Multiple platform build/check report for BioC 3.11
ABCDEFGHIJKLMNOPQR[S]TUVWXYZ

CHECK report for SummarizedBenchmark on tokay2

This page was generated on 2020-10-17 11:57:54 -0400 (Sat, 17 Oct 2020).

TO THE DEVELOPERS/MAINTAINERS OF THE SummarizedBenchmark PACKAGE: Please make sure to use the following settings in order to reproduce any error or warning you see on this page.
Package 1757/1905HostnameOS / ArchINSTALLBUILDCHECKBUILD BIN
SummarizedBenchmark 2.6.0
Patrick Kimes
Snapshot Date: 2020-10-16 14:40:19 -0400 (Fri, 16 Oct 2020)
URL: https://git.bioconductor.org/packages/SummarizedBenchmark
Branch: RELEASE_3_11
Last Commit: 7d6f875
Last Changed Date: 2020-04-27 15:14:45 -0400 (Mon, 27 Apr 2020)
malbec2 Linux (Ubuntu 18.04.4 LTS) / x86_64  OK  OK  OK UNNEEDED, same version exists in internal repository
tokay2 Windows Server 2012 R2 Standard / x64  OK  OK [ WARNINGS ] NA 
machv2 macOS 10.14.6 Mojave / x86_64  OK  OK  OK  OK UNNEEDED, same version exists in internal repository

Summary

Package: SummarizedBenchmark
Version: 2.6.0
Command: C:\Users\biocbuild\bbs-3.11-bioc\R\bin\R.exe CMD check --force-multiarch --install=check:SummarizedBenchmark.install-out.txt --library=C:\Users\biocbuild\bbs-3.11-bioc\R\library --no-vignettes --timings SummarizedBenchmark_2.6.0.tar.gz
StartedAt: 2020-10-17 08:42:14 -0400 (Sat, 17 Oct 2020)
EndedAt: 2020-10-17 08:47:58 -0400 (Sat, 17 Oct 2020)
EllapsedTime: 344.2 seconds
RetCode: 0
Status:  WARNINGS  
CheckDir: SummarizedBenchmark.Rcheck
Warnings: 1

Command output

##############################################################################
##############################################################################
###
### Running command:
###
###   C:\Users\biocbuild\bbs-3.11-bioc\R\bin\R.exe CMD check --force-multiarch --install=check:SummarizedBenchmark.install-out.txt --library=C:\Users\biocbuild\bbs-3.11-bioc\R\library --no-vignettes --timings SummarizedBenchmark_2.6.0.tar.gz
###
##############################################################################
##############################################################################


* using log directory 'C:/Users/biocbuild/bbs-3.11-bioc/meat/SummarizedBenchmark.Rcheck'
* using R version 4.0.3 (2020-10-10)
* using platform: x86_64-w64-mingw32 (64-bit)
* using session charset: ISO8859-1
* using option '--no-vignettes'
* checking for file 'SummarizedBenchmark/DESCRIPTION' ... OK
* checking extension type ... Package
* this is package 'SummarizedBenchmark' version '2.6.0'
* package encoding: UTF-8
* checking package namespace information ... OK
* checking package dependencies ... NOTE
Depends: includes the non-default packages:
  'tidyr', 'SummarizedExperiment', 'S4Vectors', 'BiocGenerics',
  'UpSetR', 'rlang', 'stringr', 'BiocParallel', 'ggplot2', 'mclust',
  'dplyr', 'digest', 'sessioninfo', 'crayon', 'tibble'
Adding so many packages to the search path is excessive and importing
selectively is preferable.
* checking if this is a source package ... OK
* checking if there is a namespace ... OK
* checking for hidden files and directories ... OK
* checking for portable file names ... OK
* checking whether package 'SummarizedBenchmark' can be installed ... WARNING
Found the following significant warnings:
  Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:47: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
  Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:17: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
  Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:76: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
  Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/modifyMethod.Rd:14: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
See 'C:/Users/biocbuild/bbs-3.11-bioc/meat/SummarizedBenchmark.Rcheck/00install.out' for details.
* checking installed package size ... NOTE
  installed size is 11.7Mb
  sub-directories of 1Mb or more:
    data  10.6Mb
* checking package directory ... OK
* checking 'build' directory ... OK
* checking DESCRIPTION meta-information ... OK
* checking top-level files ... OK
* checking for left-over files ... OK
* checking index information ... OK
* checking package subdirectories ... OK
* checking R files for non-ASCII characters ... OK
* checking R files for syntax errors ... OK
* loading checks for arch 'i386'
** checking whether the package can be loaded ... OK
** checking whether the package can be loaded with stated dependencies ... OK
** checking whether the package can be unloaded cleanly ... OK
** checking whether the namespace can be loaded with stated dependencies ... OK
** checking whether the namespace can be unloaded cleanly ... OK
* loading checks for arch 'x64'
** checking whether the package can be loaded ... OK
** checking whether the package can be loaded with stated dependencies ... OK
** checking whether the package can be unloaded cleanly ... OK
** checking whether the namespace can be loaded with stated dependencies ... OK
** checking whether the namespace can be unloaded cleanly ... OK
* checking dependencies in R code ... NOTE
Unexported object imported by a ':::' call: 'BiocGenerics:::replaceSlots'
  See the note in ?`:::` about the use of this operator.
* checking S3 generic/method consistency ... OK
* checking replacement functions ... OK
* checking foreign function calls ... OK
* checking R code for possible problems ... NOTE
.combineSummarizedBenchmarks: no visible binding for global variable
  'colid'
.combineSummarizedBenchmarks: no visible binding for global variable
  'label'
.compare.meta: no visible binding for global variable 'label'
.compare.meta : <anonymous>: no visible binding for global variable
  'label'
.compare.meta : <anonymous>: no visible binding for global variable '.'
.compare.meta: no visible binding for global variable 'value'
.compare.meta: no visible binding for global variable 'comparison'
.list2mat: no visible binding for global variable '.method'
.list2mat: no visible binding for global variable '.val'
.list2mat: no visible binding for global variable '.id'
.printUpdateBench: no visible binding for global variable 'f'
.printUpdateBench: no visible binding for global variable 'meta'
.printUpdateBench: no visible binding for global variable 'post'
.printUpdateBench: no visible binding for global variable 'rerun'
.printUpdateBench: no visible binding for global variable 'overlap'
.printUpdateBench: no visible binding for global variable '.'
plotROC: no visible binding for global variable 'FDR'
plotROC: no visible binding for global variable 'TPR'
plotROC: no visible binding for global variable 'method'
tidyUpMetrics: no visible binding for global variable 'key'
tidyUpMetrics: no visible binding for global variable 'value'
updateBench: no visible binding for global variable 'overlap'
updateBench: no visible binding for global variable 'f'
updateBench: no visible binding for global variable 'meta'
updateBench: no visible binding for global variable 'post'
Undefined global functions or variables:
  . .id .method .val FDR TPR colid comparison f key label meta method
  overlap post rerun value
* checking Rd files ... OK
* checking Rd metadata ... OK
* checking Rd cross-references ... OK
* checking for missing documentation entries ... OK
* checking for code/documentation mismatches ... OK
* checking Rd \usage sections ... OK
* checking Rd contents ... OK
* checking for unstated dependencies in examples ... OK
* checking contents of 'data' directory ... OK
* checking data for non-ASCII characters ... OK
* checking data for ASCII and uncompressed saves ... OK
* checking files in 'vignettes' ... OK
* checking examples ...
** running examples for arch 'i386' ... OK
** running examples for arch 'x64' ... OK
* checking for unstated dependencies in 'tests' ... OK
* checking tests ...
** running tests for arch 'i386' ...
  Running 'testthat.R'
 OK
** running tests for arch 'x64' ...
  Running 'testthat.R'
 OK
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes in 'inst/doc' ... OK
* checking running R code from vignettes ... SKIPPED
* checking re-building of vignette outputs ... SKIPPED
* checking PDF version of manual ... OK
* DONE

Status: 1 WARNING, 4 NOTEs
See
  'C:/Users/biocbuild/bbs-3.11-bioc/meat/SummarizedBenchmark.Rcheck/00check.log'
for details.



Installation output

SummarizedBenchmark.Rcheck/00install.out

##############################################################################
##############################################################################
###
### Running command:
###
###   C:\cygwin\bin\curl.exe -O https://malbec2.bioconductor.org/BBS/3.11/bioc/src/contrib/SummarizedBenchmark_2.6.0.tar.gz && rm -rf SummarizedBenchmark.buildbin-libdir && mkdir SummarizedBenchmark.buildbin-libdir && C:\Users\biocbuild\bbs-3.11-bioc\R\bin\R.exe CMD INSTALL --merge-multiarch --build --library=SummarizedBenchmark.buildbin-libdir SummarizedBenchmark_2.6.0.tar.gz && C:\Users\biocbuild\bbs-3.11-bioc\R\bin\R.exe CMD INSTALL SummarizedBenchmark_2.6.0.zip && rm SummarizedBenchmark_2.6.0.tar.gz SummarizedBenchmark_2.6.0.zip
###
##############################################################################
##############################################################################


  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 5648k  100 5648k    0     0  43.6M      0 --:--:-- --:--:-- --:--:-- 45.9M

install for i386

* installing *source* package 'SummarizedBenchmark' ...
** using staged installation
** R
** data
*** moving datasets to lazyload DB
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
  converting help for package 'SummarizedBenchmark'
    finding HTML links ... done
    BDData-class                            html  
    BDData-setter                           html  
    BDData-show                             html  
    BDData                                  html  
    BDMethod-class                          html  
    BDMethod-setter                         html  
    BDMethod-show                           html  
    BDMethod                                html  
    BDMethodList-class                      html  
    BDMethodList-setter                     html  
    BDMethodList-show                       html  
    BDMethodList                            html  
    BenchDesign-class                       html  
    BenchDesign-show                        html  
    BenchDesign                             html  
    SummarizedBenchmark-class               html  
    finding level-2 HTML links ... done

    SummarizedBenchmark                     html  
    addMethod                               html  
Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:47: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:17: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/addMethod.Rd:76: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
    addPerformanceMetric                    html  
    allSB                                   html  
    assayNames-setter                       html  
    availableMetrics                        html  
    buildBench                              html  
    compareBDData                           html  
    compareBDMethod                         html  
    compareBenchDesigns                     html  
    dropMethod                              html  
    estimateMetrics                         html  
    expandMethod                            html  
    groundTruths-setter                     html  
    groundTruths                            html  
    hashBDData                              html  
    mcols-setter                            html  
    modifyMethod                            html  
Rd warning: C:/Users/biocbuild/bbs-3.11-bioc/tmpdir/RtmpCy8yng/R.INSTALL14ec22c65d95/SummarizedBenchmark/man/modifyMethod.Rd:14: file link 'quotation' in package 'rlang' does not exist and so has been treated as a topic
    modmethod                               html  
    performanceMetrics-setter               html  
    performanceMetrics                      html  
    plotMethodsOverlap                      html  
    plotROC                                 html  
    printMethod                             html  
    sb                                      html  
    tdat                                    html  
    tidyBDMethod                            html  
    tidyUpMetrics                           html  
    updateBench                             html  
*** copying figures
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path

install for x64

* installing *source* package 'SummarizedBenchmark' ...
** testing if installed package can be loaded
* MD5 sums
packaged installation of 'SummarizedBenchmark' as SummarizedBenchmark_2.6.0.zip
* DONE (SummarizedBenchmark)
* installing to library 'C:/Users/biocbuild/bbs-3.11-bioc/R/library'
package 'SummarizedBenchmark' successfully unpacked and MD5 sums checked

Tests output

SummarizedBenchmark.Rcheck/tests_i386/testthat.Rout


R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
Copyright (C) 2020 The R Foundation for Statistical Computing
Platform: i386-w64-mingw32/i386 (32-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library("testthat")
> library("SummarizedBenchmark")
Loading required package: tidyr

Attaching package: 'tidyr'

The following object is masked from 'package:testthat':

    matches

Loading required package: SummarizedExperiment
Loading required package: GenomicRanges
Loading required package: stats4
Loading required package: BiocGenerics
Loading required package: parallel

Attaching package: 'BiocGenerics'

The following objects are masked from 'package:parallel':

    clusterApply, clusterApplyLB, clusterCall, clusterEvalQ,
    clusterExport, clusterMap, parApply, parCapply, parLapply,
    parLapplyLB, parRapply, parSapply, parSapplyLB

The following objects are masked from 'package:stats':

    IQR, mad, sd, var, xtabs

The following objects are masked from 'package:base':

    Filter, Find, Map, Position, Reduce, anyDuplicated, append,
    as.data.frame, basename, cbind, colnames, dirname, do.call,
    duplicated, eval, evalq, get, grep, grepl, intersect, is.unsorted,
    lapply, mapply, match, mget, order, paste, pmax, pmax.int, pmin,
    pmin.int, rank, rbind, rownames, sapply, setdiff, sort, table,
    tapply, union, unique, unsplit, which, which.max, which.min

Loading required package: S4Vectors

Attaching package: 'S4Vectors'

The following object is masked from 'package:tidyr':

    expand

The following object is masked from 'package:base':

    expand.grid

Loading required package: IRanges

Attaching package: 'IRanges'

The following object is masked from 'package:grDevices':

    windows

Loading required package: GenomeInfoDb
Loading required package: Biobase
Welcome to Bioconductor

    Vignettes contain introductory material; view with
    'browseVignettes()'. To cite Bioconductor, see
    'citation("Biobase")', and for packages 'citation("pkgname")'.

Loading required package: DelayedArray
Loading required package: matrixStats

Attaching package: 'matrixStats'

The following objects are masked from 'package:Biobase':

    anyMissing, rowMedians


Attaching package: 'DelayedArray'

The following objects are masked from 'package:matrixStats':

    colMaxs, colMins, colRanges, rowMaxs, rowMins, rowRanges

The following objects are masked from 'package:base':

    aperm, apply, rowsum

Loading required package: UpSetR
Loading required package: rlang

Attaching package: 'rlang'

The following object is masked from 'package:Biobase':

    exprs

The following objects are masked from 'package:testthat':

    is_false, is_null, is_true

Loading required package: stringr
Loading required package: BiocParallel
Loading required package: ggplot2
Loading required package: mclust
Package 'mclust' version 5.4.6
Type 'citation("mclust")' for citing this R package in publications.
Loading required package: dplyr

Attaching package: 'dplyr'

The following object is masked from 'package:matrixStats':

    count

The following object is masked from 'package:Biobase':

    combine

The following objects are masked from 'package:GenomicRanges':

    intersect, setdiff, union

The following object is masked from 'package:GenomeInfoDb':

    intersect

The following objects are masked from 'package:IRanges':

    collapse, desc, intersect, setdiff, slice, union

The following objects are masked from 'package:S4Vectors':

    first, intersect, rename, setdiff, setequal, union

The following objects are masked from 'package:BiocGenerics':

    combine, intersect, setdiff, union

The following object is masked from 'package:testthat':

    matches

The following objects are masked from 'package:stats':

    filter, lag

The following objects are masked from 'package:base':

    intersect, setdiff, setequal, union

Loading required package: digest
Loading required package: sessioninfo
Loading required package: crayon

Attaching package: 'crayon'

The following object is masked from 'package:ggplot2':

    %+%

The following object is masked from 'package:rlang':

    chr

Loading required package: tibble
> 
> test_check("SummarizedBenchmark")

Option rerun is set to `FALSE`:
Rerunning performance metrics only for the following methods: BH2

== testthat results  ===========================================================
[ OK: 224 | SKIPPED: 0 | WARNINGS: 7 | FAILED: 0 ]
> 
> proc.time()
   user  system elapsed 
  36.34    3.78   41.50 

SummarizedBenchmark.Rcheck/tests_x64/testthat.Rout


R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
Copyright (C) 2020 The R Foundation for Statistical Computing
Platform: x86_64-w64-mingw32/x64 (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library("testthat")
> library("SummarizedBenchmark")
Loading required package: tidyr

Attaching package: 'tidyr'

The following object is masked from 'package:testthat':

    matches

Loading required package: SummarizedExperiment
Loading required package: GenomicRanges
Loading required package: stats4
Loading required package: BiocGenerics
Loading required package: parallel

Attaching package: 'BiocGenerics'

The following objects are masked from 'package:parallel':

    clusterApply, clusterApplyLB, clusterCall, clusterEvalQ,
    clusterExport, clusterMap, parApply, parCapply, parLapply,
    parLapplyLB, parRapply, parSapply, parSapplyLB

The following objects are masked from 'package:stats':

    IQR, mad, sd, var, xtabs

The following objects are masked from 'package:base':

    Filter, Find, Map, Position, Reduce, anyDuplicated, append,
    as.data.frame, basename, cbind, colnames, dirname, do.call,
    duplicated, eval, evalq, get, grep, grepl, intersect, is.unsorted,
    lapply, mapply, match, mget, order, paste, pmax, pmax.int, pmin,
    pmin.int, rank, rbind, rownames, sapply, setdiff, sort, table,
    tapply, union, unique, unsplit, which, which.max, which.min

Loading required package: S4Vectors

Attaching package: 'S4Vectors'

The following object is masked from 'package:tidyr':

    expand

The following object is masked from 'package:base':

    expand.grid

Loading required package: IRanges

Attaching package: 'IRanges'

The following object is masked from 'package:grDevices':

    windows

Loading required package: GenomeInfoDb
Loading required package: Biobase
Welcome to Bioconductor

    Vignettes contain introductory material; view with
    'browseVignettes()'. To cite Bioconductor, see
    'citation("Biobase")', and for packages 'citation("pkgname")'.

Loading required package: DelayedArray
Loading required package: matrixStats

Attaching package: 'matrixStats'

The following objects are masked from 'package:Biobase':

    anyMissing, rowMedians


Attaching package: 'DelayedArray'

The following objects are masked from 'package:matrixStats':

    colMaxs, colMins, colRanges, rowMaxs, rowMins, rowRanges

The following objects are masked from 'package:base':

    aperm, apply, rowsum

Loading required package: UpSetR
Loading required package: rlang

Attaching package: 'rlang'

The following object is masked from 'package:Biobase':

    exprs

The following objects are masked from 'package:testthat':

    is_false, is_null, is_true

Loading required package: stringr
Loading required package: BiocParallel
Loading required package: ggplot2
Loading required package: mclust
Package 'mclust' version 5.4.6
Type 'citation("mclust")' for citing this R package in publications.
Loading required package: dplyr

Attaching package: 'dplyr'

The following object is masked from 'package:matrixStats':

    count

The following object is masked from 'package:Biobase':

    combine

The following objects are masked from 'package:GenomicRanges':

    intersect, setdiff, union

The following object is masked from 'package:GenomeInfoDb':

    intersect

The following objects are masked from 'package:IRanges':

    collapse, desc, intersect, setdiff, slice, union

The following objects are masked from 'package:S4Vectors':

    first, intersect, rename, setdiff, setequal, union

The following objects are masked from 'package:BiocGenerics':

    combine, intersect, setdiff, union

The following object is masked from 'package:testthat':

    matches

The following objects are masked from 'package:stats':

    filter, lag

The following objects are masked from 'package:base':

    intersect, setdiff, setequal, union

Loading required package: digest
Loading required package: sessioninfo
Loading required package: crayon

Attaching package: 'crayon'

The following object is masked from 'package:ggplot2':

    %+%

The following object is masked from 'package:rlang':

    chr

Loading required package: tibble
> 
> test_check("SummarizedBenchmark")

Option rerun is set to `FALSE`:
Rerunning performance metrics only for the following methods: BH2

== testthat results  ===========================================================
[ OK: 224 | SKIPPED: 0 | WARNINGS: 7 | FAILED: 0 ]
> 
> proc.time()
   user  system elapsed 
  33.18    2.95   36.14 

Example timings

SummarizedBenchmark.Rcheck/examples_i386/SummarizedBenchmark-Ex.timings

nameusersystemelapsed
BDData-setter0.030.000.03
BDData0.020.000.01
BDMethod-setter0.040.000.05
BDMethod000
BDMethodList-setter0.020.000.02
BDMethodList0.010.000.01
BenchDesign0.020.000.02
SummarizedBenchmark-class0.620.060.69
SummarizedBenchmark0.220.110.32
addMethod0.060.000.07
addPerformanceMetric0.050.000.04
allSB0.000.010.02
assayNames-setter0.060.000.06
availableMetrics000
buildBench1.670.253.03
compareBDData0.020.000.02
compareBDMethod0.030.000.03
compareBenchDesigns0.250.000.25
dropMethod0.030.000.03
estimateMetrics0.550.030.58
expandMethod0.030.000.03
modifyMethod0.030.000.03
performanceMetrics-setter0.050.020.06
performanceMetrics0.050.000.05
plotMethodsOverlap000
plotROC0.000.020.01
printMethod0.020.000.02
sb0.010.000.01
tdat000
tidyUpMetrics0.170.000.17
updateBench1.680.061.74

SummarizedBenchmark.Rcheck/examples_x64/SummarizedBenchmark-Ex.timings

nameusersystemelapsed
BDData-setter0.030.000.03
BDData000
BDMethod-setter0.030.000.03
BDMethod000
BDMethodList-setter0.020.000.02
BDMethodList0.020.000.01
BenchDesign0.010.000.02
SummarizedBenchmark-class0.630.060.68
SummarizedBenchmark0.250.000.25
addMethod0.030.000.04
addPerformanceMetric0.060.000.06
allSB0.020.000.01
assayNames-setter0.060.000.07
availableMetrics000
buildBench1.550.081.62
compareBDData000
compareBDMethod0.040.000.05
compareBenchDesigns0.250.020.26
dropMethod0.050.000.05
estimateMetrics0.580.040.63
expandMethod0.030.000.03
modifyMethod0.050.000.04
performanceMetrics-setter0.040.000.05
performanceMetrics0.050.020.06
plotMethodsOverlap000
plotROC000
printMethod0.020.000.01
sb000
tdat0.000.010.02
tidyUpMetrics0.190.000.18
updateBench1.670.021.69