Combining WANDA with various first-order termination provers on the full TPDB

This group of experiments considers WANDA's power when combined with various different first-order termination tools. Experiments were done on the full TPDB 2018. The benchmarks are presented in the order: Mixed_HO_10/, Kop_11/, Mixed_HO_12/, Kop_13/, Hamana_17/, Hamana_17/Blanqui_15/, Uncurried_Applicative_11/, Hamana_Kikuchi_18/.

Filename aprove natt muterm natt+aprove noprover
applicative MAYBE MAYBE MAYBE MAYBE MAYBE
apply YES 0.04 YES 0.04 YES 0.04 YES 0.04 YES 0.04
app YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
counterex1 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
counterex2 MAYBE MAYBE MAYBE MAYBE MAYBE
curry1 YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
curry YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
deriv TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
eval YES 1.08 YES 0.19 YES 0.12 YES 0.18 YES 0.09
extrec YES 0.19 YES 0.14 YES 0.14 YES 0.14 YES 0.14
filter YES 0.04 YES 0.03 YES 0.03 YES 0.03 YES 0.03
findzero YES 1.60 YES 0.64 YES 0.62 YES 0.64 YES 0.63
foldl YES 0.32 YES 0.26 YES 0.27 YES 0.26 YES 0.26
foobar MAYBE MAYBE MAYBE MAYBE MAYBE
from YES 1.35 YES 0.43 YES 0.42 YES 0.43 YES 0.42
hrsdif1 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
hrsdif2 MAYBE MAYBE MAYBE MAYBE MAYBE
if YES 0.98 YES 0.20 YES 0.20 YES 0.20 YES 0.19
inlamb YES 0.01 YES 0.00 YES 0.00 YES 0.00 YES 0.00
iterative YES 1.21 YES 1.02 YES 1.03 YES 1.04 YES 1.02
lambda1 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
lambda2 NO 1.84 MAYBE MAYBE NO 0.96 MAYBE
lambda3 YES 0.02 YES 0.02 YES 0.01 YES 0.02 YES 0.02
length YES 0.11 YES 0.10 YES 0.10 YES 0.10 YES 0.10
loopy YES 0.02 YES 0.02 YES 0.02 YES 0.02 YES 0.02
map YES 0.02 YES 0.02 YES 0.02 YES 0.02 YES 0.02
noabs YES 0.04 YES 0.04 YES 0.04 YES 0.04 YES 0.04
onearg YES 0.17 YES 0.17 YES 0.17 YES 0.18 YES 0.17
ordrec YES 0.38 YES 0.34 YES 0.35 YES 0.34 YES 0.35
plode YES 0.30 YES 0.30 YES 0.29 YES 0.29 YES 0.29
prefixsum YES 0.12 YES 0.12 YES 0.12 YES 0.12 YES 0.12
prenex YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
process YES 3.28 YES 3.04 YES 3.00 YES 3.01 YES 3.01
qsort YES 1.65 YES 1.03 YES 1.02 YES 1.03 YES 1.04
rec YES 0.10 YES 0.10 YES 0.10 YES 0.11 YES 0.10
reverse YES 0.64 YES 0.57 YES 0.57 YES 0.57 YES 0.57
sdu YES 0.31 YES 0.27 YES 0.27 YES 0.27 YES 0.27
sort YES 2.29 YES 2.01 YES 2.01 YES 2.02 YES 2.01
uncurry YES 0.01 YES 0.01 YES 0.01 YES 0.02 YES 0.01
zipWith YES 1.21 YES 0.39 YES 0.39 YES 0.41 YES 0.43
average YES 0.64 YES 0.07 YES 0.07 YES 0.07 YES 0.08
lambda5 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
merge YES 0.05 YES 0.04 YES 0.05 YES 0.04 YES 0.04
noneating YES 0.51 YES 0.03 YES 0.03 YES 0.03 YES 0.02
shuffle YES 0.09 YES 0.10 YES 0.09 YES 0.09 YES 0.09
twice YES 0.11 YES 0.10 YES 0.10 YES 0.10 YES 0.10
fuhs11frocos_a MAYBE MAYBE MAYBE MAYBE MAYBE
listrepeat MAYBE MAYBE MAYBE MAYBE MAYBE
prefixshuffle YES 1.65 YES 0.84 YES 0.83 YES 0.83 YES 0.87
prenex_modif1 YES 0.07 YES 0.07 YES 0.07 YES 0.07 YES 0.07
sqr MAYBE MAYBE MAYBE MAYBE MAYBE
tailrecgen MAYBE MAYBE MAYBE MAYBE MAYBE
twice_modif4 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
fuhkop11frocos YES 0.10 YES 0.07 YES 0.07 YES 0.07 YES 0.07
fuhkop12rta1 YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
fuhkop12rta2 YES 0.92 YES 0.17 YES 0.15 YES 0.16 YES 0.17
kop11cai1 YES 0.57 YES 0.50 YES 0.50 YES 0.50 YES 0.49
kop11cai2 YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
kop12lmcs1 MAYBE MAYBE MAYBE MAYBE MAYBE
kop12lmcs2 YES 0.11 YES 0.10 YES 0.09 YES 0.09 YES 0.09
kop12thesis_ex2.11 YES 0.22 YES 0.21 YES 0.21 YES 0.21 YES 0.21
kop12thesis_ex7.23 YES 0.05 YES 0.04 YES 0.04 YES 0.05 YES 0.04
kop12thesis_ex7.45_1 MAYBE MAYBE MAYBE MAYBE MAYBE
kop12thesis_ex7.45_2 MAYBE MAYBE MAYBE MAYBE MAYBE
kop12thesis_sec3.3.3 YES 0.03 YES 0.03 YES 0.03 YES 0.03 YES 0.03
churchNum2 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
churchNum TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
DicosmoKesner93 YES 0.88 YES 0.15 YES 0.12 YES 0.15 YES 0.08
gstate MAYBE MAYBE MAYBE MAYBE MAYBE
kripke YES 0.49 YES 0.03 YES 0.02 YES 0.03 YES 0.02
lambda_prod YES 0.58 YES 0.03 YES 0.03 YES 0.03 YES 0.02
lambda_sum YES 0.03 YES 0.03 YES 0.03 YES 0.03 YES 0.03
monad YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
pical YES 0.04 YES 0.04 YES 0.04 YES 0.04 YES 0.04
restriction YES 7.17 YES 6.74 YES 6.77 YES 6.78 YES 6.78
slml MAYBE MAYBE MAYBE MAYBE MAYBE
SystemT YES 0.07 YES 0.06 YES 0.06 YES 0.07 YES 0.06
typed_lamUNC YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
typed_lam YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
ysllc YES 0.06 YES 0.06 YES 0.06 YES 0.06 YES 0.06
01GoedelT YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
02Ackermann YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
03minus YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
04arrow YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
05height YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
06plusmult YES 0.17 YES 0.17 YES 0.17 YES 0.17 YES 0.18
07ordinal YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
09ex YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
AotoYamada_05__001 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
AotoYamada_05__002 YES 0.13 YES 0.13 YES 0.13 YES 0.14 YES 0.14
AotoYamada_05__003 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
AotoYamada_05__004 YES 0.02 YES 0.02 YES 0.03 YES 0.02 YES 0.02
AotoYamada_05__005 YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
AotoYamada_05__006 YES 0.03 YES 0.03 YES 0.03 YES 0.03 YES 0.03
AotoYamada_05__007 YES 0.06 YES 0.05 YES 0.05 YES 0.05 YES 0.05
AotoYamada_05__009 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
AotoYamada_05__010 YES 0.42 YES 0.40 YES 0.41 YES 0.41 YES 0.40
AotoYamada_05__011 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
AotoYamada_05__012 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
AotoYamada_05__013 YES 0.07 YES 0.07 YES 0.07 YES 0.07 YES 0.07
AotoYamada_05__014 YES 0.41 YES 0.41 YES 0.41 YES 0.41 YES 0.42
AotoYamada_05__015 YES 0.21 YES 0.21 YES 0.21 YES 0.21 YES 0.21
AotoYamada_05__016 YES 0.48 YES 0.47 YES 0.47 YES 0.48 YES 0.49
AotoYamada_05__017 YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
AotoYamada_05__019 YES 0.06 YES 0.07 YES 0.06 YES 0.06 YES 0.06
AotoYamada_05__020 YES 0.11 YES 0.10 YES 0.11 YES 0.10 YES 0.10
AotoYamada_05__021 YES 0.45 YES 0.45 YES 0.45 YES 0.46 YES 0.45
AotoYamada_05__022 YES 0.06 YES 0.05 YES 0.05 YES 0.05 YES 0.05
AotoYamada_05__023 YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
AotoYamada_05__024 YES 0.02 YES 0.02 YES 0.02 YES 0.02 YES 0.02
AotoYamada_05__025 YES 0.00 YES 0.00 YES 0.00 YES 0.00 YES 0.00
AotoYamada_05__026 YES 0.13 YES 0.12 YES 0.12 YES 0.12 YES 0.12
AotoYamada_05__027 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.06
AotoYamada_05__028 YES 0.02 YES 0.02 YES 0.02 YES 0.02 YES 0.02
AotoYamada_05__Ex1SimplyTyped YES 0.02 YES 0.02 YES 0.02 YES 0.02 YES 0.02
AotoYamada_05__Ex5TermProof YES 0.38 YES 0.36 YES 0.36 YES 0.36 YES 0.35
Applicative_05__BTreeMember YES 0.12 YES 0.11 YES 0.11 YES 0.11 YES 0.11
Applicative_05__Ex2_6_1Composition YES 0.01 YES 0.01 YES 0.01 YES 0.01 YES 0.01
Applicative_05__Ex2_8_1ConstSubstFix MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__Ex2PrimRec MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__Ex3Lists YES 0.07 YES 0.06 YES 0.06 YES 0.06 YES 0.06
Applicative_05__Ex4MapList YES 0.04 YES 0.04 YES 0.04 YES 0.04 YES 0.04
Applicative_05__Ex5Folding YES 0.28 YES 0.27 YES 0.27 YES 0.26 YES 0.26
Applicative_05__Ex5Sorting YES 3.56 YES 3.36 YES 3.39 YES 3.37 YES 3.37
Applicative_05__Ex6_11 MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__Ex6Folding YES 0.45 YES 0.42 YES 0.43 YES 0.42 YES 0.42
Applicative_05__Ex6Recursor YES 0.07 YES 0.07 YES 0.07 YES 0.07 YES 0.07
Applicative_05__Ex7_9 YES 0.90 YES 0.22 YES 0.23 YES 0.22 YES 0.22
Applicative_05__Ex7OrdinalRec MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__Ex7Sorting YES 1.35 YES 1.24 YES 1.24 YES 1.24 YES 1.26
Applicative_05__Ex9Maps YES 12.33 YES 11.48 YES 11.48 YES 11.47 YES 11.52
Applicative_05__Hamming NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
Applicative_05__mapDivMinusHard YES 0.79 YES 0.14 YES 0.14 YES 0.14 MAYBE
Applicative_05__mapDivMinus YES 0.75 YES 0.11 YES 0.11 YES 0.11 YES 0.12
Applicative_05__ReverseLastInit YES 0.27 YES 0.27 YES 0.27 YES 0.27 YES 0.28
Applicative_05__TakeDropWhile YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
Applicative_05__termMonTypes MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__TreeFlatten YES 0.09 YES 0.09 YES 0.09 YES 0.09 YES 0.09
Applicative_05__TreeHeight YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
Applicative_05__TreeLevels YES 0.07 YES 0.07 YES 0.07 YES 0.07 YES 0.07
Applicative_05__TreeMap YES 0.35 YES 0.34 YES 0.34 YES 0.34 YES 0.35
Applicative_05__TreeSize YES 0.04 YES 0.04 YES 0.04 YES 0.04 YES 0.04
Applicative_05__TypeEx3 MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_05__TypeEx5 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
Applicative_AG01_innermost__#4.10 NO 1.52 MAYBE MAYBE NO 0.95 MAYBE
Applicative_AG01_innermost__#4.13 MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_AG01_innermost__#4.15 NO 1.72 MAYBE MAYBE NO 0.95 MAYBE
Applicative_AG01_innermost__#4.17 NO 2.07 MAYBE MAYBE NO 0.98 MAYBE
Applicative_AG01_innermost__#4.19 TIMEOUT MAYBE TIMEOUT TIMEOUT MAYBE
Applicative_AG01_innermost__#4.22 YES 0.86 YES 0.25 YES 0.24 YES 0.32 YES 0.24
Applicative_AG01_innermost__#4.24 YES 1.00 YES 0.35 YES 0.30 YES 0.34 YES 0.29
Applicative_AG01_innermost__#4.26 YES 1.13 YES 0.31 YES 0.31 YES 0.32 MAYBE
Applicative_AG01_innermost__#4.28 YES 0.65 YES 0.23 YES 0.23 YES 0.24 MAYBE
Applicative_AG01_innermost__#4.2 NO 1.82 MAYBE MAYBE NO 0.89 MAYBE
Applicative_AG01_innermost__#4.34 YES 1.02 YES 0.32 YES 0.32 YES 0.33 YES 0.35
Applicative_AG01_innermost__#4.36 YES 1.66 YES 0.67 YES 0.68 YES 0.67 YES 0.76
Applicative_AG01_innermost__#4.3 NO 1.46 MAYBE MAYBE NO 0.77 MAYBE
Applicative_AG01_innermost__#4.5 NO 0.00 NO 0.00 NO 0.00 NO 0.00 NO 0.00
Applicative_AG01_innermost__#4.7 NO 1.78 MAYBE MAYBE NO 0.85 MAYBE
Applicative_AG01_innermost__#4.8 MAYBE MAYBE MAYBE MAYBE MAYBE
Applicative_first_order_05__01 YES 0.11 YES 0.11 YES 0.12 YES 0.11 YES 0.13
Applicative_first_order_05__02 YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
Applicative_first_order_05__06 YES 0.14 YES 0.13 YES 0.13 YES 0.13 YES 0.13
Applicative_first_order_05__08 YES 0.47 YES 0.43 YES 0.42 YES 0.45 YES 0.42
Applicative_first_order_05__11 YES 1.75 YES 1.50 YES 1.51 YES 1.54 YES 1.52
Applicative_first_order_05__12 YES 0.88 YES 0.81 YES 0.81 YES 0.84 YES 0.81
Applicative_first_order_05__13 YES 20.28 YES 0.89 YES 0.84 TIMEOUT YES 0.42
Applicative_first_order_05__17 YES 0.14 YES 0.14 YES 0.15 YES 0.48 YES 0.14
Applicative_first_order_05__18 YES 0.23 YES 0.21 YES 0.21 YES 0.63 YES 0.21
Applicative_first_order_05__21 YES 0.94 YES 0.30 YES 0.29 YES 0.32 MAYBE
Applicative_first_order_05__29 YES 0.63 YES 0.63 YES 0.63 YES 0.65 YES 0.63
Applicative_first_order_05__30 YES 0.53 YES 0.48 YES 0.47 YES 0.48 YES 0.47
Applicative_first_order_05__#3.10 YES 1.76 YES 0.70 YES 0.73 YES 0.73 YES 0.86
Applicative_first_order_05__#3.13 YES 1.61 YES 0.66 YES 0.68 YES 0.66 YES 0.76
Applicative_first_order_05__#3.16 YES 0.39 YES 0.39 YES 0.39 YES 0.40 YES 0.39
Applicative_first_order_05__#3.18 YES 1.00 YES 0.31 YES 0.29 YES 0.30 YES 0.33
Applicative_first_order_05__31 YES 0.67 YES 0.66 YES 0.66 YES 0.66 YES 0.66
Applicative_first_order_05__#3.22 YES 0.91 YES 0.20 YES 0.40 YES 0.20 YES 3.63
Applicative_first_order_05__#3.25 YES 0.57 YES 0.16 YES 0.16 YES 0.16 YES 0.16
Applicative_first_order_05__#3.27 YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
Applicative_first_order_05__#3.2 YES 0.99 YES 0.27 YES 0.26 YES 0.28 YES 0.28
Applicative_first_order_05__#3.32 YES 0.54 YES 0.16 YES 0.15 YES 0.16 YES 0.15
Applicative_first_order_05__#3.36 YES 1.05 YES 0.28 YES 0.28 YES 0.28 YES 0.31
Applicative_first_order_05__#3.38 YES 1.02 YES 0.31 YES 0.30 YES 0.32 YES 0.33
Applicative_first_order_05__33 TIMEOUT MAYBE TIMEOUT TIMEOUT MAYBE
Applicative_first_order_05__#3.40 YES 1.50 MAYBE YES 1.50 TIMEOUT MAYBE
Applicative_first_order_05__#3.45 YES 0.70 YES 0.16 YES 0.15 YES 0.19 YES 0.14
Applicative_first_order_05__#3.48 YES 0.85 YES 0.23 YES 0.22 YES 0.24 YES 0.21
Applicative_first_order_05__#3.52 YES 0.74 YES 0.17 YES 0.15 YES 0.18 YES 0.16
Applicative_first_order_05__#3.55 YES 1.55 YES 0.60 YES 0.60 YES 0.60 YES 0.69
Applicative_first_order_05__#3.57 YES 1.50 YES 0.59 YES 0.59 YES 0.61 YES 0.77
Applicative_first_order_05__#3.6 YES 1.25 YES 0.38 YES 0.38 YES 0.38 YES 0.47
Applicative_first_order_05__#3.8 YES 1.17 YES 0.41 YES 0.40 YES 0.42 YES 0.48
Applicative_first_order_05__hydra YES 0.89 YES 0.24 YES 0.22 YES 0.24 YES 0.21
Applicative_first_order_05__minsort TIMEOUT MAYBE TIMEOUT TIMEOUT MAYBE
Applicative_first_order_05__motivation YES 2.20 YES 0.22 YES 0.23 YES 0.25 YES 0.25
Applicative_first_order_05__perfect2 YES 1.32 YES 0.34 YES 0.32 YES 0.33 YES 0.37
Applicative_first_order_05__perfect YES 0.97 YES 0.30 YES 0.29 YES 0.32 YES 0.28
h00 YES 0.39 YES 0.36 YES 0.36 YES 0.36 YES 0.36
h01 YES 21.03 YES 19.39 YES 19.24 YES 20.06 YES 19.28
h02 YES 0.19 YES 0.20 YES 0.20 YES 0.20 YES 0.19
h03 YES 2.83 YES 2.83 YES 2.82 YES 2.88 YES 2.83
h04 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h05 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h06 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h07 YES 9.00 YES 7.59 YES 7.57 YES 7.62 YES 7.46
h08 MAYBE MAYBE MAYBE MAYBE MAYBE
h09 YES 0.85 YES 0.48 YES 0.35 YES 0.35 YES 0.35
h10 MAYBE MAYBE MAYBE MAYBE MAYBE
h11 YES 0.05 YES 0.05 YES 0.05 YES 0.05 YES 0.05
h12 YES 0.07 YES 0.06 YES 0.06 YES 0.06 YES 0.06
h13 YES 3.93 YES 3.56 YES 3.58 YES 3.63 YES 3.50
h14 YES 0.30 YES 0.29 YES 0.28 YES 0.29 YES 0.28
h15 YES 8.25 YES 7.53 YES 7.53 YES 7.56 YES 7.54
h16 YES 1.49 YES 1.48 YES 1.49 YES 1.49 YES 1.48
h17 YES 0.19 YES 0.17 YES 0.17 YES 0.17 YES 0.17
h18 MAYBE MAYBE MAYBE MAYBE MAYBE
h19 TIMEOUT YES 1.32 TIMEOUT YES 1.31 MAYBE
h20 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h21 TIMEOUT NO 1.16 TIMEOUT NO 6.23 MAYBE
h22 TIMEOUT YES 2.14 TIMEOUT YES 2.16 MAYBE
h23 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h24 TIMEOUT YES 1.97 TIMEOUT YES 1.96 MAYBE
h25 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h26 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h27 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h28 TIMEOUT YES 47.24 TIMEOUT YES 47.53 TIMEOUT
h29 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h30 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h31 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h32 TIMEOUT YES 8.73 TIMEOUT YES 8.80 TIMEOUT
h33 TIMEOUT YES 11.17 TIMEOUT YES 11.11 MAYBE
h34 TIMEOUT YES 37.22 TIMEOUT YES 37.32 TIMEOUT
h35 TIMEOUT YES 25.86 TIMEOUT YES 25.93 TIMEOUT
h36 TIMEOUT YES 1.48 TIMEOUT YES 1.50 MAYBE
h37 TIMEOUT YES 2.47 TIMEOUT YES 2.49 TIMEOUT
h38 TIMEOUT YES 3.02 TIMEOUT YES 3.03 MAYBE
h39 TIMEOUT TIMEOUT TIMEOUT TIMEOUT TIMEOUT
h40 TIMEOUT YES 12.07 TIMEOUT YES 12.09 TIMEOUT
h41 TIMEOUT YES 10.82 TIMEOUT YES 10.87 TIMEOUT
h42 TIMEOUT YES 59.05 TIMEOUT YES 59.42 TIMEOUT
h43 YES 0.15 YES 0.16 YES 0.15 YES 0.15 YES 0.19
h44 YES 0.16 YES 0.15 YES 0.15 YES 0.15 YES 0.16
h45 YES 0.33 YES 0.33 YES 0.34 YES 0.33 YES 0.36
h46 YES 0.11 YES 0.11 YES 0.11 YES 0.11 YES 0.11
h47 YES 4.86 YES 4.83 YES 4.85 YES 4.85 YES 4.85
h48 YES 2.85 YES 2.61 YES 2.61 YES 2.63 YES 2.62
h49 YES 13.52 YES 12.66 YES 12.70 YES 12.79 YES 12.68
h50 YES 7.41 YES 7.21 YES 7.22 YES 7.22 YES 7.19
h51 YES 0.15 YES 0.14 YES 0.14 YES 0.14 YES 0.14
h52 YES 0.42 YES 0.41 YES 0.42 YES 0.42 YES 0.41
h53 YES 7.13 YES 6.93 YES 6.92 YES 6.93 YES 6.95
h54 YES 5.91 YES 5.73 YES 5.75 YES 5.75 YES 5.75
h55 YES 0.06 YES 0.06 YES 0.07 YES 0.06 YES 0.06
h56 YES 4.36 YES 4.24 YES 4.24 YES 4.26 YES 4.25
h57 YES 0.08 YES 0.08 YES 0.08 YES 0.08 YES 0.08
h58 YES 9.19 YES 8.95 YES 8.96 YES 8.95 YES 8.95
h59 YES 0.06 YES 0.05 YES 0.05 YES 0.05 YES 0.05
h60 YES 5.69 YES 5.66 YES 5.67 YES 5.69 YES 5.67
h61 YES 0.24 YES 0.24 YES 0.24 YES 0.25 YES 0.24
h62 YES 6.61 YES 6.53 YES 6.53 YES 6.52 YES 6.55
Total YES 188 201 188 200 183
Total NO 16 10 9 17 9
Total MAYBE 24 35 31 24 46
Total TIMEOUT 33 15 33 20 23
Average Runtime 1.20 1.87 0.87 1.88 0.89