+++ OK, passed 10000 tests. warming up estimating clock resolution... mean is 13.61566 us (40001 iterations) found 632 outliers among 39999 samples (1.6%) 549 (1.4%) high severe estimating cost of a clock call... mean is 318.1415 ns (85 iterations) found 15 outliers among 85 samples (17.6%) 15 (17.6%) high severe benchmarking random/ghc collecting 100 samples, 40103 iterations each, in estimated 1.361598 s bootstrapping with 100000 resamples mean: 335.3855 ns, lb 334.4350 ns, ub 339.1859 ns, ci 0.950 std dev: 8.591500 ns, lb 1.536631 ns, ub 20.11715 ns, ci 0.950 found 8 outliers among 100 samples (8.0%) 3 (3.0%) high mild 5 (5.0%) high severe variance introduced by outliers: 0.998% variance is unaffected by outliers benchmarking random/ghc' collecting 100 samples, 41047 iterations each, in estimated 1.361574 s bootstrapping with 100000 resamples mean: 333.7127 ns, lb 332.1851 ns, ub 337.4480 ns, ci 0.950 std dev: 11.45805 ns, lb 5.592544 ns, ub 21.80001 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 3 (3.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 0.999% variance is unaffected by outliers benchmarking random/ghc'' collecting 100 samples, 41015 iterations each, in estimated 1.361572 s bootstrapping with 100000 resamples mean: 334.2495 ns, lb 334.0257 ns, ub 334.6001 ns, ci 0.950 std dev: 1.411241 ns, lb 988.1713 ps, ub 2.029566 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 4 (4.0%) high mild 6 (6.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking random/ghc''' collecting 100 samples, 40919 iterations each, in estimated 1.361570 s bootstrapping with 100000 resamples mean: 330.8420 ns, lb 330.6798 ns, ub 331.1888 ns, ci 0.950 std dev: 1.159247 ns, lb 668.5561 ps, ub 2.169322 ns, ci 0.950 found 6 outliers among 100 samples (6.0%) 2 (2.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc collecting 100 samples, 1 iterations each, in estimated 197.9024 s bootstrapping with 100000 resamples mean: 754.8432 ms, lb 753.1244 ms, ub 755.3495 ms, ci 0.950 std dev: 4.282882 ms, lb 1.430347 ms, ub 9.687440 ms, ci 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) low severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc' collecting 100 samples, 1 iterations each, in estimated 46.17419 s bootstrapping with 100000 resamples mean: 467.1604 ms, lb 466.7996 ms, ub 467.6010 ms, ci 0.950 std dev: 2.035625 ms, lb 1.654840 ms, ub 2.708787 ms, ci 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high mild 1 (1.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc'' collecting 100 samples, 1 iterations each, in estimated 45.63260 s bootstrapping with 100000 resamples mean: 455.2373 ms, lb 454.9215 ms, ub 456.2122 ms, ci 0.950 std dev: 2.566041 ms, lb 981.7127 us, ub 5.607354 ms, ci 0.950 found 11 outliers among 100 samples (11.0%) 3 (3.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc''' collecting 100 samples, 1 iterations each, in estimated 46.52531 s bootstrapping with 100000 resamples mean: 457.5139 ms, lb 457.3146 ms, ub 457.8794 ms, ci 0.950 std dev: 1.341669 ms, lb 847.4891 us, ub 2.182414 ms, ci 0.950 found 11 outliers among 100 samples (11.0%) 4 (4.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc collecting 100 samples, 38669 iterations each, in estimated 1.361585 s bootstrapping with 100000 resamples mean: 354.4202 ns, lb 354.2985 ns, ub 354.6878 ns, ci 0.950 std dev: 883.4568 ps, lb 497.6282 ps, ub 1.773199 ns, ci 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) low mild 1 (1.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc' collecting 100 samples, 38512 iterations each, in estimated 1.361591 s bootstrapping with 100000 resamples mean: 353.6499 ns, lb 352.7094 ns, ub 357.8740 ns, ci 0.950 std dev: 8.718460 ns, lb 1.165423 ns, ub 20.64673 ns, ci 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) high severe variance introduced by outliers: 0.997% variance is unaffected by outliers benchmarking shakespeare/ghc'' collecting 100 samples, 38286 iterations each, in estimated 1.361581 s bootstrapping with 100000 resamples mean: 354.3150 ns, lb 353.9248 ns, ub 355.0440 ns, ci 0.950 std dev: 2.644616 ns, lb 1.506599 ns, ub 3.926156 ns, ci 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking shakespeare/ghc''' collecting 100 samples, 38631 iterations each, in estimated 1.361596 s bootstrapping with 100000 resamples mean: 354.6511 ns, lb 354.5560 ns, ub 354.7683 ns, ci 0.950 std dev: 536.5729 ps, lb 439.1529 ps, ub 759.2855 ps, ci 0.950 found 2 outliers among 100 samples (2.0%) 1 (1.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking space/ghc collecting 100 samples, 40751 iterations each, in estimated 1.361584 s bootstrapping with 100000 resamples mean: 333.0739 ns, lb 332.8243 ns, ub 333.6820 ns, ci 0.950 std dev: 1.877387 ns, lb 809.3170 ps, ub 3.573228 ns, ci 0.950 found 5 outliers among 100 samples (5.0%) 5 (5.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking space/ghc' collecting 100 samples, 40723 iterations each, in estimated 1.361567 s bootstrapping with 100000 resamples mean: 335.0913 ns, lb 334.6339 ns, ub 335.9928 ns, ci 0.950 std dev: 3.156786 ns, lb 1.885708 ns, ub 5.144787 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 2 (2.0%) high mild 9 (9.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking space/ghc'' collecting 100 samples, 40824 iterations each, in estimated 1.361588 s bootstrapping with 100000 resamples mean: 335.0377 ns, lb 334.9307 ns, ub 335.2376 ns, ci 0.950 std dev: 727.3157 ps, lb 414.7741 ps, ub 1.231130 ns, ci 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking space/ghc''' collecting 100 samples, 40696 iterations each, in estimated 1.361597 s bootstrapping with 100000 resamples mean: 334.7427 ns, lb 334.6406 ns, ub 334.9381 ns, ci 0.950 std dev: 700.2734 ps, lb 441.1236 ps, ub 1.306595 ns, ci 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking b/ghc collecting 100 samples, 40696 iterations each, in estimated 1.361597 s bootstrapping with 100000 resamples mean: 334.4267 ns, lb 334.2209 ns, ub 335.1489 ns, ci 0.950 std dev: 1.764115 ns, lb 518.5120 ps, ub 4.020552 ns, ci 0.950 found 5 outliers among 100 samples (5.0%) 2 (2.0%) high mild 3 (3.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking b/ghc' collecting 100 samples, 40782 iterations each, in estimated 1.361567 s bootstrapping with 100000 resamples mean: 336.1290 ns, lb 336.0282 ns, ub 336.3184 ns, ci 0.950 std dev: 688.0308 ps, lb 371.4434 ps, ub 1.126719 ns, ci 0.950 found 5 outliers among 100 samples (5.0%) 3 (3.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking b/ghc'' collecting 100 samples, 40562 iterations each, in estimated 1.361570 s bootstrapping with 100000 resamples mean: 337.1913 ns, lb 335.8093 ns, ub 340.8660 ns, ci 0.950 std dev: 10.25204 ns, lb 1.577051 ns, ub 20.79917 ns, ci 0.950 found 9 outliers among 100 samples (9.0%) 1 (1.0%) low severe 7 (7.0%) high severe variance introduced by outliers: 0.998% variance is unaffected by outliers benchmarking b/ghc''' collecting 100 samples, 40746 iterations each, in estimated 1.361595 s bootstrapping with 100000 resamples mean: 335.7902 ns, lb 335.6087 ns, ub 336.1306 ns, ci 0.950 std dev: 1.237225 ns, lb 804.7162 ps, ub 2.128560 ns, ci 0.950 found 10 outliers among 100 samples (10.0%) 2 (2.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking t/ghc collecting 100 samples, 40772 iterations each, in estimated 1.361589 s bootstrapping with 100000 resamples mean: 335.5323 ns, lb 335.2821 ns, ub 335.9535 ns, ci 0.950 std dev: 1.628030 ns, lb 1.103468 ns, ub 2.514457 ns, ci 0.950 found 10 outliers among 100 samples (10.0%) 2 (2.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking t/ghc' collecting 100 samples, 40625 iterations each, in estimated 1.361572 s bootstrapping with 100000 resamples mean: 334.6695 ns, lb 334.5674 ns, ub 334.8295 ns, ci 0.950 std dev: 644.1256 ps, lb 472.4545 ps, ub 1.010268 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 7 (7.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking t/ghc'' collecting 100 samples, 40809 iterations each, in estimated 1.361592 s bootstrapping with 100000 resamples mean: 335.6402 ns, lb 335.1777 ns, ub 336.4552 ns, ci 0.950 std dev: 3.054758 ns, lb 1.893249 ns, ub 4.445290 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 2 (2.0%) high mild 9 (9.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking t/ghc''' collecting 100 samples, 41059 iterations each, in estimated 1.361598 s bootstrapping with 100000 resamples mean: 337.7765 ns, lb 337.2608 ns, ub 338.5814 ns, ci 0.950 std dev: 3.259791 ns, lb 2.364436 ns, ub 4.442409 ns, ci 0.950 found 16 outliers among 100 samples (16.0%) 2 (2.0%) high mild 14 (14.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking n/ghc collecting 100 samples, 40632 iterations each, in estimated 1.361570 s bootstrapping with 100000 resamples mean: 335.7491 ns, lb 335.5139 ns, ub 336.1218 ns, ci 0.950 std dev: 1.495651 ns, lb 1.075091 ns, ub 2.389507 ns, ci 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking n/ghc' collecting 100 samples, 40452 iterations each, in estimated 1.361586 s bootstrapping with 100000 resamples mean: 336.2353 ns, lb 335.9281 ns, ub 336.8233 ns, ci 0.950 std dev: 2.099609 ns, lb 1.278600 ns, ub 3.479301 ns, ci 0.950 found 13 outliers among 100 samples (13.0%) 6 (6.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking n/ghc'' collecting 100 samples, 41024 iterations each, in estimated 1.361572 s bootstrapping with 100000 resamples mean: 336.7488 ns, lb 336.6014 ns, ub 337.0462 ns, ci 0.950 std dev: 1.029476 ns, lb 617.9073 ps, ub 1.905411 ns, ci 0.950 found 10 outliers among 100 samples (10.0%) 6 (6.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking n/ghc''' collecting 100 samples, 40504 iterations each, in estimated 1.361598 s bootstrapping with 100000 resamples mean: 335.8524 ns, lb 335.3619 ns, ub 337.4336 ns, ci 0.950 std dev: 4.031480 ns, lb 1.412744 ns, ub 8.905863 ns, ci 0.950 found 9 outliers among 100 samples (9.0%) 8 (8.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking r/ghc collecting 100 samples, 40180 iterations each, in estimated 1.361567 s bootstrapping with 100000 resamples mean: 335.3456 ns, lb 335.1170 ns, ub 335.7682 ns, ci 0.950 std dev: 1.549638 ns, lb 953.8784 ps, ub 2.535959 ns, ci 0.950 found 9 outliers among 100 samples (9.0%) 1 (1.0%) low severe 3 (3.0%) high mild 5 (5.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking r/ghc' collecting 100 samples, 40558 iterations each, in estimated 1.361569 s bootstrapping with 100000 resamples mean: 336.3603 ns, lb 335.9085 ns, ub 337.0729 ns, ci 0.950 std dev: 2.867666 ns, lb 2.016688 ns, ub 3.914004 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 3 (3.0%) high mild 8 (8.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking r/ghc'' collecting 100 samples, 40477 iterations each, in estimated 1.361574 s bootstrapping with 100000 resamples mean: 334.1684 ns, lb 333.8808 ns, ub 334.8433 ns, ci 0.950 std dev: 2.112668 ns, lb 792.1059 ps, ub 3.687288 ns, ci 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking r/ghc''' collecting 100 samples, 40671 iterations each, in estimated 1.361574 s bootstrapping with 100000 resamples mean: 336.2475 ns, lb 336.0814 ns, ub 336.7703 ns, ci 0.950 std dev: 1.358196 ns, lb 499.8391 ps, ub 2.991605 ns, ci 0.950 found 6 outliers among 100 samples (6.0%) 4 (4.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking f/ghc collecting 100 samples, 41059 iterations each, in estimated 1.361598 s bootstrapping with 100000 resamples mean: 335.2366 ns, lb 335.0220 ns, ub 335.6099 ns, ci 0.950 std dev: 1.415698 ns, lb 942.9835 ps, ub 2.169847 ns, ci 0.950 found 10 outliers among 100 samples (10.0%) 4 (4.0%) high mild 6 (6.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking f/ghc' collecting 100 samples, 40631 iterations each, in estimated 1.361595 s bootstrapping with 100000 resamples mean: 338.6801 ns, lb 336.4551 ns, ub 342.9305 ns, ci 0.950 std dev: 15.36959 ns, lb 9.250281 ns, ub 22.97298 ns, ci 0.950 found 15 outliers among 100 samples (15.0%) 2 (2.0%) high mild 13 (13.0%) high severe variance introduced by outliers: 0.999% variance is unaffected by outliers benchmarking f/ghc'' collecting 100 samples, 40740 iterations each, in estimated 1.361587 s bootstrapping with 100000 resamples mean: 335.5371 ns, lb 334.6597 ns, ub 337.7667 ns, ci 0.950 std dev: 6.653907 ns, lb 3.070029 ns, ub 13.44546 ns, ci 0.950 found 10 outliers among 100 samples (10.0%) 9 (9.0%) high severe variance introduced by outliers: 0.996% variance is unaffected by outliers benchmarking f/ghc''' collecting 100 samples, 40786 iterations each, in estimated 1.361567 s bootstrapping with 100000 resamples mean: 335.1477 ns, lb 335.0755 ns, ub 335.2597 ns, ci 0.950 std dev: 453.4318 ps, lb 305.7724 ps, ub 686.7372 ps, ci 0.950 found 4 outliers among 100 samples (4.0%) 2 (2.0%) high mild 2 (2.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking v/ghc collecting 100 samples, 40616 iterations each, in estimated 1.361595 s bootstrapping with 100000 resamples mean: 336.7491 ns, lb 335.7024 ns, ub 340.3004 ns, ci 0.950 std dev: 8.802091 ns, lb 2.677955 ns, ub 19.62147 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 4 (4.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 0.998% variance is unaffected by outliers benchmarking v/ghc' collecting 100 samples, 39647 iterations each, in estimated 1.361592 s bootstrapping with 100000 resamples mean: 348.7349 ns, lb 346.3728 ns, ub 353.0996 ns, ci 0.950 std dev: 15.97876 ns, lb 9.926857 ns, ub 23.54118 ns, ci 0.950 found 12 outliers among 100 samples (12.0%) 11 (11.0%) high severe variance introduced by outliers: 0.999% variance is unaffected by outliers benchmarking v/ghc'' collecting 100 samples, 40673 iterations each, in estimated 1.361582 s bootstrapping with 100000 resamples mean: 336.8786 ns, lb 336.3570 ns, ub 337.5506 ns, ci 0.950 std dev: 3.003466 ns, lb 2.452388 ns, ub 3.849910 ns, ci 0.950 found 4 outliers among 100 samples (4.0%) 4 (4.0%) high mild variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking v/ghc''' collecting 100 samples, 40751 iterations each, in estimated 1.361569 s bootstrapping with 100000 resamples mean: 335.9711 ns, lb 335.2754 ns, ub 338.2351 ns, ci 0.950 std dev: 5.772661 ns, lb 2.083262 ns, ub 12.81688 ns, ci 0.950 found 13 outliers among 100 samples (13.0%) 3 (3.0%) high mild 10 (10.0%) high severe variance introduced by outliers: 0.995% variance is unaffected by outliers benchmarking xa0/ghc collecting 100 samples, 40553 iterations each, in estimated 1.361593 s bootstrapping with 100000 resamples mean: 337.4229 ns, lb 336.9205 ns, ub 338.2883 ns, ci 0.950 std dev: 3.281176 ns, lb 2.160989 ns, ub 4.647940 ns, ci 0.950 found 9 outliers among 100 samples (9.0%) 9 (9.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking xa0/ghc' collecting 100 samples, 40660 iterations each, in estimated 1.361591 s bootstrapping with 100000 resamples mean: 337.5174 ns, lb 336.8246 ns, ub 338.5450 ns, ci 0.950 std dev: 4.276445 ns, lb 3.154477 ns, ub 5.529748 ns, ci 0.950 found 15 outliers among 100 samples (15.0%) 5 (5.0%) high mild 10 (10.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking xa0/ghc'' collecting 100 samples, 40682 iterations each, in estimated 1.361573 s bootstrapping with 100000 resamples mean: 335.5795 ns, lb 335.0616 ns, ub 336.4595 ns, ci 0.950 std dev: 3.395489 ns, lb 2.240807 ns, ub 4.730957 ns, ci 0.950 found 9 outliers among 100 samples (9.0%) 8 (8.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking xa0/ghc''' collecting 100 samples, 35503 iterations each, in estimated 1.361596 s bootstrapping with 100000 resamples mean: 336.4726 ns, lb 335.7954 ns, ub 339.5402 ns, ci 0.950 std dev: 6.380671 ns, lb 630.8760 ps, ub 15.14783 ns, ci 0.950 found 7 outliers among 100 samples (7.0%) 3 (3.0%) high mild 4 (4.0%) high severe variance introduced by outliers: 0.996% variance is unaffected by outliers benchmarking xff/ghc collecting 100 samples, 40729 iterations each, in estimated 1.361590 s bootstrapping with 100000 resamples mean: 336.6461 ns, lb 335.7665 ns, ub 340.5693 ns, ci 0.950 std dev: 8.077867 ns, lb 937.2353 ps, ub 19.04479 ns, ci 0.950 found 7 outliers among 100 samples (7.0%) 6 (6.0%) high severe variance introduced by outliers: 0.997% variance is unaffected by outliers benchmarking xff/ghc' collecting 100 samples, 40708 iterations each, in estimated 1.361584 s bootstrapping with 100000 resamples mean: 335.4996 ns, lb 334.1213 ns, ub 339.0234 ns, ci 0.950 std dev: 9.885741 ns, lb 709.8942 ps, ub 18.52042 ns, ci 0.950 found 11 outliers among 100 samples (11.0%) 4 (4.0%) high mild 7 (7.0%) high severe variance introduced by outliers: 0.998% variance is unaffected by outliers benchmarking xff/ghc'' collecting 100 samples, 40681 iterations each, in estimated 1.361598 s bootstrapping with 100000 resamples mean: 335.3006 ns, lb 335.0735 ns, ub 335.7871 ns, ci 0.950 std dev: 1.626528 ns, lb 912.0882 ps, ub 2.903802 ns, ci 0.950 found 5 outliers among 100 samples (5.0%) 4 (4.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers benchmarking xff/ghc''' collecting 100 samples, 40599 iterations each, in estimated 1.361586 s bootstrapping with 100000 resamples mean: 335.4039 ns, lb 335.0511 ns, ub 336.0256 ns, ci 0.950 std dev: 2.341207 ns, lb 1.558003 ns, ub 3.716756 ns, ci 0.950 found 13 outliers among 100 samples (13.0%) 2 (2.0%) high mild 11 (11.0%) high severe variance introduced by outliers: 0.990% variance is unaffected by outliers