qkx_      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRST U V W X Y Z [ \ ] ^ _GHC experimentalbos@serpentine.com+A benchmark may consist of either a single   item  with a name, created with ", or a (possibly nested) group of  s, created with . AA container for a pure function to benchmark, and an argument to ) supply to it each time it is evaluated. `a $A benchmarkable function or action. 8Run a function or action the specified number of times. %The function or action to benchmark. +The number of times to run or evaluate it. AApply an argument to a function, and evaluate the result to weak  head normal form (WHNF). AApply an argument to a function, and evaluate the result to head  normal form (NF). APerform an action, then evaluate its result to head normal form. @ This is particularly useful for forcing a lazy IO action to be  completely performed. @Perform an action, then evaluate its result to weak head normal D form (WHNF). This is useful for forcing an IO action whose result ? is an expression to be evaluated down to a more useful value. Create a single benchmark. "A name to identify the benchmark. 7Group several benchmarks together under a common name. ,A name to identify the group of benchmarks. %Benchmarks to group under this name. >Retrieve the names of all benchmarks. Grouped benchmarks are ) prefixed with the name of the group they're in.       GHC experimentalbos@serpentine.comGHC experimentalbos@serpentine.com#!Top-level program configuration. The "version" banner to print. Confidence interval to use. &Whether to run the GC between passes. What to plot, and where. 'Whether to print information and exit.  Number of resamples to perform. Number of samples to collect. !Filename of summary CSV "Whether to run verbosely. #What to plot. $Benchmark timings. %*Kernel density estimate of probabilities. &BSupported plot outputs. Some outputs support width and height in  varying units. A point is 1/72 of an inch (0.353mm). '+Display in a window, dimensions in pixels. ( SVG file, dimensions in points. ) PNG file, dimensions in pixels. * PDF file, dimensions in points. +Textual CSV file. ,APrint some information and exit, without running any benchmarks. - Print a help/usaage message. .&Print version information (if known). /"Print a list of known benchmarks. 0+Do not actually print-and-exit. (Default.) 1-Control the amount of information displayed. 2345(A configuration with sensible defaults. 6Constructor for bc values. 7Deconstructor for bc values. Field to access. Default to use. de! !"#$%&'()*+,-./01234567! !"&+*)('#%$,0/.-1432576!  !" !"#%$$%&+*)(''()*+,0/.--./01432234567GHC experimentalbos@serpentine.com81The monad in which most criterion code executes. fg9:;89:;89:;89:;GHC experimentalbos@serpentine.com hijkl<Print a "normal" note. =Print verbose output. >Print an error message. ?#Add to summary CSV (if applicable) <=>?<>=?<=>?GHC experimentalbos@serpentine.com@APlot timing data. The kind of output desired. Benchmark name.  Timing data. BPlot kernel density estimate. The kind of output desired. Benchmark name. Range of x-axis "Points at which KDE was computed. Kernel density estimates. mnop?Get rid of spaces and other potentially troublesome characters  from output. @ABBA@@ABGHC experimentalbos@serpentine.comCAA description of the extent to which outliers in the sample data 0 affect the sample mean and standard deviation. DAbove 50% (i.e. measurements  are useless). EBetween 10% and 50%. FBetween 1% and 10%. GLess than 1% effect. H8Outliers from sample data, calculated using the boxplot  technique. IJK4More than 3 times the IQR below the first quartile. L:Between 1.5 and 3 times the IQR below the first quartile. M:Between 1.5 and 3 times the IQR above the third quartile. N4More than 3 times the IQR above the third quartile. qO>Classify outliers in a data set, using the boxplot technique. P?Compute the extent to which outliers in the sample data affect ) the sample mean and standard deviation. #Bootstrap estimate of sample mean. Bootstrap estimate of sample  standard deviation. Number of original iterations. Q0Count the total number of outliers in a sample. RDisplay the mean of a r , and characterise the outliers  present in the sample. Number of iterations used to  compute the sample. SDisplay a report of the IH present in a r. CDEFGHIJKLMNOPQRSHIJKLMNCGFEDRQOSPCGFEDDEFGHIJKLMNIJKLMNOPQRS GHC experimentalbos@serpentine.comT/Measured aspects of the execution environment. UVClock resolution (in seconds). W.The cost of a single clock call (in seconds). X#Measure the execution environment. TUVWXTUVWXTUVWUVWX GHC experimentalbos@serpentine.comY9Run a single benchmark, and return timings measured when  executing it. s4Run a single benchmark and analyse its performance. tZ*Run, and analyse, one or more benchmarks. A predicate that chooses # whether to run a benchmark by its  name.  YZ  YZYZ GHC experimentalbos@serpentine.com uParse a plot output. vParse a plot type. wParse a confidence interval. xParse a positive number. y[3The standard options accepted on the command line. z{\Parse command line options. ]%An entry point that can be used as a main function.  import Criterion.Main   fib :: Int -> Int  fib 0 = 0  fib 1 = 1  fib n = fib (n-1) + fib (n-2)   main = defaultMain [ 0 bgroup "fib" [ bench "10" $ whnf fib 10 0 , bench "35" $ whnf fib 35 0 , bench "37" $ whnf fib 37  ]  ] ^%An entry point that can be used as a main function, with  configurable defaults.  Example:   import Criterion.Config * import qualified Criterion.MultiMap as M  import Criterion.Main   myConfig = defaultConfig { ? -- Always display an 800x600 window with curves. C cfgPlot = M.singleton KernelDensity (Window 800 600)  }  / main = defaultMainWith myConfig (return ()) [ ' bench "fib 30" $ whnf fib 30  ] !If you save the above example as "Fib.hs", you should be able  to compile it as follows:   ghc -O --make Fib Run " Fib --help". on the command line to get a list of command  line options. 5Prepare data prior to executing the first benchmark. |BDisplay an error message from a command line parsing failure, and  exit.  [\]^  ]^[\[\]^}   !""#$%&'()*+,-./0123456789:;<=>?@A BCDEFGHIJKLMNOPQQRSTUVWXYZ[ \ \ ] ^ _ ` a b c d e fghijhijkl mnoppqrstuvwxy z { | } ~  criterion-0.5.0.9Criterion.MultiMapCriterion.TypesCriterion.MeasurementCriterion.ConfigCriterion.Monad Criterion.IOCriterion.PlotCriterion.AnalysisCriterion.Environment CriterionCriterion.MainMultiMaptoMapfromMap singletonlookup Benchmark BenchGroupPure BenchmarkablerunwhnfnfnfIOwhnfIObenchbgroup benchNamestimetime_getTime runForAtLeastsecsConfig cfgBannercfgConfInterval cfgPerformGCcfgPlotcfgPlotSameAxis cfgPrintExit cfgResamples cfgSamplescfgSummaryFile cfgVerbosityPlotTiming KernelDensity PlotOutputWindowSVGPNGPDFCSV PrintExitHelpVersionListNada VerbosityVerboseNormalQuiet defaultConfigljustfromLJ getConfig getConfigItem withConfignoteprolix printErrorsummaryplotWith plotTimingplotKDEOutlierVarianceSevereModerateSlight UnaffectedOutliers samplesSeen lowSeverelowMildhighMild highSevereclassifyOutliersoutlierVariance countOutliers analyseMean noteOutliers EnvironmentenvClockResolution envClockCostmeasureEnvironment runBenchmark runAndAnalysedefaultOptions parseArgs defaultMaindefaultMainWithNFWHNFbase Data.MonoidLast emptyConfig appendConfig runCriterionCritHPrintfType chPrintfImpl PrintfContchPrintfwriteTo escapeCSVputRowmangle addOutliersstatistics-0.8.0.5Statistics.TypesSamplerunAndAnalyseOneplotAll parsePlotplotciposnoArg printBanner printUsage parseError