mgN^      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRS T U V W X Y Z [ \ ] ^GHC experimentalbos@serpentine.com+A benchmark may consist of either a single   item  with a name, created with ", or a (possibly nested) group of  s, created with . AA container for a pure function to benchmark, and an argument to ) supply to it each time it is evaluated. _` $A benchmarkable function or action. 8Run a function or action the specified number of times. %The function or action to benchmark. +The number of times to run or evaluate it. AApply an argument to a function, and evaluate the result to weak  head normal form (WHNF). AApply an argument to a function, and evaluate the result to head  normal form (NF). APerform an action, then evaluate its result to head normal form. @ This is particularly useful for forcing a lazy IO action to be  completely performed. Create a single benchmark. "A name to identify the benchmark. 7Group several benchmarks together under a common name. ,A name to identify the group of benchmarks. %Benchmarks to group under this name. >Retrieve the names of all benchmarks. Grouped benchmarks are ) prefixed with the name of the group they're in.       GHC experimentalbos@serpentine.com#!Top-level program configuration. The "version" banner to print. Confidence interval to use. &Whether to run the GC between passes. What to plot, and where. 'Whether to print information and exit.  Number of resamples to perform. Number of samples to collect. Filename of summary CSV !Whether to run verbosely. "What to plot. #Benchmark timings. $*Kernel density estimate of probabilities. %BSupported plot outputs. Some outputs support width and height in  varying units. A point is 1/72 of an inch (0.353mm). &+Display in a window, dimensions in pixels. ' SVG file, dimensions in points. ( PNG file, dimensions in pixels. ) PDF file, dimensions in points. *Textual CSV file. +APrint some information and exit, without running any benchmarks. , Print a help/usaage message. -&Print version information (if known). ."Print a list of known benchmarks. /+Do not actually print-and-exit. (Default.) 0-Control the amount of information displayed. 1234(A configuration with sensible defaults. 5Constructor for ab values. 6Deconstructor for ab values. Field to access. Default to use. cd! !"#$%&'()*+,-./0123456! !%*)('&"$#+/.-,0321465!  ! !"$##$%*)('&&'()*+/.-,,-./0321123456GHC experimentalbos@serpentine.com71The monad in which most criterion code executes. ef89:789:789:789:GHC experimentalbos@serpentine.com ghijk;Print a "normal" note. <Print verbose output. =Print an error message. >#Add to summary CSV (if applicable) ;<=>;=<>;<=>GHC experimentalbos@serpentine.com?@Plot timing data. The kind of output desired. Benchmark name.  Timing data. APlot kernel density estimate. The kind of output desired. Benchmark name. Range of x-axis "Points at which KDE was computed. Kernel density estimates. lmno?Get rid of spaces and other potentially troublesome characters  from output. ?@AA@??@AGHC experimentalbos@serpentine.comBAA description of the extent to which outliers in the sample data 0 affect the sample mean and standard deviation. CAbove 50% (i.e. measurements  are useless). DBetween 10% and 50%. EBetween 1% and 10%. FLess than 1% effect. G8Outliers from sample data, calculated using the boxplot  technique. HIJ4More than 3 times the IQR below the first quartile. K:Between 1.5 and 3 times the IQR below the first quartile. L:Between 1.5 and 3 times the IQR above the third quartile. M4More than 3 times the IQR above the third quartile. pN>Classify outliers in a data set, using the boxplot technique. O?Compute the extent to which outliers in the sample data affect ) the sample mean and standard deviation. #Bootstrap estimate of sample mean. Bootstrap estimate of sample  standard deviation. Number of original iterations. P0Count the total number of outliers in a sample. QDisplay the mean of a q , and characterise the outliers  present in the sample. Number of iterations used to  compute the sample. RDisplay a report of the HG present in a q. BCDEFGHIJKLMNOPQRGHIJKLMBFEDCQPNROBFEDCCDEFGHIJKLMHIJKLMNOPQR GHC experimentalbos@serpentine.comS/Measured aspects of the execution environment. TUClock resolution (in seconds). V.The cost of a single clock call (in seconds). W#Measure the execution environment. STUVWSTUVWSTUVTUVW GHC experimentalbos@serpentine.comX9Run a single benchmark, and return timings measured when  executing it. r4Run a single benchmark and analyse its performance. sY*Run, and analyse, one or more benchmarks. A predicate that chooses # whether to run a benchmark by its  name.  XY  XYXY GHC experimentalbos@serpentine.com tParse a plot output. uParse a plot type. vParse a confidence interval. wParse a positive number. xZ3The standard options accepted on the command line. yz[Parse command line options. \%An entry point that can be used as a main function.  import Criterion.Main   fib :: Int -> Int  fib 0 = 0  fib 1 = 1  fib n = fib (n-1) + fib (n-2)   main = defaultMain [ 1 bgroup "fib" [ bench "fib 10" $ B fib 10 1 , bench "fib 35" $ B fib 35 1 , bench "fib 37" $ B fib 37  ]  ] ]%An entry point that can be used as a main function, with  configurable defaults.  Example:  import Criterion.Config * import qualified Criterion.MultiMap as M   myConfig = defaultConfig { ? -- Always display an 800x600 window with curves. C cfgPlot = M.singleton KernelDensity (Window 800 600)  }  / main = defaultMainWith myConfig (return ()) [ $ bench "fib 30" $ B fib 30  ] !If you save the above example as "Fib.hs", you should be able  to compile it as follows:  ghc -O --make Fib Run " Fib --help". on the command line to get a list of command  line options. 5Prepare data prior to executing the first benchmark. {BDisplay an error message from a command line parsing failure, and  exit.  Z[\]  \]Z[Z[\]|   !!"#$%&'()*+,-./0123456789:;<=>?@ ABCDEFGHIJKLMNOPPQRSTUVWXYZ [ [ \ ] ^ _ ` a b c d efghighijk lmnoopqrstuvwx y z { | } ~  criterion-0.4.1.0Criterion.MultiMapCriterion.TypesCriterion.MeasurementCriterion.ConfigCriterion.Monad Criterion.IOCriterion.PlotCriterion.AnalysisCriterion.Environment CriterionCriterion.MainMultiMaptoMapfromMap singletonlookup Benchmark BenchGroupPure BenchmarkablerunwhnfnfnfIObenchbgroup benchNamestimetime_getTime runForAtLeastsecsConfig cfgBannercfgConfInterval cfgPerformGCcfgPlotcfgPlotSameAxis cfgPrintExit cfgResamples cfgSamplescfgSummaryFile cfgVerbosityPlotTiming KernelDensity PlotOutputWindowSVGPNGPDFCSV PrintExitHelpVersionListNada VerbosityVerboseNormalQuiet defaultConfigljustfromLJ getConfig getConfigItem withConfignoteprolix printErrorsummaryplotWith plotTimingplotKDEOutlierVarianceSevereModerateSlight UnaffectedOutliers samplesSeen lowSeverelowMildhighMild highSevereclassifyOutliersoutlierVariance countOutliers analyseMean noteOutliers EnvironmentenvClockResolution envClockCostmeasureEnvironment runBenchmark runAndAnalysedefaultOptions parseArgs defaultMaindefaultMainWithNFWHNFbase Data.MonoidLast emptyConfig appendConfig runCriterionCritHPrintfType chPrintfImpl PrintfContchPrintfwriteTo escapeCSVputRowmangle addOutliersstatistics-0.4.1Statistics.TypesSamplerunAndAnalyseOneplotAll parsePlotplotciposnoArg printBanner printUsage parseError