bench-show: Show, plot and compare benchmark results
Generate text reports and graphical charts from benchmark results
criterion, showing or comparing benchmarks in
many useful ways. In a few lines of code, we can report time taken, peak
memory usage, allocations, among many other fields; we can arrange benchmarks
in groups and compare the groups; we can compare benchmark results before and
after a change; we can show the difference from baseline in absolute terms or
as a percentage; we can sort the results by percentage change to get the
worst affected benchmarks.
bench-show helps us in answering questions like the following, visually or
Across two benchmark runs, show all the operations that resulted in a regression of more than 10%, so that we can quickly identify and fix performance problems in our application.
Across two (or more) packages (providing similar functionality), show all the operations where the performance differs by more than 10%, so that we can critically analyze the packages and choose the right one.
Quick Start: Use
criterion to generate a
results.csv file, and
then use the following code to generate a textual report or a graph:
report "results.csv" Nothing defaultConfig graph "results.csv" "output" defaultConfig
For example, you can show can show % regression from a baseline in descending order texttually as follows:
(time)(Median)(Diff using min estimator) Benchmark streamly(0)(μs)(base) streamly(1)(%)(-base) --------- --------------------- --------------------- zip 644.33 +23.28 map 653.36 +7.65 fold 639.96 -15.63
To show the same graphically:
See the README and the BenchShow.Tutorial module for comprehensive documentation.
[Skip to Readme]
|Versions [faq]||0.2.0, 0.2.1, 0.2.2|
|Dependencies||ansi-wl-pprint (==0.6.*), base (>=4.8 && <5), Chart (>=1.6 && <2), Chart-diagrams (>=1.6 && <2), csv (==0.1.*), directory (>=1.2 && <1.4), filepath (>=1.3 && <1.5), mwc-random (>=0.13 && <0.15), split (==0.2.*), statistics (==0.15.*), transformers (>=0.4 && <0.6), vector (>=0.10 && <0.13) [details]|
|Copyright||2017, 2018 Composewell Technologies|
|Source repo||head: git clone https://github.com/composewell/bench-show|
|Uploaded||by harendra at Tue Oct 30 14:31:04 UTC 2018|
|Downloads||273 total (59 in the last 30 days)|
|Rating||(no votes yet) [estimated by rule of succession]|
Docs uploaded by user [build log]
All reported builds failed as of 2018-11-02 [all 3 reports]
For package maintainers and hackage trustees