BenchmarkDotNet v0.8.2

• Changes in the Summary table
  • Summary table now supports ResultExtenders that can add new column to the table
  • Now we use StandardError (aka Error) as the main accuracy metric
  • Columns op/s, StdDev are disabled by default (you can add it via ResultExtenders)
• Statistic improvements, now you have detailed statistic in the console log like follows:

Mean = 118.5298 us, StdError = 1.2863 us (N = 30, StdDev = 7.0454 us)
Min = 109.1602 us, Median = 117.1794 us, Max = 132.5764 us
IQR = 10.1244 us, LowerFence = 98.0834 us, UpperFence = 138.5810 us
ConfidenceInterval = [116.0086 us; 121.0510 us] (CI 95%)

• Added the Baseline feature, see #64
• Export improvements, now you have files <BenchmarkName>-report-github.md, <BenchmarkName>-report-stackoverflow.md for easy publishing results on GitHub and StackOverflow.
• Basic plotting. Added new BenchmarkRPlotExporter that creates BuildPlots.R in the bin directory. It is an R script that generates boxplot and barplot for your benchmarks (you should have installed R with defined R_HOME environment variable)
• Updated environment info
  • Added Stopwatch Frequency and Resolution
  • Split common benchmark properties (like Mode, Platform, Runtime) in several lines (3 properties per line)
• Log improvements: add total time, statistics, list of exported files
• Bug fixes

Milestone details

In the v0.8.2 scope, 0 issues were resolved and 0 pull requests were merged. This release includes 34 commits by 3 contributors.

Resolved issues (0)

Merged pull requests (0)

Commits (34)

• de0140 Add BenchmarkEnvironmentAnalyser (by @AndreyAkinshin)
• 9ea78f Improved confidence intervals (by @AndreyAkinshin)
• b8d4b6 Rename: PreWarmup -> Pilot (by @AndreyAkinshin)
• 988efc Reporting: change StandardDeviation to StandardError (by @AndreyAkinshin)
• 4da39d Big refactoring (by @AndreyAkinshin)
• 6a0caa Add BenchmarkRPlotExporter (by @AndreyAkinshin)
• 3a6ea4 Allow plugins to extend the Results Table (by @mattwarren)
• 7a7991 Create a "Result Extender" plug-in for #64 (by @mattwarren)
• 70ea89 Integration tests for #64 (by @mattwarren)
• a2d0ec Separate class for string extensions. (by @alinasmirnova)
• 5d6c78 Multiline prefix string extension. (by @alinasmirnova)
• bdd84e New logger type for adding prefix. StackOverflow markdowns. (by @alinasmirnova)
• ba9ec5 Move ExportToFile to ExporterBase. Add file suffix. (by @alinasmirnova)
• 38cd8c GitHub markdown support. (by @alinasmirnova)
• 732420 Markdown readme edits (by @alinasmirnova)
• 541eef Merge pull request #71 from alinasmirnova/refactoring (by @AndreyAkinshin)
• c53618 Merge remote-tracking branch 'refs/remotes/origin/develop' into refactoring (by @AndreyAkinshin)
• e3f420 Samples: add Intro_08_Baseline (by @AndreyAkinshin)
• 145b78 README: add NuGet badge (by @AndreyAkinshin)
• b0e108 Minor fixes (by @AndreyAkinshin)
• 565c25 Update README (by @AndreyAkinshin)
• 045e2a Add BenchmarkStatResultExtender (by @AndreyAkinshin)
• 20c6d2 Minor fixes (by @AndreyAkinshin)
• f80edc Update README (by @AndreyAkinshin)
• 3d2309 README: links to wiki (by @AndreyAkinshin)
• d60d0f Fix bug in TimeUnit (by @AndreyAkinshin)
• 034961 Unit tests for TimeUnit (by @AndreyAkinshin)
• f2c6f1 Logs: add total time (by @AndreyAkinshin)
• 140dec Merge branch 'refs/heads/refactoring' into develop (by @AndreyAkinshin)
• 9e16e8 Ensure that the DeltaResultExtender doesn't throw (by @mattwarren)
• 60f7c9 Merge branch 'develop' of https://github.com/PerfDotNet/BenchmarkDotNet into ... (by @mattwarren)
• 77b24b Rollback of bad changes from the last merge (by @AndreyAkinshin)
• 3df71a More robust way of wiring up BenchmarkBaselineDeltaResultExtender (by @mattwarren)
• 8e5a0e Set library version: 0.8.2 (by @AndreyAkinshin)

Contributors (3)

• Alina Smirnova (@alinasmirnova)
• Andrey Akinshin (@AndreyAkinshin)
• Matt Warren (@mattwarren)

Thank you very much!

Additional details

Date: January 19, 2016

NuGet Packages:

• https://www.nuget.org/packages/BenchmarkDotNet/0.8.2