| 
Criterion.rs helps you write fast code by detecting and measuring performance improvements or regressions, even small ones, quickly and accurately. You can optimize with confidence, knowing how each change affects the performance of your code.
criterion is passively-maintained with outdated dependencies.
This is fork is updated with:
- renovate bot dependency update
- builtin codspeed feature
clapreplaced withbpafto reduce binary size and compilation time- merged the
criterion-plotcrate intocriterion2 - remove regex filter support to reduce compilation speed
- Statistics: Statistical analysis detects if, and by how much, performance has changed since the last benchmark run
- Charts: Uses gnuplot to generate detailed graphs of benchmark results
- Stable-compatible: Benchmark your code without installing nightly Rust
In order to generate plots, you must have gnuplot installed. See the gnuplot website for installation instructions. See Compatibility Policy for details on the minimum supported Rust version.
To start with Criterion.rs, add the following to your Cargo.toml file:
[dev-dependencies]
criterion = { version = "0.4", features = ["html_reports"] }
[[bench]]
name = "my_benchmark"
harness = false
Next, define a benchmark by creating a file at $PROJECT/benches/my_benchmark.rs with the following contents:
use criterion::{black_box, criterion_group, criterion_main, Criterion};
fn fibonacci(n: u64) -> u64 {
match n {
0 => 1,
1 => 1,
n => fibonacci(n-1) + fibonacci(n-2),
}
}
fn criterion_benchmark(c: &mut Criterion) {
c.bench_function("fib 20", |b| b.iter(|| fibonacci(black_box(20))));
}
criterion_group!(benches, criterion_benchmark);
criterion_main!(benches);
Finally, run this benchmark with cargo bench. You should see output similar to the following:
Running target/release/deps/example-423eedc43b2b3a93
fib 20 time: [26.029 us 26.251 us 26.505 us]
Found 11 outliers among 99 measurements (11.11%)
6 (6.06%) high mild
5 (5.05%) high severe
See the Getting Started guide for more details.
The primary goal of Criterion.rs is to provide a powerful and statistically rigorous tool for measuring the performance of code, preventing performance regressions and accurately measuring optimizations. Additionally, it should be as programmer-friendly as possible and make it easy to create reliable, useful benchmarks, even for programmers without an advanced background in statistics.
First, thank you for contributing.
One great way to contribute to Criterion.rs is to use it for your own benchmarking needs and report your experiences, file and comment on issues, etc.
Code or documentation improvements in the form of pull requests are also welcome. If you're not sure what to work on, try checking the Beginner label.
If your issues or pull requests have no response after a few days, feel free to ping me (@bheisler).
For more details, see the CONTRIBUTING.md file.
Criterion.rs supports the last three stable minor releases of Rust. At time of writing, this means Rust 1.59 or later. Older versions may work, but are not guaranteed.
Currently, the oldest version of Rust believed to work is 1.57. Future versions of Criterion.rs may break support for such old versions, and this will not be considered a breaking change. If you require Criterion.rs to work on old versions of Rust, you will need to stick to a specific patch version of Criterion.rs.
Criterion.rs was originally created by Jorge Aparicio (@japaric) and is currently being maintained by Brook Heisler (@bheisler).
Criterion.rs is dual licensed under the Apache 2.0 license and the MIT license.
- bencher - A port of the libtest benchmark runner to stable Rust
- criterion - The Haskell microbenchmarking library that inspired Criterion.rs
- cargo-benchcmp - Cargo subcommand to compare the output of two libtest or bencher benchmark runs
- cargo-flamegraph - Cargo subcommand to profile an executable and produce a flamegraph
- criterion-cycles-per-byte - A custom-measurement plugin that counts the number of CPU cycles used by the benchmark
- criterion-perf-events - A custom-measurement plugin that counts perf events created by the benchmark
1 Jan 14, 2022
34 Dec 16, 2022
215 Jan 4, 2023
7 Jan 9, 2023
13 Oct 31, 2022
61 Nov 4, 2022
1 Apr 8, 2022
3 Jan 7, 2023
10 Oct 29, 2022
26 Apr 22, 2023
131 Mar 16, 2023
10 Sep 4, 2023
31 Oct 11, 2023
4 Oct 17, 2023
13 Jan 2, 2023
1.9k Apr 20, 2023
4 Aug 29, 2023
15 Aug 6, 2022
4 Jan 26, 2023