Skip to content

Instantly share code, notes, and snippets.

@zamazan4ik
Created September 17, 2024 18:52
Show Gist options
  • Save zamazan4ik/6814e5012838027e9dafc485181021e5 to your computer and use it in GitHub Desktop.
Save zamazan4ik/6814e5012838027e9dafc485181021e5 to your computer and use it in GitHub Desktop.
jj: PGO instrumented compared to Release
Running benches/diff_bench.rs (target/x86_64-unknown-linux-gnu/release/deps/diff_bench-0035b27d15222294)
Benchmarking bench_diff_lines/unchanged/1k
Benchmarking bench_diff_lines/unchanged/1k: Warming up for 3.0000 s
Benchmarking bench_diff_lines/unchanged/1k: Collecting 100 samples in estimated 6.9102 s (10k iterations)
Benchmarking bench_diff_lines/unchanged/1k: Analyzing
bench_diff_lines/unchanged/1k
time: [683.57 µs 684.15 µs 684.81 µs]
change: [+21.933% +22.355% +22.986%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking bench_diff_lines/modified/1k
Benchmarking bench_diff_lines/modified/1k: Warming up for 3.0000 s
Benchmarking bench_diff_lines/modified/1k: Collecting 100 samples in estimated 5.1044 s (1000 iterations)
Benchmarking bench_diff_lines/modified/1k: Analyzing
bench_diff_lines/modified/1k
time: [5.1131 ms 5.1179 ms 5.1238 ms]
change: [+22.110% +22.482% +22.800%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking bench_diff_lines/reversed/1k
Benchmarking bench_diff_lines/reversed/1k: Warming up for 3.0000 s
Benchmarking bench_diff_lines/reversed/1k: Collecting 100 samples in estimated 9.1082 s (10k iterations)
Benchmarking bench_diff_lines/reversed/1k: Analyzing
bench_diff_lines/reversed/1k
time: [899.24 µs 900.34 µs 901.57 µs]
change: [+21.671% +22.513% +23.475%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking bench_diff_lines/unchanged/10k
Benchmarking bench_diff_lines/unchanged/10k: Warming up for 3.0000 s
Benchmarking bench_diff_lines/unchanged/10k: Collecting 100 samples in estimated 5.1201 s (600 iterations)
Benchmarking bench_diff_lines/unchanged/10k: Analyzing
bench_diff_lines/unchanged/10k
time: [8.1065 ms 8.2516 ms 8.3995 ms]
change: [-1.2611% +2.1695% +5.5100%] (p = 0.20 > 0.05)
No change in performance detected.
Benchmarking bench_diff_lines/modified/10k
Benchmarking bench_diff_lines/modified/10k: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, or reduce sample count to 90.
Benchmarking bench_diff_lines/modified/10k: Collecting 100 samples in estimated 5.2577 s (100 iterations)
Benchmarking bench_diff_lines/modified/10k: Analyzing
bench_diff_lines/modified/10k
time: [51.120 ms 51.197 ms 51.284 ms]
change: [+15.776% +16.117% +16.497%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe
Benchmarking bench_diff_lines/reversed/10k
Benchmarking bench_diff_lines/reversed/10k: Warming up for 3.0000 s
Benchmarking bench_diff_lines/reversed/10k: Collecting 100 samples in estimated 6.8245 s (200 iterations)
Benchmarking bench_diff_lines/reversed/10k: Analyzing
bench_diff_lines/reversed/10k
time: [34.711 ms 34.846 ms 34.980 ms]
change: [+74.453% +75.592% +76.662%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking bench_diff_git_git_read_tree_c
Benchmarking bench_diff_git_git_read_tree_c: Warming up for 3.0000 s
Benchmarking bench_diff_git_git_read_tree_c: Collecting 100 samples in estimated 5.3083 s (66k iterations)
Benchmarking bench_diff_git_git_read_tree_c: Analyzing
bench_diff_git_git_read_tree_c
time: [80.737 µs 80.767 µs 80.796 µs]
change: [+14.596% +14.664% +14.738%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment