-
Notifications
You must be signed in to change notification settings - Fork 156
Overhaul how the rustc
benchmark works.
#1140
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Overhaul how the rustc
benchmark works.
#1140
Conversation
Because it's created in the `bench()` function which is called for each of the `bench*` subcommands.
dff4595
to
0ab786c
Compare
This seems like a good time to add a note in the README about how the artifact ID will be used as the |
This looks largely good to me -- the note @adamgemmell suggests seems like a good idea. This likely should also update https://github.com/rust-lang/rustc-perf/blob/master/collector/collect.sh#L29 to make sure we continue collecting rustc on the perf.rlo collector. |
|
0ab786c
to
4c716d4
Compare
I have fixed the formatting and added the note about the |
Currently the `rustc` benchmark is handled like a normal benchmark in some ways, and handled very differently in others. This results in various non-obvious special cases. This commit improves things. - Adds a `--bench-rustc` option to `bench_local` and `bench_next`, which makes the rustc benchmark opt-in. - Omits the rustc benchmark from `--include`/`--exclude` handling. - Calls it the "special rustc benchmark", in contrast to the "normal benchmarks". - Handles it directly in `bench()`, avoiding a bunch of awkward special-casing code. - Adds an `eprintln!` to make it more obvious when it starts running. - Cleans up some unnecessary string conversions in `bench()`.
Also import more identifiers from `execute`, for consistency.
4c716d4
to
d013f6d
Compare
Currently the
rustc
benchmark is handled like a normal benchmark insome ways, and handled very differently in others. This results in
various non-obvious special cases.
This commit improves things.
--bench-rustc
option tobench_local
andbench_next
, whichmakes the rustc benchmark opt-in.
--include
/--exclude
handling.benchmarks".
bench()
, avoiding a bunch of awkwardspecial-casing code.
eprintln!
to make it more obvious when it starts running.bench()
.