Skip to content

/cmd: Improved devx of benching many pallets simultaneously#6007

Merged
mordamax merged 11 commits into
masterfrom
mak-flip-cmd-flag
Oct 11, 2024
Merged

/cmd: Improved devx of benching many pallets simultaneously#6007
mordamax merged 11 commits into
masterfrom
mak-flip-cmd-flag

Conversation

@mordamax

@mordamax mordamax commented Oct 10, 2024

Copy link
Copy Markdown
Contributor

Improved devx of running many pallets simultaneously

Changes to /cmd:

  • Replace (flip) --continue-on-fail with --fail-fast, but only for bench. This makes all pallets/runtimes run non-stop by default, as it was primary use-case during tests
  • The list of successful/failed pallets was hard to find within tons of logs, so decided to write only needed logs in a file, and output as a summary in the workflow and in the comment
  • Side fix: updated tasks_example to pallet_example_tasks to make compliant with standard naming
image
  • added command results to workflow summary:
image

@mordamax mordamax marked this pull request as ready for review October 10, 2024 21:23
@mordamax mordamax requested review from a team as code owners October 10, 2024 21:23
@mordamax mordamax changed the title /cmd: flip --continue-on-fail -> --fail-fast for bench /cmd: Improved devx of running many pallets simultaneously Oct 10, 2024
@mordamax mordamax added the R0-no-crate-publish-required The change does not require any crates to be re-published. label Oct 10, 2024
@mordamax mordamax changed the title /cmd: Improved devx of running many pallets simultaneously /cmd: Improved devx of benching many pallets simultaneously Oct 11, 2024
@mordamax mordamax enabled auto-merge October 11, 2024 16:14

To regenerate all weights (however it will take long,
so don't do it unless you really need it), run the following command:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a great doc, is it properly linked and discover-able from the main CONTRIBUTING.md?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep, there is a general link to /cmd commands-readme and from there to here

@mordamax mordamax added this pull request to the merge queue Oct 11, 2024
Merged via the queue into master with commit c0b7343 Oct 11, 2024
@mordamax mordamax deleted the mak-flip-cmd-flag branch October 11, 2024 17:52
ordian added a commit that referenced this pull request Oct 14, 2024
* master:
  Fix storage expansion in pallet section (#6023)
  /cmd: Improved devx of benching many pallets simultaneously (#6007)
Zebedeusz pushed a commit that referenced this pull request Oct 14, 2024
### Improved devx of running many pallets simultaneously

Changes to /cmd:
- Replace (flip) `--continue-on-fail` with `--fail-fast`, but only for
`bench`. This makes all pallets/runtimes run non-stop by default, as it
was primary use-case during tests
- The list of successful/failed pallets was hard to find within tons of
logs, so decided to write only needed logs in a file, and output as a
summary in the workflow and in the comment
- Side fix: updated `tasks_example` to `pallet_example_tasks` to make
compliant with standard naming

<img width="1006" alt="image"
src="https://github.com/user-attachments/assets/14896041-7018-4a0d-92b7-4508e81913c2">

+ added command results to workflow summary:
<img width="1275" alt="image"
src="https://github.com/user-attachments/assets/b4a8afdb-dc9f-4ff9-9720-28a88956035f">

---------

Co-authored-by: GitHub Action <action@github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

R0-no-crate-publish-required The change does not require any crates to be re-published.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants