Setup air speed velocity for micro benchmarks

[aktech]

As discussed in the developer call it would be good to have some kind of benchmarking. Air speed velocity is a good tool for micro benchmarks: https://asv.readthedocs.io/en/stable/ as suggested.

Setting this up and throwing the artefacts somewhere will enable us to see the benchmarks over time like this:
https://pv.github.io/numpy-bench/

cc @jeromekelleher

[jeromekelleher]

See also #68 - should we mark this issue as a dupe @hammer, or keep it as more specific?

[tomwhite]

Reopening, as the benchmark suite has not had a successful run yet.

[aktech]

This is quite weird, this works on my personal and organization accounts:

https://github.com/AktechLabs/sgkit/runs/2111770945?check_suite_focus=true
https://github.com/aktech/sgkit/runs/2039205063?check_suite_focus=true

@hammer Can you confirm the following.

1. This is how the access token scope looks like:

2. You added the token named GH_TOKEN, in this (pystatgen/sgkit) repository.
3. You have push access to pystatgen/sgkit-benchmarks-asv repository.

[hammer]

I added it to the pystatgen/sgkit-benchmarks-asv repo. Is that not right?

[aktech]

I added it to the pystatgen/sgkit-benchmarks-asv repo. Is that not right?

Oh, I see. The token needs to be in this repo: pystatgen/sgkit
Apologies, the instructions I sent probably did not stated the repo name explicitly.

[hammer]

Okay, try now?

[aktech]

I don't have the access to rerun a workflow. Can one of you rerun this workflow?
https://github.com/pystatgen/sgkit/runs/2114712818

[jeromekelleher]

I just reran it @aktech, can you have a look and see if it succeeded?

[aktech]

Yes, it did succeed. Thanks @hammer and @jeromekelleher

Now, there is one last thing that needs to be done for the benchmarks to be visible on the Github pages on this link: http://pystatgen.github.io/sgkit-benchmarks-asv/

1. Go to https://github.com/pystatgen/sgkit-benchmarks-asv/settings
2. In the Github Pages section, select the source branch to be main and
3. Check the Enforce HTTPS button

This is how the Github Pages section would look like, after the above steps:

[jeromekelleher]

Done! Thanks for the guide @aktech

[jeromekelleher]

@tomwhite, I guess we should confirm a few uploads of benchmarks before closing?

[aktech]

Thanks! the benchmarks are live now: https://pystatgen.github.io/sgkit-benchmarks-asv/

[tomwhite]

Looks good. Thanks for doing this @aktech. Would it be possible to add a badge to the README with a link to the benchmarks?

[aktech]

Looks good. Thanks for doing this @aktech. Would it be possible to add a badge to the README with a link to the benchmarks?

Yeah, sure.

Can someone add this link: https://pystatgen.github.io/sgkit-benchmarks-asv/
In the about section of https://github.com/pystatgen/sgkit-benchmarks-asv as well

[hammer]

Can someone add this link: https://pystatgen.github.io/sgkit-benchmarks-asv/
In the about section of https://github.com/pystatgen/sgkit-benchmarks-asv as well

Done!

[hammer]

Closing this issue as discussed on the call today. Thanks @aktech!