Releases: CodSpeedHQ/pytest-codspeed
v4.0.0
What's Changed
This release introduces profiling to the walltime instrument and includes several key improvements to the existing benchmark fixture API! 🎉
Warning
Since we're now using CodSpeedHQ/instrument-hooks to control the instrument state, the performance may slightly change in tiny microbenchmarks when upgrading.
🚀 Features
- Support perf profiling in Python walltime instrument by @not-matthias in #79
- Support pytest-benchmark marker attributes by @art049 in #80
- Support the pedantic API by @art049 in #81
New Contributors
- @not-matthias made their first contribution in #79
Full Changelog: v3.2.0...v4.0.0
Contributors
Assets 2
v3.2.0
What's Changed
This release improves the reliability of the measurement, primarily focusing on the wall-time instrument.
🚀 Features
-
Increase the min round time to a bigger value (+/- 1ms) by @art049
-
Fix the random seed while measuring with instruments by @art049 in #48
🐛 Bug Fixes
- Use time per iteration instead of total round time in stats by @art049
🏗️ Refactor
⚙️ Internals
- Fix self-dependency by @adriencaccia in #66
- Fix uv version in CI by @adriencaccia
- Add benchmarks-walltime job to run additional performance benchmarks by @art049 in #65
Full Changelog: v3.1.2...v3.2.0
Contributors
Assets 2
v3.1.2
Contributors
Assets 2
v3.1.1
Contributors
Assets 2
v3.1.0
Contributors
Assets 2
v3.0.0
What's Changed
This new release includes a new wall time instrument that allows measurement of real execution timings. This will be very useful for macro benchmarks running on properly isolated machines. You can now use our CodSpeed Macro runners without changing anything to your existing CI workflows.
Find more info on our Walltime instrument here.
Breaking changes
- Dropped support for Python 3.8 since it reached its EOL
Features
- feat: add walltime clock benchmarking by @art049 in #41
- feat/add max time and quartiles by @art049 in #45
- feat: also save the lower and upper fences in the json data by @art049 in #46
Fixes
- fix: pytest-benchmark 5.0.0 compatibility by @art049 in #54
- fix: don't override pytest's default protocol by @kenodegard in #32
Internals
- chore: Add TCH, FA, and UP lints by @kenodegard in #29
- Expose type information by @Dreamsorcerer in #53
- ci: bump actions/checkout to v4 by @fargito in #47
- chore: support python 3.13 and drop 3.7 by @art049 in #40
- feat: use a true semver version by @art049 in #44
- test: add benches for TheAlgorithms/backtracking by @art049 in #43
- test: add benches for TheAlgorithms/audio_filters by @art049 in #42
- docs(readme): update action version in the CI workflow configuration by @frgfm in #39
New Contributors
- @kenodegard made their first contribution in #29
- @frgfm made their first contribution in #39
- @fargito made their first contribution in #47
- @Dreamsorcerer made their first contribution in #53
Full Changelog: v2.2.1...v3.0.0
Contributors
Assets 2
v2.2.1
What's Changed
- fix: Loosen runtime requirements by @edgarrmondragon in #21
- fix: support pytest 8.1.1 by @art049 in #28
New Contributors
- @edgarrmondragon made their first contribution in #21
Full Changelog: v2.2.0...v2.2.1
Contributors
Assets 2
v2.2.0
What's Changed
pytest-xdist is now fully supported. Thus if you have a lot of benches, you can totally leverage xdist test distribution (on the same CPU) to speed up benchmark execution.
Details
Full Changelog: v2.1.0...v2.2.0
Contributors
Assets 2
v2.1.0
art049
Arthur Pastel
a752fb9
art049
Arthur Pastel
What's Changed
Relative paths are now properly handled when using the working-directory action parameter.
Details
Internals
Full Changelog: v2.0.1...v2.1.0
Contributors
Assets 2
v2.0.1
What's Changed
Added
- Added support for returning values by @patrick91 in #12
- Add a return type to the benchmark fixture by @art049 in #13
New Contributors
- @patrick91 made their first contribution in #12
Full Changelog: v2.0.0...v2.0.1
