Skip to content

24-3-15-hotfix: Preliminary fix for erase cache consistency problems#13948

Merged
snaury merged 1 commit intoydb-platform:stable-24-3-15-hotfixfrom
snaury:bugfix-KIKIMR-22506-volatile-erase-cache-24-3-15-hotfix
Jan 29, 2025
Merged

24-3-15-hotfix: Preliminary fix for erase cache consistency problems#13948
snaury merged 1 commit intoydb-platform:stable-24-3-15-hotfixfrom
snaury:bugfix-KIKIMR-22506-volatile-erase-cache-24-3-15-hotfix

Conversation

@snaury
Copy link
Member

@snaury snaury commented Jan 29, 2025

Changelog entry

Fixed consistency issues related to caching deleted ranges.

Changelog category

  • Bugfix

Additional information

Several issues have been identified using a new jepsen workload that produces and tests deleted rows. The root cause is due to datashard transaction map remapping already committed or rolled back transactions to different committed versions, which doesn't affect correctness when replying to requests (datashards use transaction observers to filter inconsistent results), but confuses LocalDB when it uses these remapped versions for caching.

This temporary fix avoids caching over uncompacted deltas so it's easier to backport.

Fixes KIKIMR-22506.

@snaury snaury self-assigned this Jan 29, 2025
@github-actions
Copy link

github-actions bot commented Jan 29, 2025

2025-01-29 08:16:48 UTC Pre-commit check for d98ede4 has started.
2025-01-29 08:19:48 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2025-01-29 09:05:05 UTC Build successful.
2025-01-29 09:05:19 UTC Tests are running...
🔴 2025-01-29 10:54:26 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40297 35020 0 18 5219 40

🟢 2025-01-29 10:55:24 UTC ydbd size 8.3 GiB changed* by -119.5 KiB, which is <= 0 Bytes vs stable-24-3-15-hotfix: OK

ydbd size dash stable-24-3-15-hotfix: 55a593f merge: d98ede4 diff diff %
ydbd size 8 874 182 808 Bytes 8 874 060 400 Bytes -119.5 KiB -0.001%
ydbd stripped size 484 292 680 Bytes 484 288 520 Bytes -4.1 KiB -0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Jan 29, 2025

2025-01-29 08:16:57 UTC Pre-commit check for d98ede4 has started.
2025-01-29 08:19:54 UTC Build linux-x86_64-release-asan is running...
🟢 2025-01-29 08:45:18 UTC Build successful.
2025-01-29 08:45:36 UTC Tests are running...
🔴 2025-01-29 11:01:55 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11724 11611 0 35 33 45

🟢 2025-01-29 11:03:01 UTC ydbd size 5.6 GiB changed* by -30.8 KiB, which is <= 0 Bytes vs stable-24-3-15-hotfix: OK

ydbd size dash stable-24-3-15-hotfix: d0b724a merge: d98ede4 diff diff %
ydbd size 6 002 428 592 Bytes 6 002 397 072 Bytes -30.8 KiB -0.001%
ydbd stripped size 1 504 203 872 Bytes 1 504 203 808 Bytes -64 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@snaury snaury marked this pull request as ready for review January 29, 2025 08:24
@snaury snaury requested a review from a team as a code owner January 29, 2025 08:24
@snaury snaury merged commit 3eb61c8 into ydb-platform:stable-24-3-15-hotfix Jan 29, 2025
4 of 8 checks passed
@snaury snaury deleted the bugfix-KIKIMR-22506-volatile-erase-cache-24-3-15-hotfix branch January 29, 2025 11:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants