Skip to content

feat: handle multiple grpc deletes#2150

Merged
MichaelScofield merged 5 commits intoGreptimeTeam:developfrom
NiwakaDev:feat/handle_multiple_delete_request
Aug 15, 2023
Merged

feat: handle multiple grpc deletes#2150
MichaelScofield merged 5 commits intoGreptimeTeam:developfrom
NiwakaDev:feat/handle_multiple_delete_request

Conversation

@NiwakaDev
Copy link
Copy Markdown
Collaborator

I hereby agree to the terms of the GreptimeDB CLA

What's changed and what's your intention?

This PR allows greptimedb to handle multiple grpc deletes.

Checklist

  • I have written the necessary rustdoc comments.
  • I have added the necessary unit tests and integration tests.

Refer to a related PR or issue link (optional)

close #1708

@codecov
Copy link
Copy Markdown

codecov Bot commented Aug 11, 2023

Codecov Report

Merging #2150 (79d41df) into develop (d4565c0) will decrease coverage by 0.32%.
The diff coverage is 97.36%.

@@             Coverage Diff             @@
##           develop    #2150      +/-   ##
===========================================
- Coverage    84.58%   84.27%   -0.32%     
===========================================
  Files          698      699       +1     
  Lines       111745   112006     +261     
===========================================
- Hits         94519    94389     -130     
- Misses       17226    17617     +391     

@NiwakaDev
Copy link
Copy Markdown
Collaborator Author

NiwakaDev commented Aug 11, 2023

It seems like CI / Sqlness Test (windows-latest) fails consistently:

Going to build the DB...
thread 'main' panicked at tests\runner\src\env.rs:319:13:
Failed to build GreptimeDB (`cargo build` fails)
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: process didn't exit successfully: `target\debug\sqlness-runner.exe` (exit code: 101)
Error: Process completed with exit code 1.

@MichaelScofield
Copy link
Copy Markdown
Collaborator

@NiwakaDev I've made the cargo build in sqlness prints the output if it fails in #2152 . After that PR is merged, plz rebase your code and see how the ci fails

@NiwakaDev NiwakaDev force-pushed the feat/handle_multiple_delete_request branch 2 times, most recently from 4409ce8 to 2b0dcfe Compare August 11, 2023 06:06
@MichaelScofield
Copy link
Copy Markdown
Collaborator

@NiwakaDev disk is full. plz wait for #2158

@NiwakaDev NiwakaDev force-pushed the feat/handle_multiple_delete_request branch 3 times, most recently from 9e9c40a to ef8193e Compare August 14, 2023 04:39
Comment thread src/frontend/src/error.rs Outdated
Comment thread src/partition/src/manager.rs Outdated
Copy link
Copy Markdown
Member

@killme2008 killme2008 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Almost LGTM

Comment thread src/frontend/src/instance/distributed.rs
@NiwakaDev NiwakaDev force-pushed the feat/handle_multiple_delete_request branch from 2c90952 to 490cb51 Compare August 14, 2023 16:27
Copy link
Copy Markdown
Collaborator

@MichaelScofield MichaelScofield left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Please resolve the conflicts so I can merge it.

@NiwakaDev NiwakaDev force-pushed the feat/handle_multiple_delete_request branch from 490cb51 to 79d41df Compare August 15, 2023 07:49
@NiwakaDev
Copy link
Copy Markdown
Collaborator Author

@MichaelScofield

Please resolve the conflicts so I can merge it.

I resolved them.

@MichaelScofield MichaelScofield added this pull request to the merge queue Aug 15, 2023
@MichaelScofield
Copy link
Copy Markdown
Collaborator

@NiwakaDev thx!

Merged via the queue into GreptimeTeam:develop with commit a8f2e44 Aug 15, 2023
MichaelScofield pushed a commit to MichaelScofield/greptimedb that referenced this pull request Aug 16, 2023
* feat: handle multiple grpc deletes (GreptimeTeam#2150)

* feat: handle multiple grpc deletes

* fix: make DistDeleter::grpc_delete return usize

* fix: remove backtrace from MissingTimeIndexColumn

* fix: avoid using unwrap in PartitionRuleManager::split_delete_request

* fix: simplify MissingTimeIndexColumn

* refactor: improve the image building performance (GreptimeTeam#2175)

* refactor: use '--output type=local' in 'build-greptime-by-buildx' target to reduce unnecessary 'docker cp'"

Signed-off-by: zyy17 <zyylsxm@gmail.com>

* refactor: improve the image building performance

* ci: release centos dev builder

* ci: use 'make build-by-dev-builder' to improve docker build performance

* refactor: add 'which' command in centos

* fix: add 'OUTPUT_DIR' to fix 'make docker-image-buildx' error

* fix: fix incorrect dockerfile path

Signed-off-by: zyy17 <zyylsxm@gmail.com>

* refactor: remove configure-aws-credentials action and use env variables

Signed-off-by: zyy17 <zyylsxm@gmail.com>

* ci: update slack notification prompt

* refactor: clean up the target directory before building artifacts of centos7

---------

Signed-off-by: zyy17 <zyylsxm@gmail.com>

* docs: rfc of update metadata in single txn (GreptimeTeam#2165)

* docs: rfc of update metadata in single txn

* chore: apply suggestion from CR

* feat: grpc handler result (GreptimeTeam#2107)

* feat: grpc handler inner result

* feat: ext header, x-greptime-err-code, x-greptime-err-msg

* fix: sqlness case

* chore: by comment

* fix: convert status to Error

* chore: minor `auth` crate change (GreptimeTeam#2176)

* chore: pub auth_mysql

* chore: pub all error

* chore: remove back to error

* chore: wrap failed permission check result to err

* chore: minor change

* feat: don't enable telemetry for debug building (GreptimeTeam#2177)

---------

Signed-off-by: zyy17 <zyylsxm@gmail.com>
Co-authored-by: Niwaka <61189782+NiwakaDev@users.noreply.github.com>
Co-authored-by: zyy17 <zyylsxm@gmail.com>
Co-authored-by: Weny Xu <wenymedia@gmail.com>
Co-authored-by: JeremyHi <jiachun_feng@proton.me>
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>
Co-authored-by: dennis zhuang <killme2008@gmail.com>
paomian pushed a commit to paomian/greptimedb that referenced this pull request Oct 19, 2023
* feat: handle multiple grpc deletes

* fix: make DistDeleter::grpc_delete return usize

* fix: remove backtrace from MissingTimeIndexColumn

* fix: avoid using unwrap in PartitionRuleManager::split_delete_request

* fix: simplify MissingTimeIndexColumn
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Optimize distributed deletions from gRPC

3 participants