Skip to content

Conversation

@gianm
Copy link
Contributor

@gianm gianm commented Nov 29, 2025

Include the first failure message in the task status itself, so it is not necessary to fetch task logs to see the error message.

Also, don't log the entire task JSON for failed subtasks. It is logged once when a subtask is initially run, and that's enough.

Include the first failure message in the task status itself, so it is
not necessary to fetch task logs to see the error message.

Also, don't log the entire task JSON for failed subtasks. It is logged
once when a subtask is initially run, and that's enough.
@github-actions github-actions bot added Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Nov 29, 2025
Copy link
Contributor

@kfaraz kfaraz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

final TaskStatus eachResult = eachTask.run(toolbox);
if (!eachResult.isSuccess()) {
if (task.isReady(toolbox.getTaskActionClient())) {
log.info("Running MSQControllerTask[%d]: %s", taskCnt, json);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: It seems kind of weird that the MSQControllerTask[%d] is not the the task id but the taskcnt.
Should be rename this to something like
"Running MSQCompaction task number[%d] with payload : %s"

if (!taskStatus.isSuccess()) {
failCnt++;
log.warn("Failed to run MSQControllerTask: [%s].\nTrying the next MSQControllerTask.", json);
log.warn("Failed to run MSQControllerTask[%d]: %s", taskCnt, taskStatus.getErrorMsg());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar task number comment here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants