Skip to content

HDFS-11114. Support for running async disk checks in DataNode. #153

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from
Closed

Conversation

arp7
Copy link
Contributor

@arp7 arp7 commented Nov 7, 2016

Interface for running async checks on a resource.

The implementation ThrottledAsyncChecker supports throttling and result-caching. DataNode changes to use it will be done in another Jira.

Change-Id: Ib21cd21fe9b67ca35b38f8462c138e90b55f33df
*
* @throws InterruptedException
*/
void join(long timeout, TimeUnit timeUnit) throws InterruptedException;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just trying to understand this a little better, From the signature and implementation this function looks more a awaitTermination in executorService. That is this function will wait for a while and cancel and task if the timeout occurs, in that case would you consider calling this await or awaitTermination. Java "join" seems to imply a wait without timeouts. Just making sure that the intended was indeed a shutdown/await pattern.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking a look @anuengineer. The method covers both shutdown and awaitTermination semantics. I could call it shutdownAndAwaitTermination() to make it clearer.

Change-Id: I3b6dd71f2421b6703fc09b0f3491bd3e18bbf898
@arp7
Copy link
Contributor Author

arp7 commented Nov 7, 2016

Renamed it to shutdownAndWait.

Copy link
Contributor

@anuengineer anuengineer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, looks good to me. Thanks for providing this patch.

asfgit pushed a commit that referenced this pull request Nov 8, 2016
@asfgit asfgit closed this in 3fff158 Nov 8, 2016
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
…kController

Addresses the following:
* Makes LeaderElectionListener to be explicitly registered by the caller
* Removes debouncetimer dependency from ZkLeaderElector implementation
* [Bug] onBecomeLeader was scheduling a task in timer under "OnBecomeLeader", when it should actually be the same as "OnProcessorChange". Otherwise, it will not cancel when there is a new OnProcessorChange event.
* [Transient Test Failure] `TestScheduleAfterDebounceTime` tests were relying on timing controlled by sleep. Fixed it by using latch

Author: Navina Ramesh <[email protected]>

Reviewers: Xinyu Liu <[email protected]>, Boris Shkolnik <[email protected]>

Closes apache#153 from navina/SAMZA-1251
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
…bounceTimer

This PR depends on PR apache#153
* Treats all errors in jobcoordinator as FATAL and shuts-down the streamprocessor
* [Bug] Fixed bug reported in SAMZA-1241
* Introduced a callback to be associated with the timer (same callback for every Runnable failure)

**TBD**: some more unit tests

Author: Navina Ramesh <[email protected]>

Reviewers: Xinyu Liu <[email protected]>, Prateek Maheshwari <[email protected]>

Closes apache#166 from navina/SAMZA-1150
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants