Skip to content

Ability to flush chunks with stale markers early. #1759

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Oct 31, 2019

Conversation

gouthamve
Copy link
Contributor

Signed-off-by: Goutham Veeramachaneni [email protected]

@gouthamve gouthamve force-pushed the flush-stale-chunks-early branch from 9562f8c to 2dcd68e Compare October 25, 2019 06:00
@gouthamve gouthamve force-pushed the flush-stale-chunks-early branch 2 times, most recently from 4f12eb8 to 5c84f37 Compare October 25, 2019 13:54
@gouthamve
Copy link
Contributor Author

@bboreham Using the lastSampleValue from memorySeries now, nice catch! Also added this to the docs.

Copy link
Contributor

@jtlisi jtlisi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

The StaleNaN values in Prom is very clever

Copy link
Contributor

@pracucci pracucci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job! I left few minor comments

Signed-off-by: Goutham Veeramachaneni <[email protected]>
@gouthamve gouthamve force-pushed the flush-stale-chunks-early branch from 93f1a54 to 2568855 Compare October 31, 2019 18:43
@gouthamve gouthamve merged commit f2d1405 into cortexproject:master Oct 31, 2019
@gouthamve gouthamve deleted the flush-stale-chunks-early branch October 31, 2019 18:55
@@ -138,6 +139,7 @@ func (cfg *Config) RegisterFlags(f *flag.FlagSet) {
f.DurationVar(&cfg.RetainPeriod, "ingester.retain-period", 5*time.Minute, "Period chunks will remain in memory after flushing.")
f.DurationVar(&cfg.FlushOpTimeout, "ingester.flush-op-timeout", 1*time.Minute, "Timeout for individual flush operations.")
f.DurationVar(&cfg.MaxChunkIdle, "ingester.max-chunk-idle", 5*time.Minute, "Maximum chunk idle time before flushing.")
f.DurationVar(&cfg.MaxChunkIdle, "ingester.max-stale-chunk-idle", 0, "Maximum chunk idle time for chunks terminating in stale markers before flushing. 0 disables it and a stale series is not flushed until the max-chunk-idle timeout is reached.")
Copy link
Contributor

@bboreham bboreham Nov 5, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oops - typo MaxChunkIdle #1788

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants