Skip to content

Backpressure for offline ETL processing #313

Closed
@planetchili

Description

@planetchili

Use condition variable to block processing thread, signal from output thread
Will automatically activate for offline processing only (always disabled for realtime trace)
CLI option (hidden) to override behavior and disable backpressure
Need to handle the corner case of the buffer filling with non-ready presents (in that case we need to not block and overflow presents, otherwise we will deadlock both threads).

Metadata

Metadata

Assignees

Labels

PresentDataRelates to the collection/analysis library (PresentData/)bugdev-centricFeatures and fixes related to improving dx, debugging, and diagnostics

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions