You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If an empty mapping is specified for overrides (i.e. overrides: {}) in overrides.yaml, automatic stream sharding is wrongly disabled.
Jsonnet deployment (production/ksonnet/loki) generates such manifest by default.
If -limits.per-user-override-config is not passed to distributors or overrides is null or is not specified, automatic stream sharding is enabled by default as specified in limits_config.shard_streams.enabled.
To Reproduce
Started Loki (I'm using v3.4.2) with -limits.per-user-override-config=overrides.yaml, where overrides.yaml contains overrides: {}
Check the distributors' metrics. loki_rate_store_max_stream_rate_bytes, which has meaningful value and is updated by time if automatic stream sharding is enabled, is always zero.
Modify overrides.yaml. overrides: null
Check the distributors' metrics. loki_rate_store_max_stream_rate_bytes is now updated.
Modify overrides.yaml. Delete overrides field.
Check the distributors' metrics. loki_rate_store_max_stream_rate_bytes is still updated.
restart the distributors without setting -limits.per-user-override-config
Check the distributors' metrics. loki_rate_store_max_stream_rate_bytes is updated too.
Expected behavior
Automatic stream sharding is still enabled.
anyShardingEnabled() function, which checks sharding is enabled for any of tenant, does not seem to check the default setting in limits_config if some overrides are written. However, even if some override configs are written for some tenants, other tenants still use the default settings. So, the default setting in limits_config MUST be always checked.
Environment:
Loki version: v3.4.2
Infrastructure: Kubernetes
Deployment tool: jsonnet
Deployment mode: microservice (distributed)
Screenshots, Promtail config, or terminal output
(none)
The text was updated successfully, but these errors were encountered:
Describe the bug
If an empty mapping is specified for
overrides
(i.e.overrides: {}
) in overrides.yaml, automatic stream sharding is wrongly disabled.Jsonnet deployment (production/ksonnet/loki) generates such manifest by default.
If
-limits.per-user-override-config
is not passed to distributors oroverrides
isnull
or is not specified, automatic stream sharding is enabled by default as specified inlimits_config.shard_streams.enabled
.To Reproduce
-limits.per-user-override-config=overrides.yaml
, where overrides.yaml containsoverrides: {}
loki_rate_store_max_stream_rate_bytes
, which has meaningful value and is updated by time if automatic stream sharding is enabled, is always zero.overrides: null
loki_rate_store_max_stream_rate_bytes
is now updated.overrides
field.loki_rate_store_max_stream_rate_bytes
is still updated.-limits.per-user-override-config
loki_rate_store_max_stream_rate_bytes
is updated too.Expected behavior
Automatic stream sharding is still enabled.
anyShardingEnabled()
function, which checks sharding is enabled for any of tenant, does not seem to check the default setting inlimits_config
if some overrides are written. However, even if some override configs are written for some tenants, other tenants still use the default settings. So, the default setting inlimits_config
MUST be always checked.Environment:
Screenshots, Promtail config, or terminal output
(none)
The text was updated successfully, but these errors were encountered: