Skip to content

Stream-querying Ingester v2 hits message size limits #2945

Closed
@pstibrany

Description

@pstibrany

v2QueryStream method of Ingester can produce messages that are still too be to be sent over gRPC. Right now its logic is to send batches of 128 time series, but if timeseries contain many samples (eg. when asking for large time range), it may still hit gRPC message size limit.

With 6 samples/minute, over 12h time that is 4000+ samples for single timeseries. If we batch 128 of them, that is 500k + samples in single batch.

Batching in v2QueryStream ingester could be a little smarter to avoid hitting the limit.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions