Skip to content

Local blocks processor honor per-tenant max trace size#3305

Merged
mdisibio merged 6 commits intografana:mainfrom
mdisibio:generator-max-trace-size
Jan 17, 2024
Merged

Local blocks processor honor per-tenant max trace size#3305
mdisibio merged 6 commits intografana:mainfrom
mdisibio:generator-max-trace-size

Conversation

@mdisibio
Copy link
Copy Markdown
Contributor

@mdisibio mdisibio commented Jan 17, 2024

What this PR does:
Updates the local-blocks processor to honor the per-tenant override max_trace_bytes. The generators already make use of the per-tenant overrides but this field. This goes one step further than the trace size limits in the ingesters. The ingesters keep track of the historical trace size only for the lifetime of the headblock, and that means long-running traces can eventually append more data. This goes one step further and maintains the historical trace size for as long as the trace is active (continues to send spans).

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Copy link
Copy Markdown
Contributor

@zalegrala zalegrala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple comments, but overall looks reasonable to me.

Comment thread modules/generator/processor/localblocks/traceSizes.go Outdated
Comment thread modules/generator/processor/localblocks/livetraces.go Outdated
@mdisibio mdisibio marked this pull request as ready for review January 17, 2024 17:41
Copy link
Copy Markdown
Contributor

@zalegrala zalegrala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@mdisibio mdisibio merged commit e96c371 into grafana:main Jan 17, 2024
mdisibio added a commit to mdisibio/tempo that referenced this pull request Jan 22, 2024
* Keep track of trace sizes for the lifetime of the headblock, add metrics

* lint

* Comment

* Fix invalid assumption that all batches have the same trace id. Undo variable name change, review comments

* changelog
@mdisibio mdisibio mentioned this pull request Jan 22, 2024
3 tasks
mdisibio added a commit that referenced this pull request Jan 22, 2024
* Keep track of trace sizes for the lifetime of the headblock, add metrics

* lint

* Comment

* Fix invalid assumption that all batches have the same trace id. Undo variable name change, review comments

* changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants