Skip to content

ci: Exclude HTTP 5xx metrics from comparisons#7671

Merged
yurishkuro merged 4 commits intojaegertracing:mainfrom
neoandmatrix:flaky-metrics
Dec 17, 2025
Merged

ci: Exclude HTTP 5xx metrics from comparisons#7671
yurishkuro merged 4 commits intojaegertracing:mainfrom
neoandmatrix:flaky-metrics

Conversation

@neoandmatrix
Copy link
Copy Markdown
Contributor

Which problem is this PR solving?

Description of the changes

  • This PR introduces the changes to filter out 503 calls to reduce the flakiness in the metrics comparision.

How was this change tested?

Before changes
image

After changes
image

Checklist

Signed-off-by: Tushar Anand <tusharannand@gmail.com>
@neoandmatrix neoandmatrix requested a review from a team as a code owner November 27, 2025 17:12
@dosubot dosubot bot added the enhancement label Nov 27, 2025
@neoandmatrix neoandmatrix changed the title chore: exclusion of metrics added ci: exclusion of metrics added Nov 27, 2025
Signed-off-by: Tushar Anand <tusharannand@gmail.com>
@codecov
Copy link
Copy Markdown

codecov bot commented Nov 27, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 95.56%. Comparing base (72eca6e) to head (27d28b6).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #7671   +/-   ##
=======================================
  Coverage   95.56%   95.56%           
=======================================
  Files         307      307           
  Lines       15399    15399           
=======================================
  Hits        14716    14716           
  Misses        536      536           
  Partials      147      147           
Flag Coverage Δ
badger_v1 9.73% <ø> (ø)
badger_v2 2.03% <ø> (ø)
cassandra-4.x-v1-manual 14.09% <ø> (ø)
cassandra-4.x-v2-auto 2.02% <ø> (ø)
cassandra-4.x-v2-manual 2.02% <ø> (ø)
cassandra-5.x-v1-manual 14.09% <ø> (ø)
cassandra-5.x-v2-auto 2.02% <ø> (ø)
cassandra-5.x-v2-manual 2.02% <ø> (ø)
clickhouse 1.95% <ø> (ø)
elasticsearch-6.x-v1 18.60% <ø> (ø)
elasticsearch-7.x-v1 18.63% <ø> (ø)
elasticsearch-8.x-v1 18.79% <ø> (ø)
elasticsearch-8.x-v2 2.03% <ø> (ø)
elasticsearch-9.x-v2 2.03% <ø> (ø)
grpc_v1 9.61% <ø> (ø)
grpc_v2 2.03% <ø> (ø)
kafka-3.x-v2 2.03% <ø> (ø)
memory_v2 2.03% <ø> (ø)
opensearch-1.x-v1 18.68% <ø> (ø)
opensearch-2.x-v1 18.68% <ø> (ø)
opensearch-2.x-v2 2.03% <ø> (ø)
opensearch-3.x-v2 2.03% <ø> (ø)
query 2.03% <ø> (ø)
tailsampling-processor 0.59% <ø> (ø)
unittests 94.12% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Comment on lines +97 to +98
should_exclude= should_exclude_metric(sample.name, labels)
if should_exclude:
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
should_exclude= should_exclude_metric(sample.name, labels)
if should_exclude:
if should_exclude_metric(sample.name, labels):

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it would be good to count these exclusions in stats

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it would be good to count these exclusions in stats

Like the ones posted in PR, if some stats are excluded?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes (although I am not sure excluding full metrics is a good thing, per the other comment).

neoandmatrix and others added 2 commits December 17, 2025 13:14
Signed-off-by: Tushar Anand <tusharannand@gmail.com>
@yurishkuro yurishkuro changed the title ci: exclusion of metrics added ci: Exclude HTTP 5xx metrics from comparisons Dec 17, 2025
@yurishkuro yurishkuro added the changelog:ci Change related to continuous integration / testing label Dec 17, 2025
@yurishkuro
Copy link
Copy Markdown
Member

can we address this ? #7671 (comment)

@neoandmatrix
Copy link
Copy Markdown
Contributor Author

can we address this ? #7671 (comment)

Yes sure @yurishkuro , i would like to open another pr which will modify the necessary scripts that post the comment.

@yurishkuro
Copy link
Copy Markdown
Member

ok

@yurishkuro yurishkuro merged commit 65589aa into jaegertracing:main Dec 17, 2025
82 of 84 checks passed
yurishkuro pushed a commit that referenced this pull request Jan 7, 2026
## Which problem is this PR solving?
- Part of #7617 and [comment
](#7671 (comment))

## Description of the changes
- This PR introduces the changes in scripts to also include count of
exclusions in metrics if any.

## How was this change tested?
- I used the artifacts form
https://github.com/jaegertracing/jaeger/actions/runs/19589467818/job/56105108460
and
https://github.com/jaegertracing/jaeger/actions/runs/19596403385/job/56121587792?pr=7666
to manually test the changes. The outputs were as in the below
screenshots
<img width="665" height="425" alt="image"
src="https://github.com/user-attachments/assets/69a13af3-32d2-403e-b8a9-1fe33899202e"
/>

<img width="908" height="297" alt="image"
src="https://github.com/user-attachments/assets/eae2b3e0-ad63-41d2-ace5-a3e911a41858"
/>


## Checklist
- [x] I have read
https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
- [x] I have signed all commits
- [ ] I have added unit tests for the new functionality
- [x] I have run lint and test steps successfully
  - for `jaeger`: `make lint test`
  - for `jaeger-ui`: `npm run lint` and `npm run test`

---------

Signed-off-by: Tushar Anand <tusharannand@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog:ci Change related to continuous integration / testing enhancement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants