Add support for scope in cost-attribution usage tracker

[electron0zero]

What this PR does:

Add support for scopes in the cost attribution dimensions attribute matching for cost attribution usage tracker.

Users can now configure dimensions with resource. or span. to only look for the attribute at span or resource level.

With scoped configuration, you can configure tempo to look for values the requested scope and avoid unwanted overwrite from span attributes when the same attribute exists at both resource and span levels.

This change is backwards compatible, and if you need to look at both resource and span scope, you can keep using upscoped attribute in the configuration and it will work as it used to work before this change.

please refer to updated documentation to see more details.

note for reviewers: CHANGELOG.md has few formatting fixes where extra whitespace is cleaned up by my IDE, you can clean the diff with Hide whitespace changes in the diff view.

Benchmarks

Micro benchmarks show almost no change in perf and allocations.

BenchmarkUsageTrackerCollect

$ benchstat Collect-main.txt Collect-branch.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
                       │ Collect-main.txt │         Collect-branch.txt         │
                       │      sec/op      │   sec/op     vs base               │
UsageTrackerCollect-11        8.460µ ± 1%   8.591µ ± 1%  +1.55% (p=0.000 n=10)

                       │ Collect-main.txt │         Collect-branch.txt          │
                       │       B/op       │     B/op      vs base               │
UsageTrackerCollect-11       34.04Ki ± 0%   34.05Ki ± 0%  +0.03% (p=0.030 n=10)

                       │ Collect-main.txt │       Collect-branch.txt       │
                       │    allocs/op     │ allocs/op   vs base            │
UsageTrackerCollect-11         46.00 ± 0%   46.00 ± 0%  ~ (p=1.000 n=10) ¹
¹ all samples are equal

$ cat Collect-main.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
BenchmarkUsageTrackerCollect-11    	 1428439	      8405 ns/op	   34870 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1416528	      8480 ns/op	   34866 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1407066	      8540 ns/op	   34860 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1413918	      8407 ns/op	   34859 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1429488	      8431 ns/op	   34855 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1422626	      8499 ns/op	   34854 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1412239	      8436 ns/op	   34853 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1429485	      8440 ns/op	   34850 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1420756	      8496 ns/op	   34851 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1408904	      8508 ns/op	   34849 B/op	      46 allocs/op
PASS
ok  	github.com/grafana/tempo/modules/distributor/usage	205.960s

$ cat Collect-branch.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
BenchmarkUsageTrackerCollect-11    	 1409739	      8464 ns/op	   34872 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1410174	      8586 ns/op	   34870 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1388434	      8578 ns/op	   34868 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1390281	      8633 ns/op	   34869 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1384576	      8658 ns/op	   34867 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1380625	      8768 ns/op	   34865 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1391090	      8682 ns/op	   34861 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1395918	      8592 ns/op	   34858 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1399555	      8590 ns/op	   34854 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1397942	      8504 ns/op	   34855 B/op	      46 allocs/op
PASS
ok  	github.com/grafana/tempo/modules/distributor/usage	207.362s

BenchmarkUsageTrackerObserve

$ benchstat Collect-main.txt Collect-branch.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
                       │ Observe-main.txt │       Observe-branch.txt       │
                       │      sec/op      │    sec/op     vs base          │
UsageTrackerObserve-11       5.548µ ± 18%   5.914µ ± 21%  ~ (p=0.529 n=10)

                       │ Observe-main.txt │       Observe-branch.txt       │
                       │       B/op       │    B/op     vs base            │
UsageTrackerObserve-11         0.000 ± 0%   0.000 ± 0%  ~ (p=1.000 n=10) ¹
¹ all samples are equal

                       │ Observe-main.txt │       Observe-branch.txt       │
                       │    allocs/op     │ allocs/op   vs base            │
UsageTrackerObserve-11         0.000 ± 0%   0.000 ± 0%  ~ (p=1.000 n=10) ¹
¹ all samples are equal

$ cat Collect-main.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
BenchmarkUsageTrackerCollect-11    	 1428439	      8405 ns/op	   34870 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1416528	      8480 ns/op	   34866 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1407066	      8540 ns/op	   34860 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1413918	      8407 ns/op	   34859 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1429488	      8431 ns/op	   34855 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1422626	      8499 ns/op	   34854 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1412239	      8436 ns/op	   34853 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1429485	      8440 ns/op	   34850 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1420756	      8496 ns/op	   34851 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1408904	      8508 ns/op	   34849 B/op	      46 allocs/op
PASS
ok  	github.com/grafana/tempo/modules/distributor/usage	205.960s

$ cat Collect-branch.txt
goos: darwin
goarch: arm64
pkg: github.com/grafana/tempo/modules/distributor/usage
cpu: Apple M3 Pro
BenchmarkUsageTrackerCollect-11    	 1409739	      8464 ns/op	   34872 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1410174	      8586 ns/op	   34870 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1388434	      8578 ns/op	   34868 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1390281	      8633 ns/op	   34869 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1384576	      8658 ns/op	   34867 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1380625	      8768 ns/op	   34865 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1391090	      8682 ns/op	   34861 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1395918	      8592 ns/op	   34858 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1399555	      8590 ns/op	   34854 B/op	      46 allocs/op
BenchmarkUsageTrackerCollect-11    	 1397942	      8504 ns/op	   34855 B/op	      46 allocs/op
PASS
ok  	github.com/grafana/tempo/modules/distributor/usage	207.362s

Which issue(s) this PR fixes:
Fixes #

Checklist

• Tests updated
• Documentation added
• CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

[knylander-grafana]

Thank you for updating the docs. I have a few minor suggestions to bring your doc in line with our style guide. Overall, great job! I'm going to approve the PR since I'm out of town and don't want to block your work.