invalid span context noisy logging

[macfarla]

Can this log line be moved to TRACE - it's very noisy at DEBUG level

{"@timestamp":"2024-01-22T01:16:50,003","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}

{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce532","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce533","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,008","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce534","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,009","level":"DEBUG","thread":"vert.x-worker-thread-11","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac67",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce535","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"vert.x-worker-thread-18","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac68",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,010","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce536","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce537","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,011","level":"DEBUG","thread":"vert.x-worker-thread-3","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac69",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,012","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,012","level":"DEBUG","thread":"vert.x-worker-thread-7","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac6a",false]","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,013","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce538","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,013","level":"DEBUG","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionLogBloomCacher","message":"Caching logs bloom for block 0x3ce539","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,014","level":"DEBUG","thread":"vert.x-eventloop-thread-1","class":"B3PropagatorExtractorMultipleHeaders","message":"Invalid TraceId in B3 header: null'. Returning INVALID span context.","throwable":""}
{"@timestamp":"2024-01-22T01:16:50,014","level":"DEBUG","thread":"vert.x-worker-thread-4","class":"JsonRpcExecutor","message":"JSON-RPC request -> eth_getBlockByNumber ["0x2cac6b",false]","throwable":""}

maybe some context here #3184

[macfarla]

workaround to turn it down -

curl -X POST --data '{"jsonrpc":"2.0", "method":"admin_changeLogLevel", "params":["INFO", ["io.opentelemetry.extension.trace.propagation"]], "id":1}' http://127.0.0.1:8545

[macfarla]

FYI #6422 (comment) still happening even with otel upgrade