Skip to content

Introduce L1ScoutingNanoAOD for Run3 #48163

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

patinkaew
Copy link
Contributor

PR description:

Please also note contributions from @gpetruc, @Mmiglio for initial and important components of L1ScoutingNano as well as L1Scouting team for numerous valuable feedbacks.

This PR introduces L1ScoutingNanoAOD workflow for Run3. For L1Scouting data, each processing event is actually an orbit (in OrbitCollection), different OutputModule is needed to convert orbits to bunch crossings (bx).

Some key features:

  • OrbitNanoAODOutputModule is analogous to NanoAODOutputModule and is used to convert orbits to bxs.
  • OrbitFlatTable is analogous to nanoaod::FlatTable and contains offsets of each bx in an orbit
  • SimpleOrbitFlatTableProducer is analogous to SimpleFlatTableProducer and has all functionalities of SimpleFlatTableProducer.

Two custom NanoAOD flavours are added: @L1Scout for ZeroBias stream and @L1ScoutSelect for Selection stream.

Event content files (html) can be found here on CERNBOX.

PR validation:

Pass all tests from scram b runtests use-ibeos.

Two relval_nano workflows are added for each flavour.
Pass these two workflows from runTheMatrix.py -l 2500.240,2500.241

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

This is not a backport.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 23, 2025

cms-bot internal usage

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48163/44934

@ftorrresd
Copy link
Contributor

enable nano

@ftorrresd
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-43d56f/46799/summary.html
COMMIT: fe95b32
CMSSW: CMSSW_15_1_X_2025-06-16-2300/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/48163/46799/install.sh to create a dev area with all the needed externals and cmssw changes.

This pull request cannot be automatically merged, could you please rebase it?
You can see the log for git cms-merge-topic here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-43d56f/46799/git-merge-result

@patinkaew
Copy link
Contributor Author

Hi @ftorrresd,

Sorry for a delay. I just fix the merge conflict.

Please note that the workflow numbers for L1ScoutingNano have changed (since BPHNano workflow in 140X was removed in master).

2500.239 L1Scouting2024RAW14.0+l1ScoutingNANO_data14.0 
2500.24 L1ScoutingSelection2024RAW14.0+l1ScoutingSelectionNANO_data14.0

Best,
Patin

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48163/45278

@@ -449,6 +461,8 @@ def subnext(self):
workflows[_wfn()] = ['lepTrackInfoNANOdata140Xrun3', ['MuonEG2024MINIAOD14.0', 'lepTrackInfoNANO_data14.0']]
workflows[_wfn()] = ['ScoutingNANOdata140Xrun3', ['ScoutingPFRun32024RAW14.0', 'scoutingNANO_data14.0']]
workflows[_wfn()] = ['ScoutingNANOwithPromptdata140Xrun3', ['ScoutingPFMonitor2024MINIAOD14.0', 'scoutingNANO_withPrompt_data14.0']]
workflows[_wfn()] = ['L1ScoutingNANOdata140Xrun3', ['L1Scouting2024RAW14.0', 'l1ScoutingNANO_data14.0']]
workflows[_wfn()] = ['L1ScoutingSelectionNANOdata140Xrun3', ['L1ScoutingSelection2024RAW14.0', 'l1ScoutingSelectionNANO_data14.0']]
Copy link
Contributor

@ftorrresd ftorrresd Jun 23, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like these two lines overflow the WF counter.

My naive suggestion for now would be to move the L1Scounting to a new series (2500.28x). I also leave it for the others to comment.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@patinkaew -- please, have a look at #48459

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ftorrresd thank you!
Sorry for a late reply, we had a discussion during L1Scouting Weekly today also and we are fine with moving to a new series. However, I think the new PR to extend the workflow numbers can work really well also. I will keep on eye on #48459 and once that is merged, I will rebase this PR.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 7, 2025

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48163/45425

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 7, 2025

Pull request #48163 was updated.

@patinkaew
Copy link
Contributor Author

patinkaew commented Jul 7, 2025

Hi @ftorrresd,

I saw #48459 was merged. I didn't see any merge conflict, but I just rebased to the latest IB release anyway.

The workflow numbers for L1ScoutingNano are now 2500.2309. 2500.231. I checked the event content of the output root files from these workflows again and they look reasonable.

We discussed this PR in the L1Scouting meeting last week and other people from L1Scouting are reviewing this. Once the reviewers give a green light, I will change this PR to be ready for review so we can merge soon.

Best regards,
Patin

@ftorrresd
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 7, 2025

+1

Size: This PR adds an extra 28KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-43d56f/47111/summary.html
COMMIT: a7823dc
CMSSW: CMSSW_15_1_X_2025-07-07-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/48163/47111/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 1 differences found in the comparisons
  • DQMHistoTests: Total files compared: 50
  • DQMHistoTests: Total histograms compared: 4067201
  • DQMHistoTests: Total failures: 38
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4067143
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
  • Checked 215 log files, 184 edm output root files, 50 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

Summary:

  • You potentially added 283 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 89100
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 89100
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
  • Checked 134 log files, 80 edm output root files, 22 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

  • Nano ERROR: Missing ref/2500.2309_L1ScoutingNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2309_L1ScoutingNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.231_L1ScoutingSelectionNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.231_L1ScoutingSelectionNANOdata140Xrun3-size.json
workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.118 3.118 0.000 ( +0.0% ) 3.75 3.71 +1.0% 2.634 2.681
NANOmc106Xul17v2 2500.0002 3.177 3.177 0.000 ( +0.0% ) 3.46 3.44 +0.7% 2.645 3.123
NANOmc106Xul18v2 2500.0003 3.128 3.128 0.000 ( +0.0% ) 3.53 3.50 +0.9% 2.663 3.105
NANOdata106Xul16v2 2500.0101 1.560 1.560 0.000 ( +0.0% ) 6.02 5.89 +2.2% 2.358 2.673
NANOdata106Xul17v2 2500.0102 1.948 1.948 0.000 ( +0.0% ) 4.08 4.06 +0.5% 2.390 2.844
NANOdata106Xul18v2 2500.0103 1.914 1.914 0.000 ( +0.0% ) 4.88 4.86 +0.4% 2.440 2.778
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.67 1.70 -1.9% 2.615 2.609
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.55 1.22 +26.3% 2.599 2.606
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.49 1.54 -2.7% 2.556 2.567
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.22 1.26 -3.6% 2.764 2.764
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.28 1.33 -3.6% 2.677 2.688
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.46 1.39 +4.9% 2.616 2.620
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.24 1.20 +3.7% 2.724 2.722
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.04 0.87 +19.5% 2.725 2.704
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.28 4.26 +0.4% 2.442 3.061
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 6.17 6.28 -1.6% 2.669 2.689
ScoutingNANOdata130Xrun3 2500.1301 0.771 0.771 0.000 ( +0.0% ) 29.72 32.71 -9.1% 1.351 1.651
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.10 5.51 -7.5% 2.198 2.220
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 3.68 3.91 -5.8% 2.424 2.501
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 2.39 2.49 -3.9% 2.575 2.583
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 1.10 1.12 -1.4% 2.419 2.418
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 3.68 3.92 -6.0% 2.363 2.371
ScoutingNANOmc140X 2500.2207 1.486 1.486 0.000 ( +0.0% ) 14.74 14.97 -1.5% 1.911 1.914
ScoutingNANOwithPromptmc140X 2500.2208 4.474 4.474 0.000 ( +0.0% ) 3.31 3.28 +0.9% 2.594 2.557
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 7.40 7.50 -1.3% 2.435 2.135
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.55 5.64 -1.6% 2.826 2.841
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.55 3.56 -0.3% 2.875 2.530
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.43 1.43 +0.0% 2.406 2.386
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.50 5.52 -0.4% 2.727 2.427
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 28.76 28.55 +0.7% 1.508 1.400
ScoutingNANOwithPromptdata140Xrun3 2500.2308 2.783 2.783 0.000 ( +0.0% ) 5.15 5.03 +2.3% 2.961 2.795
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 6.39 6.93 -7.8% 1.865 1.856
muDPGNANO140Xrun3 2500.2402 10.331 10.331 0.000 ( +0.0% ) 1.59 1.65 -3.6% 1.734 1.718
muDPGNANOBkg140Xrun3 2500.2403 2.712 2.712 0.000 ( +0.0% ) 15.61 15.50 +0.7% 1.041 1.011
hcalDPGNANO140Xrun3 2500.2404 486.016 486.016 0.000 ( +0.0% ) 1.10 1.12 -1.7% 1.632 1.643
hcalDPGCalibNANO140Xrun3 2500.2405 826.413 826.413 0.000 ( +0.0% ) 1.52 1.51 +0.7% 1.703 1.626
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.64 1.64 +0.5% 1.771 1.752
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.33 1.41 -6.1% 2.897 3.096
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.21 1.21 -0.7% 2.681 2.676
NANOmc150X 2500.3001 3.218 3.218 0.000 ( +0.0% ) 17.92 17.31 +3.6% 2.747 2.763
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 31.36 33.34 -5.9% 1.876 2.247
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 22.73 22.72 +0.0% 2.348 2.582
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 15.14 15.13 +0.0% 2.400 2.452
EGMNANOmc150X 2500.3202 4.110 4.110 0.000 ( +0.0% ) 13.93 13.62 +2.3% 2.466 2.525
BTVNANOmc150X 2500.3203 10.551 10.551 0.000 ( +0.0% ) 4.82 4.74 +1.6% 2.731 2.662
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.36 1.32 +3.2% 2.651 2.679
jmeNANOrePuppimc150X 2500.3205 6.762 6.762 0.000 ( +0.0% ) 1.30 1.24 +4.4% 3.049 2.992
lepTrackInfoNANOmc150X 2500.3206 3.720 3.720 0.000 ( +0.0% ) 14.73 13.90 +6.0% 2.458 2.504
ScoutingNANOmc150X 2500.3207 1.562 1.562 0.000 ( +0.0% ) 19.22 18.74 +2.6% 2.449 2.448
ScoutingNANOwithPromptmc150X 2500.3208 4.773 4.773 0.000 ( +0.0% ) 10.69 10.41 +2.7% 2.816 2.790
BPHNANOmc150X 2500.3209 4.108 4.108 0.000 ( +0.0% ) 17.17 16.89 +1.7% 2.605 2.647
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 24.66 24.59 +0.3% 2.134 2.400
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 22.45 21.35 +5.1% 2.199 2.482
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.93 5.76 +2.9% 2.409 2.679
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.67 1.63 +2.4% 2.354 2.384
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.45 1.42 +1.8% 2.606 2.652
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 24.72 23.95 +3.2% 2.393 2.219
ScoutingNANOdata150Xrun3 2500.3307 1.737 1.737 0.000 ( +0.0% ) 29.64 30.64 -3.3% 1.510 1.684
ScoutingNANOwithPromptdata150Xrun3 2500.3308 2.601 2.601 0.000 ( +0.0% ) 17.63 17.13 +2.9% 2.575 2.572
BPHNANOdata150Xrun3 2500.3309 2.604 2.604 0.000 ( +0.0% ) 34.08 33.60 +1.4% 2.441 2.436
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 29.61 28.77 +2.9% 1.827 1.848
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 28.81 28.13 +2.4% 1.516 1.519
DYToLL_M-50_13TeV_pythia8 2500.9101 14.345 14.345 0.000 ( +0.0% ) 7.94 8.38 -5.3% 1.061 1.045
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.310 0.150 0.160 ( +106.7% ) 3.60 3.14 +14.8% 0.850 0.851
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.55 2.55 +0.2% 0.853 0.854

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants