Add TrackingParticle <-> reco-track association tables to NanoAOD (Phase-2 HLT) by rovere · Pull Request #50976 · cms-sw/cmssw

rovere · 2026-05-19T10:22:50Z

PR description:

Persists the truth-matching links between TrackingParticles and reconstructed tracks into NanoAOD as flat index tables, so analyses can consume association results directly from NANO without re-running the associator.

New generic OneToManyWithQualityFlatTableProducer for edm::AssociationMap-style one-to-many+quality maps, with plugin typedefs for both SimToRecoCollection and RecoToSimCollection, plus a _cff.py wiring both directions.
Integration into the Phase-2 HLT NanoAOD flow (NGT Scouting), exposing HLT track collections and adding the association tables to the output.
Standalone test cfg that reads the new tables back and dumps them for validation of column contents and index consistency.

PR Validation

Phase-2 HLT NANO runTheMatrix.py workflows confirm the new branches appear.

cmsbuild · 2026-05-19T10:23:17Z

cms-bot internal usage

mmusich · 2026-05-19T10:23:23Z

type ngt

mmusich · 2026-05-19T10:24:03Z

test parameters:

workflows = ph2_hlt

cmsbuild · 2026-05-19T10:25:25Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50976/49383

There are other open Pull requests which might conflict with changes you have proposed:
- File HLTrigger/NGTScouting/python/HLTNanoProducer_cff.py modified in PR(s): Phase2 Single_Tau_Trigger Path Added #49637

cmsbuild · 2026-05-19T10:25:50Z

A new Pull Request was created by @rovere for master.

It involves the following packages:

HLTrigger/NGTScouting (hlt)
PhysicsTools/NanoAOD (xpog)
SimTracker/TrackAssociation (simulation)

@Martin-Grunewald, @battibass, @civanch, @cmsbuild, @ftorrresd, @kpedro88, @mdhildreth, @mmusich can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @Martin-Grunewald, @VinInn, @VourMa, @abbiendi, @dgulhan, @elusian, @gpetruc, @jhgoh, @missirol, @mmasciov, @mmusich, @mtosi, @threus this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

mmusich · 2026-05-19T10:25:58Z

@cmsbuild, please test

cmsbuild · 2026-05-19T12:40:47Z

+1

Size: This PR adds an extra 32KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-621fb4/53322/summary.html
COMMIT: b0a5d21
CMSSW: CMSSW_17_0_X_2026-05-18-2300/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/50976/53322/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 12 differences found in the comparisons
DQMHistoTests: Total files compared: 67
DQMHistoTests: Total histograms compared: 4602279
DQMHistoTests: Total failures: 12
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4602247
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 66 files compared)
Checked 279 log files, 238 edm output root files, 67 DQM output files
TriggerResults: no differences found

civanch · 2026-05-19T15:04:06Z

+1

mmusich · 2026-05-20T08:03:20Z

+hlt

battibass · 2026-05-20T08:31:07Z

enable nano

battibass · 2026-05-20T08:31:15Z

please test

cmsbuild · 2026-05-20T10:54:38Z

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-621fb4/53361/summary.html
COMMIT: b0a5d21
CMSSW: CMSSW_17_0_X_2026-05-19-2300/el8_amd64_gcc13
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/50976/53361/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 1 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 14 differences found in the comparisons
DQMHistoTests: Total files compared: 66
DQMHistoTests: Total histograms compared: 4596347
DQMHistoTests: Total failures: 74
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4596253
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 65 files compared)
Checked 276 log files, 236 edm output root files, 66 DQM output files
TriggerResults: no differences found

Nano size comparison Summary:

workflow	id	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
NANOmc106Xul16v2	2500.0001	3.094	3.094	0.000 ( +0.0% )	3.74	3.32	+12.7%	2.654	2.665
NANOmc106Xul16APVv2	2500.0002	3.048	3.048	0.000 ( +0.0% )	3.68	3.31	+11.2%	2.678	2.694
NANOmc106Xul17v2	2500.0003	3.153	3.153	0.000 ( +0.0% )	3.49	3.07	+13.7%	3.115	3.136
NANOmc106Xul18v2	2500.0004	3.105	3.105	0.000 ( +0.0% )	3.52	3.10	+13.7%	3.124	3.121
NANOdata106Xul16v2	2500.0101	1.539	1.539	0.000 ( +0.0% )	6.36	5.48	+16.0%	2.737	2.764
NANOdata106Xul17v2	2500.0102	1.926	1.926	0.000 ( +0.0% )	4.18	3.72	+12.5%	2.937	2.963
NANOdata106Xul18v2	2500.0103	1.890	1.890	0.000 ( +0.0% )	5.01	4.40	+14.0%	2.795	2.790
NANOmcUL16APVreMINI	2500.0201	0.022	0.022	0.000 ( +0.0% )	1.82	1.64	+11.0%	2.714	2.852
NANOmcUL16reMINI	2500.0202	0.022	0.022	0.000 ( +0.0% )	1.80	1.68	+7.5%	2.858	2.876
NANOmcUL17reMINI	2500.0203	0.022	0.022	0.000 ( +0.0% )	1.71	1.30	+31.3%	3.053	3.066
NANOmcUL18reMINI	2500.0204	0.022	0.022	0.000 ( +0.0% )	1.66	1.44	+14.8%	3.070	3.058
NANOdataUL16APVreMINI	2500.0301	0.035	0.035	0.000 ( +0.0% )	1.61	1.51	+6.9%	2.777	2.794
NANOdataUL16reMINI	2500.0302	0.036	0.036	0.000 ( +0.0% )	1.64	1.20	+36.7%	2.791	2.563
NANOdataUL17reMINI	2500.0303	0.037	0.037	0.000 ( +0.0% )	1.58	1.48	+6.9%	2.819	2.849
NANOdataUL18reMINI	2500.0304	0.036	0.036	0.000 ( +0.0% )	1.61	1.50	+7.2%	2.810	2.836
NANOmcUL16APVMini2Mini	2500.0401	0.023	0.023	0.000 ( +0.0% )	2.60	2.30	+12.9%	2.109	2.114
NANOmcUL16Mini2Mini	2500.0402	0.023	0.023	0.000 ( +0.0% )	2.61	2.31	+13.4%	2.141	2.146
NANOmcUL17Mini2Mini	2500.0403	0.023	0.023	0.000 ( +0.0% )	2.48	2.09	+19.0%	2.158	2.162
NANOmcUL18Mini2Mini	2500.0404	0.023	0.023	0.000 ( +0.0% )	2.56	2.07	+23.4%	2.155	2.164
NANOdataUL16Mini2Mini	2500.0501	0.039	0.039	0.000 ( +0.0% )	3.59	2.52	+42.2%	1.997	2.010
NANOdataUL17Mini2Mini	2500.0502	0.040	0.040	0.000 ( +0.0% )	2.72	1.97	+37.8%	2.061	2.069
NANOdataUL18Mini2Mini	2500.0503	0.039	0.039	0.000 ( +0.0% )	3.05	2.32	+31.2%	2.053	2.065
NANOmc130X	2500.1001	3.228	3.228	0.000 ( +0.0% )	4.22	3.67	+15.0%	3.027	3.040
NANOdata130Xrun3	2500.1101	1.790	1.790	0.000 ( +0.0% )	6.45	5.55	+16.2%	2.731	2.687
NANOmc23Mini2Mini	2500.1201	0.022	0.022	0.000 ( +0.0% )	2.88	2.12	+35.6%	2.031	2.038
NANOdata23Mini2Mini	2500.1301	0.041	0.041	0.000 ( +0.0% )	3.68	2.60	+41.5%	2.317	2.326
ScoutingNANOdata124Xrun3	2500.1501	0.772	0.772	0.000 ( +0.0% )	34.73	26.98	+28.7%	1.579	1.592
ScoutingNANOmonitordata124Xrun3	2500.1502	0.862	0.862	0.000 ( +0.0% )	14.67	11.95	+22.8%	1.424	1.442
ScoutingNANOdata130Xrun3	2500.1503	1.251	1.251	0.000 ( +0.0% )	25.53	20.28	+25.9%	1.470	1.456
ScoutingNANOmonitordata130Xrun3	2500.1504	1.297	1.297	0.000 ( +0.0% )	10.82	9.43	+14.8%	1.381	1.408
muPOGNANOmc140X	2500.2201	2.269	2.269	0.000 ( +0.0% )	5.71	4.53	+26.0%	2.258	2.258
EGMNANOmc140X	2500.2202	3.859	3.859	0.000 ( +0.0% )	4.14	3.10	+33.4%	2.386	2.526
BTVNANOmc140X	2500.2203	10.475	10.475	0.000 ( +0.0% )	2.60	2.05	+26.9%	2.460	2.471
jmeNANOmc140X	2500.2204	6.639	6.639	0.000 ( +0.0% )	1.17	1.04	+13.2%	2.634	2.648
lepTrackInfoNANOmc140X	2500.2206	3.553	3.553	0.000 ( +0.0% )	4.11	3.48	+18.2%	2.556	2.381
ScoutingNANOmc140X	2500.2207	1.488	1.488	0.000 ( +0.0% )	14.37	12.48	+15.1%	1.785	1.858
ScoutingNANOwithPromptmc140X	2500.2208	4.461	4.461	0.000 ( +0.0% )	2.94	2.66	+10.7%	2.841	2.675
muPOGNANO140Xrun3	2500.2301	1.683	1.683	0.000 ( +0.0% )	7.86	6.78	+15.9%	2.337	2.340
EGMNANOdata140Xrun3	2500.2302	2.623	2.623	0.000 ( +0.0% )	5.95	5.18	+14.8%	2.694	2.627
BTVNANOdata140Xrun3	2500.2303	5.612	5.612	0.000 ( +0.0% )	3.75	3.45	+8.8%	2.796	2.773
jmeNANOdata140Xrun3	2500.2304	3.976	3.976	0.000 ( +0.0% )	1.48	1.34	+10.7%	2.619	2.642
lepTrackInfoNANOdata140Xrun3	2500.2306	2.413	2.413	0.000 ( +0.0% )	5.94	5.47	+8.5%	2.713	2.632
ScoutingNANOdata140Xrun3	2500.2307	1.101	1.101	0.000 ( +0.0% )	29.98	28.48	+5.3%	1.419	1.459
ScoutingNANOmonitordata140Xrun3	2500.2308	2.784	2.784	0.000 ( +0.0% )	4.79	4.35	+10.2%	2.992	2.930
ScoutingNANOmonitorWithPromptdata140Xrun3	2500.2309	2.784	2.784	0.000 ( +0.0% )	4.72	4.32	+9.3%	2.824	2.828
L1ScoutingSelectionNANOdata140Xrun3	2500.2311	0.081	0.081	0.000 ( +0.0% )	48.57	44.95	+8.1%	0.842	0.847
L1ScoutingNANOdata140Xrun3	2500.231	0.082	0.082	0.000 ( +0.0% )	4.08	3.90	+4.5%	0.854	0.934
l1DPGNANO140Xrun3	2500.2401	9.405	9.405	0.000 ( +0.0% )	7.21	6.45	+11.7%	1.829	1.848
muDPGNANO140Xrun3	2500.2402	10.377	10.377	0.000 ( +0.0% )	1.66	1.60	+3.9%	1.691	1.696
muDPGNANOBkg140Xrun3	2500.2403	6.401	6.401	0.000 ( +0.0% )	15.57	13.27	+17.3%	1.197	1.265
hcalDPGNANO140Xrun3	2500.2404	486.015	486.015	0.000 ( +0.0% )	1.16	1.10	+5.7%	1.598	1.664
hcalDPGCalibNANO140Xrun3	2500.2405	826.418	826.418	0.000 ( +0.0% )	1.51	1.45	+4.1%	1.639	1.581
hcalDPGMCNANO140Xrun3	2500.2501	645.333	645.333	0.000 ( +0.0% )	1.66	1.60	+3.6%	1.691	1.765
NANOmc2024reMINI	2500.2601	0.021	0.021	0.000 ( +0.0% )	1.95	1.76	+10.7%	2.613	2.637
NANOdata2024reMINI	2500.2701	0.036	0.036	0.000 ( +0.0% )	1.93	1.72	+12.1%	2.524	2.568
NANOmc150X	2500.3001	3.224	3.224	0.000 ( +0.0% )	17.64	15.87	+11.1%	2.770	2.779
NANOdata150X	2500.3101	2.144	2.144	0.000 ( +0.0% )	34.67	30.33	+14.3%	2.479	2.514
NANOdata150X	2500.3102	2.630	2.630	0.000 ( +0.0% )	28.68	26.07	+10.0%	2.286	2.533
muPOGNANOmc150X	2500.3201	2.344	2.344	0.000 ( +0.0% )	15.39	14.80	+4.0%	2.575	2.586
EGMNANOmc150X	2500.3202	4.118	4.118	0.000 ( +0.0% )	14.09	12.51	+12.7%	2.620	2.764
BTVNANOmc150X	2500.3203	10.559	10.559	0.000 ( +0.0% )	4.84	4.21	+15.0%	2.750	2.956
jmeNANOmc150X	2500.3204	6.460	6.460	0.000 ( +0.0% )	1.24	1.13	+9.1%	2.653	2.697
jmeNANOrePuppimc150X	2500.3205	6.464	6.464	0.000 ( +0.0% )	1.07	0.95	+13.0%	2.986	3.132
lepTrackInfoNANOmc150X	2500.3206	3.728	3.728	0.000 ( +0.0% )	14.68	14.05	+4.5%	2.617	2.766
ScoutingNANOmc150X	2500.3207	1.563	1.563	0.000 ( +0.0% )	17.49	14.93	+17.2%	2.390	2.334
ScoutingNANOwithPromptmc150X	2500.3208	4.781	4.781	0.000 ( +0.0% )	9.32	8.04	+15.9%	2.827	2.733
BPHNANOmc150X	2500.3209	4.135	4.135	0.000 ( +0.0% )	14.03	12.87	+8.9%	2.646	2.772
EXONANOmc150X	2500.321	6.155	6.157	-0.002 ( -0.0% )	0.32	0.29	+9.7%	0.783	0.857
muPOGNANO150Xrun3	2500.3301	1.244	1.244	0.000 ( +0.0% )	28.02	26.43	+6.0%	2.271	2.404
EGMNANOdata150Xrun3	2500.3302	2.985	2.985	0.000 ( +0.0% )	22.23	21.70	+2.5%	2.211	2.480
BTVNANOdata150Xrun3	2500.3303	7.971	7.971	0.000 ( +0.0% )	5.34	4.90	+9.0%	2.395	2.407
jmeNANOdata150Xrun3	2500.3304	4.349	4.349	0.000 ( +0.0% )	1.39	1.19	+17.5%	2.393	2.661
jmeNANOrePuppidata150Xrun3	2500.3305	4.332	4.332	0.000 ( +0.0% )	1.22	1.09	+12.1%	2.578	2.851
lepTrackInfoNANOdata150Xrun3	2500.3306	2.625	2.625	0.000 ( +0.0% )	26.54	21.26	+24.8%	2.505	2.500
ScoutingNANOdata150Xrun3	2500.3307	1.738	1.738	0.000 ( +0.0% )	25.25	22.66	+11.4%	1.533	1.582
ScoutingNANOmonitordata150Xrun3	2500.3308	1.400	1.400	0.000 ( +0.0% )	21.18	17.89	+18.4%	2.267	2.104
ScoutingNANOmonitorWithPromptdata150Xrun3	2500.3309	2.602	2.602	0.000 ( +0.0% )	15.18	12.46	+21.9%	2.544	2.451
EXONANOdata150Xrun3	2500.3311	5.268	5.268	0.000 ( +0.0% )	0.24	0.24	-0.1%	0.712	0.711
L1ScoutingNANOdata150Xrun3	2500.3312	0.078	0.078	0.000 ( +0.0% )	2.32	2.36	-1.4%	0.836	0.870
L1ScoutingSelectionNANOdata150Xrun3	2500.3313	0.078	0.078	0.000 ( +0.0% )	16.08	19.17	-16.2%	0.951	0.954
BPHNANOdata150Xrun3	2500.331	2.632	2.632	0.000 ( +0.0% )	24.13	19.49	+23.8%	2.497	2.483
L1ScoutingNANOdata160Xrun3	2500.4301	0.110	0.110	0.000 ( +0.0% )	1.90	1.80	+5.6%	0.925	0.934
L1ScoutingSelectionNANOdata160Xrun3	2500.4302	0.113	0.113	0.000 ( +0.0% )	16.31	15.27	+6.8%	0.955	0.963
TTbarMINIAOD10.6_UL18v2	2500.9001	1.814	1.814	0.000 ( +0.0% )	31.44	25.91	+21.4%	1.909	1.918
TTbarMINIAOD14.0	2500.9002	1.662	1.662	0.000 ( +0.0% )	31.25	24.83	+25.8%	1.502	1.509
DYToLL_M-50_13TeV_pythia8	2500.9101	14.992	14.992	0.000 ( +0.0% )	5.25	6.22	-15.6%	1.152	1.161
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV	2500.9102	0.199	0.240	-0.041 ( -16.9% )	2.72	2.29	+19.0%	0.885	0.889
TTbar_Pow_LHE_13TeV	2500.9103	0.110	0.110	0.000 ( +0.0% )	2.33	2.27	+2.7%	0.889	0.895

NANO Comparison Summary

Summary:

You potentially added 717 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 32
DQMHistoTests: Total histograms compared: 43020
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 43020
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
Checked 192 log files, 112 edm output root files, 32 DQM output files
TriggerResults: no differences found

rovere added 3 commits May 18, 2026 18:04

Add TrackingParticles to recoTrack NANOAOD association.

b936ec9

Add test utility for TP-Reco NANO association.

270a938

TrackingParticles to Reco association in NANO HLT Phase2.

b0a5d21

cmsbuild added this to the CMSSW_17_0_X milestone May 19, 2026

cmsbuild added simulation-pending hlt-pending pending-signatures tests-pending orp-pending code-checks-pending xpog-pending trk labels May 19, 2026

cmsbuild added the ngt label May 19, 2026

cmsbuild added code-checks-approved and removed code-checks-pending labels May 19, 2026

cmsbuild added tests-started and removed tests-pending labels May 19, 2026

cmsbuild added tests-approved and removed tests-started labels May 19, 2026

cmsbuild added simulation-approved and removed simulation-pending labels May 19, 2026

cmsbuild added hlt-approved and removed hlt-pending labels May 20, 2026

cmsbuild added tests-started and removed tests-approved labels May 20, 2026

cmsbuild added tests-approved and removed tests-started labels May 20, 2026

cmsbuild mentioned this pull request May 20, 2026

[NGT] Add workflow to produce Phase2 NANOAOD with L1 and HLT objects #51004

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add TrackingParticle <-> reco-track association tables to NanoAOD (Phase-2 HLT)#50976

Add TrackingParticle <-> reco-track association tables to NanoAOD (Phase-2 HLT)#50976
rovere wants to merge 3 commits into
cms-sw:masterfrom
rovere:TPAssociatorsInNANOPhase2HLT

rovere commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026 •

edited

Loading

Uh oh!

mmusich commented May 19, 2026

Uh oh!

mmusich commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Uh oh!

mmusich commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Uh oh!

civanch commented May 19, 2026

Uh oh!

mmusich commented May 20, 2026

Uh oh!

battibass commented May 20, 2026

Uh oh!

battibass commented May 20, 2026

Uh oh!

cmsbuild commented May 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

rovere commented May 19, 2026

PR description:

PR Validation

Uh oh!

cmsbuild commented May 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mmusich commented May 19, 2026

Uh oh!

mmusich commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Uh oh!

mmusich commented May 19, 2026

Uh oh!

cmsbuild commented May 19, 2026

Comparison Summary

Uh oh!

civanch commented May 19, 2026

Uh oh!

mmusich commented May 20, 2026

Uh oh!

battibass commented May 20, 2026

Uh oh!

battibass commented May 20, 2026

Uh oh!

cmsbuild commented May 20, 2026

Comparison Summary

NANO Comparison Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

cmsbuild commented May 19, 2026 •

edited

Loading