[WIP] Prototype TruthInfo graph for truth history navigation and association studies#50913

Draft

felicepantaleo wants to merge 41 commits into

cms-sw:masterfrom

felicepantaleo:truthGraph_17_0_0_pre1

Contributor

felicepantaleo commented May 11, 2026

This draft PR collects the ongoing TruthInfo graph developments being worked on during the 20th Patatrack hackathon.

The goal is to prototype a common truth-history representation in CMSSW, combining generator-level and simulation-level information into graph-based data structures that can be navigated through a physics-oriented API.

This PR is intentionally opened as a draft so that the working group can collaborate in a single place during the hackathon.

This development explores two related layers:

a compact raw TruthGraph, built from existing CMS truth products such as HepMC, SimTrack, and SimVertex;
a higher-level logical truth::Graph, exposing particles, vertices, payload, and navigation methods.

The long-term goal is to provide a stable abstraction for truth navigation and truth-reco association, avoiding the need for downstream reconstruction and validation code to directly depend on the internal structure of several low-level truth collections.

Hackathon work area

This PR is meant as the shared development branch for the working group at the ongoing 20th Patatrack hackathon.

Status

This is a prototype and not yet intended as a final interface.

The main purpose of this draft PR is to collect ideas, code, tests, and validation feedback in a common place during the hackathon. The implementation and API are expected to evolve substantially before this can become a stable CMSSW interface.

felicepantaleo added 8 commits

May 8, 2026 15:22


          Introduce compact truth graph data structure

e23c826


          Add necessary build and dictionary files for TruthGraph

1220e28


          Implement TruthGraphProducer for event graph construction

27535f2


          Add dumper module for graph visualization and inspection

fdf02ea


          Add plugin build configuration for producer and dumper modules

3add5a9


          Add Python configuration fragment for TruthGraphProducer

25e3390


          Create standalone truth logical graph

3024f29


          Draft README

a5a2ddd

cmsbuild added this to the CMSSW_17_0_X milestone

cmsbuild added pending-signatures tests-pending orp-pending new-package-pending code-checks-pending changes-dataformats labels

Contributor

cmsbuild commented May 11, 2026 •

edited

Loading

cms-bot internal usage

Contributor

cmsbuild commented May 11, 2026

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49282

Found files with invalid states:
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

cmsbuild added code-checks-approved and removed code-checks-pending labels


          Add possibility to filter mother by pdgid

005afc8

cmsbuild added code-checks-pending and removed code-checks-approved labels

Contributor

cmsbuild commented May 11, 2026

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49283

Found files with invalid states:
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

cmsbuild added code-checks-approved and removed code-checks-pending labels

Contributor

cmsbuild commented May 11, 2026

Pull request #50913 was updated.

felicepantaleo added 2 commits

May 11, 2026 14:54


          Add generator status flags to truth graphs

06d1ed4

Store packed reco::GenStatusFlags in the raw TruthGraph and propagate them to the logical truth::Graph particle payload. Decode and print the active status flags in the logical graph dumper to make hard-process and copy-history information visible in DOT dumps.


          Collapse intermediate same-PDG GEN particle chains

30478e2

Add an optional post-processing pass for the logical truth graph. The pass collapses GEN-only chains of the form P -> V -> C when P has status different from 1, C is the only daughter, and P and C have the same PDG id. This removes intermediate generator-history copies while preserving the physics-forward graph topology.

cmsbuild added code-checks-pending and removed code-checks-approved labels

cmsbuild added simulation-pending code-checks-pending and removed code-checks-approved labels

Contributor

cmsbuild commented May 12, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49311

Found files with invalid states:
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49311/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49311/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly
code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49311/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49311/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly

cmsbuild added code-checks-rejected and removed code-checks-pending labels


          Update README

4c40757

Contributor

cmsbuild commented May 12, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49312

Found files with invalid states:
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49312/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49312/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly
code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49312/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49312/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly

felicepantaleo added 2 commits

May 13, 2026 10:21


          adding rechits

6ffb5f7


          adding possibility to hide truth particles with no simhits

00a7e0b

Contributor

cmsbuild commented May 13, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49317

Found files with invalid states:
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49317/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49317/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly


          add argparser

c0e6190

Contributor

cmsbuild commented May 13, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49324

Found files with invalid states:
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49324/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49324/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly

felicepantaleo added 2 commits

May 13, 2026 15:59


          Separate postprocessing

9c2d710


          code format

52b592c

Contributor

cmsbuild commented May 13, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49328

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49328/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49328/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly
code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49328/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49328/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly

IzaakWN and others added 2 commits

May 13, 2026 16:02


          make input file optional (#66)

ccb99ab


          dump simhits & rechits (#67)

470a299

Contributor

cmsbuild commented May 13, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49329

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49329/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49329/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly


          Add unit tests for TruthLogicalGraphPostProcessor

36c8b20

Contributor

cmsbuild commented May 15, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49350

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49350/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49350/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly
code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49350/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49350/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly


          make code check happy

e03e2a6

Contributor

cmsbuild commented May 15, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49351

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49351/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49351/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly


          format

806d289

Contributor

cmsbuild commented May 15, 2026

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49352

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710

Contributor

cmsbuild commented May 15, 2026

Pull request #50913 was updated.

felicepantaleo added 2 commits

May 15, 2026 19:38


          Create enableTruth ProcessModifier

558c5e6


          Create enableTruth Run4 workflows

9daf9b8

Contributor

cmsbuild commented May 15, 2026

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-50913/49362

Found files with invalid states:
- PhysicsTools/TruthInfo/python/truthGraphProducer_cfi.py:
  - Added: 25e3390
  - Deleted: 9c2d710
- PhysicsTools/TruthInfo/test/dumpTruthGraphsFromStep1_cfg.py:
  - Added: a556325
  - Modified: 0388260, 1f551a7, d6f1dde, b791ef4
  - Deleted: 00a7e0b
- PhysicsTools/TruthInfo/src/BuildFile.xml:
  - Added: 1220e28
  - Deleted: 3024f29
- PhysicsTools/TruthInfo/python/truthLogicalGraphDumper_cfi.py:
  - Added: 3024f29
  - Modified: 00a7e0b
  - Deleted: 9c2d710
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Rpc digi dev v9 #47447, update phase-2 HLT timing script and use alpaka modifier in NGT workflows #49821, TICL: Consolidate v5 as Default Configuration and Cleanup Legacy Code #49932

Contributor

cmsbuild commented May 15, 2026

Pull request #50913 was updated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changes-dataformats code-checks-approved new-package-pending operations-pending orp-pending pdmv-pending pending-signatures simulation-pending tests-pending