Jobsub ID 79936.157@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79936.157@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3512 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 07:52:19 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2024-09-27 16:42:31 |
| From worker node | Hostname | dunegli-4171968-0-fnpc23019.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 12:22:15 |
| Input files | hd-protodune:np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339.hdf5
|
| Outputting started | 2024-09-27 16:16:00 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
gged "gauss"
FrameSaver: q=1.67587e+06 n=849635 tag=gauss
wclsFrameSaver: saving 60732 traces tagged "wiener"
FrameSaver: q=1.80901e+06 n=772187 tag=wiener
5979 hits in TPC 0
4316 hits in TPC 1
3889 hits in TPC 2
4481 hits in TPC 3
3384 hits in TPC 4
3982 hits in TPC 5
5748 hits in TPC 6
3179 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 43 XUs and 39 XVs -> 2 XUVs
C:0 T:1 5844 XUs and 4598 XVs -> 736 XUVs
C:0 T:2 6383 XUs and 9031 XVs -> 328 XUVs
C:0 T:3 11120 XUs and 25456 XVs -> 1687 XUVs
C:0 T:4 8 XUs and 5 XVs -> 0 XUVs
C:0 T:5 24340 XUs and 27511 XVs -> 1602 XUVs
C:0 T:6 9960 XUs and 14447 XVs -> 1761 XUVs
C:0 T:7 271 XUs and 331 XVs -> 4 XUVs
6120 XUVs total
1913 collection wire objects
6120 potential space points
Neighbour search...
358646 tests to find 177228 neighbours
Iterating with no regularization...
Begin: 2.13501e+07
0 1.93906e+07
1 1.91975e+07
2 1.91667e+07
3 1.91582e+07
Now with regularization...
Begin: 1.76072e+07
0 1.76016e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:15:52 UTC Closed output file "np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup.root"
27-Sep-2024 16:15:52 UTC Closed input file "np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 45.4824 68.9785 118.895 65.5885 16.2106 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000336219 0.00131839 0.00280871 0.00134534 0.00071416 35
produce:fembfilter:PDHDFEMBFilter 0.435795 0.608256 0.844911 0.629054 0.116151 35
produce:wclsdatahd:WireCellToolkit 21.992 25.7397 32.0778 23.7676 3.31264 35
produce:gaushit:GausHitFinder 0.338993 0.574655 1.04813 0.515212 0.201545 35
produce:nhitsfilter:NumberOfHitsFilter 0.000176174 0.00027894 0.000467589 0.000265955 6.80489e-05 35
produce:reco3d:SpacePointSolver 0.25008 0.840367 4.30932 0.699021 0.701162 35
produce:hitpdune:DisambigFromSpacePoints 0.143271 0.552505 1.41257 0.459748 0.297028 35
produce:pandora:StandardPandora 4.87322 12.5775 33.0525 10.4427 6.56876 35
produce:pandoraWriter:StandardPandora 0.0613093 0.114871 0.220776 0.106072 0.0364798 35
produce:pandoraTrack:LArPandoraTrackCreation 0.437441 1.02606 2.20211 0.988156 0.392559 35
produce:pandoraShower:LArPandoraShowerCreation 0.380628 1.19717 2.82552 1.02972 0.573929 35
produce:pandoracalo:Calorimetry 0.240677 0.557114 1.12617 0.544879 0.204943 35
produce:pandoracalonosce:Calorimetry 0.219505 0.515959 1.0698 0.510756 0.193444 35
produce:pandorapid:Chi2ParticleID 0.000911842 0.00165848 0.00310205 0.00174461 0.000487921 35
produce:pandoraShowercalo:ShowerCalorimetry 0.332473 1.16394 2.98702 1.03031 0.574257 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.323963 1.11228 2.86874 0.98541 0.53481 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0508155 0.10881 0.201911 0.0962199 0.0388146 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.016624 0.0364918 0.0627946 0.033009 0.0120358 35
produce:emtrkmichelid:EmTrackMichelId 13.1258 20.9997 32.1424 20.3793 4.5931 35
[art]:TriggerResults:TriggerResultInserter 1.3145e-05 2.42692e-05 7.2828e-05 2.0889e-05 1.26946e-05 35
end_path:out1:RootOutput 6.652e-06 1.11076e-05 2.2102e-05 1.1421e-05 3.2702e-06 35
end_path:michelremoving:michelremoving 0.0105047 0.0529829 0.227367 0.0221148 0.0595865 35
end_path:michelremovinggnocchi:michelremoving 0.00973407 0.0495684 0.218791 0.0198339 0.0584428 35
end_path:calibanagnocchi:CalibAnaTree 0.203707 0.422569 1.15047 0.388523 0.177262 35
end_path:out1:RootOutput(write) 0.348521 0.648546 1.28639 0.59693 0.207403 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4991.04 MB
Peak resident set size usage (VmHWM): 2663.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup.root
\tHists: np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451314.0,
"core.end_time": 1727453753.0,
"core.events": [
2832,
2836,
2840,
2844,
2848,
2852,
2856,
2860,
2864,
2868,
2872,
2876,
2880,
2884,
2888,
2892,
2896,
2900,
2904,
2908,
2912,
2916,
2920,
2924,
2928,
2932,
2936,
2940,
2944,
2948,
2952,
2956,
2960,
2964,
2968
],
"core.event_count": 35,
"core.first_event_number": 2832,
"core.last_event_number": 2968,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27346
],
"core.runs_subruns": [
2734600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339_reco_stage1_reco_stage2_20240927T161552_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451314.0,
"core.end_time": 1727453753.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27346
],
"core.runs_subruns": [
2734600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027346_0020_dataflow3_datawriter_0_20240621T153339.hdf5"
}
]
} 