Jobsub ID 269356.150@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 269356.150@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3585 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-10-04 17:27:15 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2024-10-05 00:46:35 |
| From worker node | Hostname | cdr1133.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-04 22:02:12 |
| Input files | hd-protodune:np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406.hdf5
|
| Outputting started | 2024-10-05 00:45:13 |
| Output files | |
| Finished | 2024-10-05 00:46:35 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
FrameSaver: q=1.38229e+06 n=733192 tag=gauss
wclsFrameSaver: saving 56104 traces tagged "wiener"
FrameSaver: q=1.53164e+06 n=667229 tag=wiener
2059 hits in TPC 0
2094 hits in TPC 1
7708 hits in TPC 2
2619 hits in TPC 3
4157 hits in TPC 4
7262 hits in TPC 5
4685 hits in TPC 6
2993 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4 XUs and 0 XVs -> 0 XUVs
C:0 T:1 2030 XUs and 1402 XVs -> 45 XUVs
C:0 T:2 36523 XUs and 39670 XVs -> 2051 XUVs
C:0 T:3 447 XUs and 572 XVs -> 29 XUVs
C:0 T:4 1171 XUs and 1459 XVs -> 83 XUVs
C:0 T:5 24879 XUs and 30241 XVs -> 3932 XUVs
C:0 T:6 36569 XUs and 32139 XVs -> 530 XUVs
C:0 T:7 572 XUs and 429 XVs -> 60 XUVs
6730 XUVs total
1384 collection wire objects
6730 potential space points
Neighbour search...
632474 tests to find 345742 neighbours
Iterating with no regularization...
Begin: 1.30635e+07
0 1.08082e+07
1 1.06015e+07
2 1.05535e+07
3 1.05331e+07
4 1.05224e+07
5 1.05152e+07
Now with regularization...
Begin: 9.42349e+06
0 9.41308e+06
1 9.40665e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
04-Oct-2024 17:45:03 PDT Closed output file "np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup.root"
04-Oct-2024 17:45:03 PDT Closed input file "np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 93.4373 175.525 271.745 172.105 42.4599 39
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000460962 0.00396977 0.00830895 0.00411239 0.00208783 39
produce:fembfilter:PDHDFEMBFilter 0.988679 1.01825 1.06119 1.02059 0.0131363 39
produce:wclsdatahd:WireCellToolkit 55.3708 61.9067 65.713 62.2395 1.97029 39
produce:gaushit:GausHitFinder 0.785836 1.34104 2.02506 1.28864 0.293226 39
produce:nhitsfilter:NumberOfHitsFilter 0.000373787 0.000805049 0.00182555 0.00071112 0.000328257 39
produce:reco3d:SpacePointSolver 0.244253 7.27584 21.7953 6.52929 4.62279 39
produce:hitpdune:DisambigFromSpacePoints 0.334913 1.56312 3.04303 1.57343 0.657827 39
produce:pandora:StandardPandora 11.2902 33.9598 80.7217 31.9086 16.196 39
produce:pandoraWriter:StandardPandora 0.136374 0.301404 0.424879 0.298843 0.0665915 39
produce:pandoraTrack:LArPandoraTrackCreation 1.56972 6.32614 12.4824 5.4312 2.72904 39
produce:pandoraShower:LArPandoraShowerCreation 1.15409 8.55022 15.7665 7.85366 4.29328 39
produce:pandoracalo:Calorimetry 0.670732 2.42016 4.53349 2.23044 1.04228 39
produce:pandoracalonosce:Calorimetry 0.614426 2.2974 4.43942 2.13946 0.995794 39
produce:pandorapid:Chi2ParticleID 0.00212019 0.00345369 0.00554438 0.00335797 0.000737314 39
produce:pandoraShowercalo:ShowerCalorimetry 0.967971 5.97597 12.6709 5.34448 3.13382 39
produce:pandoraShowercalonosce:ShowerCalorimetry 0.96685 5.67394 11.9497 4.96382 3.00539 39
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0991336 0.21363 0.331543 0.207997 0.0470558 39
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0377037 0.0842941 0.13342 0.0833389 0.018148 39
produce:emtrkmichelid:EmTrackMichelId 16.6881 32.8517 44.9006 33.9206 6.65324 39
[art]:TriggerResults:TriggerResultInserter 3.5984e-05 7.24828e-05 0.000133381 6.9406e-05 2.76079e-05 39
end_path:out1:RootOutput 1.3326e-05 2.19259e-05 3.9511e-05 2.032e-05 6.824e-06 39
end_path:michelremoving:michelremoving 0.0231157 0.161233 0.625885 0.0943494 0.132294 39
end_path:michelremovinggnocchi:michelremoving 0.0215449 0.139872 0.407991 0.0830748 0.106451 39
end_path:calibanagnocchi:CalibAnaTree 0.47833 1.79711 3.44766 1.57495 0.789895 39
end_path:out1:RootOutput(write) 0.719225 1.39938 2.01912 1.452 0.307058 39
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5018.68 MB
Peak resident set size usage (VmHWM): 2696.15 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup.root
\tHists: np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728082207.0,
"core.end_time": 1728089104.0,
"core.events": [
1729,
1733,
1737,
1741,
1745,
1749,
1753,
1757,
1761,
1765,
1769,
1773,
1777,
1781,
1785,
1789,
1793,
1797,
1801,
1805,
1809,
1813,
1817,
1821,
1825,
1829,
1833,
1837,
1841,
1845,
1849,
1853,
1857,
1861,
1865,
1869,
1873,
1877,
1881
],
"core.event_count": 39,
"core.first_event_number": 1729,
"core.last_event_number": 1881,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27765
],
"core.runs_subruns": [
2776500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406_reco_stage1_reco_stage2_20241005T004503_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728082207.0,
"core.end_time": 1728089104.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27765
],
"core.runs_subruns": [
2776500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027765_0011_dataflow3_datawriter_0_20240705T155406.hdf5"
}
]
} 