Jobsub ID 79899.70@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79899.70@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3518 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 07:28:59 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:41:55 |
| From worker node | Hostname | mh-7662-13.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 12:33:21 |
| Input files | hd-protodune:np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13101s) |
| CPU time | 56m (3418s = 26%) |
| Outputting started | 2024-09-27 16:11:43 |
| Output files | |
| Finished | 2024-09-27 16:41:55 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
:0 T:3 125 XUs and 159 XVs -> 2 XUVs
C:0 T:4 66 XUs and 75 XVs -> 1 XUVs
C:0 T:5 23440 XUs and 30340 XVs -> 504 XUVs
C:0 T:6 24894 XUs and 28088 XVs -> 973 XUVs
C:0 T:7 1540 XUs and 1650 XVs -> 62 XUVs
2347 XUVs total
1652 collection wire objects
2347 potential space points
Neighbour search...
21575 tests to find 11840 neighbours
Iterating with no regularization...
Begin: 2.51659e+07
0 2.41499e+07
1 2.40941e+07
2 2.40931e+07
Now with regularization...
Begin: 2.23745e+07
0 2.23733e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 10360 TrkackID 9 startx, y, z 46.2431 288.806 444.652 wireno, peakt tpcno 74 819.627 5 dist 0min T, max_T760.394 2796.77
no of hits closeby 0 event 10360 TrkackID 16 startx, y, z 22.8679 593.369 133.322 wireno, peakt tpcno 286 1870.48 2 dist 187.608min T, max_T6.68752 1895.43
no of hits closeby 0 event 10360 TrkackID 9 startx, y, z 46.2431 288.806 444.652 wireno, peakt tpcno 74 819.627 5 dist 0min T, max_T760.394 2796.77
no of hits closeby 0 event 10360 TrkackID 16 startx, y, z 22.8679 593.369 133.322 wireno, peakt tpcno 286 1870.48 2 dist 187.608min T, max_T6.68752 1895.43
27-Sep-2024 09:11:36 PDT Closed output file "np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup.root"
27-Sep-2024 09:11:36 PDT Closed input file "np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 56.5534 75.7746 121.614 72.9474 16.0205 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000440688 0.00171374 0.00329509 0.00167719 0.0008183 35
produce:fembfilter:PDHDFEMBFilter 0.557065 0.591992 0.666277 0.590944 0.0195999 35
produce:wclsdatahd:WireCellToolkit 28.3468 30.1698 32.0523 30.1537 0.677064 35
produce:gaushit:GausHitFinder 0.412116 0.655422 0.927907 0.665652 0.138417 35
produce:nhitsfilter:NumberOfHitsFilter 0.000230974 0.000324757 0.000463568 0.000335446 5.25197e-05 35
produce:reco3d:SpacePointSolver 0.146004 0.812815 4.43977 0.548945 0.794147 35
produce:hitpdune:DisambigFromSpacePoints 0.208815 0.471703 1.12569 0.419371 0.194306 35
produce:pandora:StandardPandora 5.27915 14.3072 49.31 11.6808 10.021 35
produce:pandoraWriter:StandardPandora 0.0851821 0.128438 0.189427 0.127343 0.0267191 35
produce:pandoraTrack:LArPandoraTrackCreation 0.573495 1.06281 2.62949 0.893345 0.455589 35
produce:pandoraShower:LArPandoraShowerCreation 0.478247 1.1625 2.30343 1.10861 0.469476 35
produce:pandoracalo:Calorimetry 0.307357 0.525981 1.25466 0.443185 0.196738 35
produce:pandoracalonosce:Calorimetry 0.276794 0.4795 1.16101 0.413983 0.184657 35
produce:pandorapid:Chi2ParticleID 0.00115636 0.00163282 0.00274971 0.00156612 0.000354501 35
produce:pandoraShowercalo:ShowerCalorimetry 0.443241 1.03706 2.0901 0.988495 0.417295 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.431992 0.993458 2.01347 0.955777 0.396211 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0790425 0.112088 0.148791 0.110562 0.0186968 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.026126 0.0378029 0.0511554 0.0368506 0.00663927 35
produce:emtrkmichelid:EmTrackMichelId 15.6335 21.9052 31.4078 21.3094 3.99047 35
[art]:TriggerResults:TriggerResultInserter 1.414e-05 2.3787e-05 7.5731e-05 2.082e-05 1.21148e-05 35
end_path:out1:RootOutput 7.87e-06 1.12193e-05 2.9551e-05 9.71e-06 4.53052e-06 35
end_path:michelremoving:michelremoving 0.0141557 0.0582596 0.273439 0.0218901 0.067955 35
end_path:michelremovinggnocchi:michelremoving 0.0130227 0.0536522 0.244171 0.0192846 0.06315 35
end_path:calibanagnocchi:CalibAnaTree 0.194277 0.405736 0.921834 0.375168 0.155335 35
end_path:out1:RootOutput(write) 0.495135 0.716011 1.04419 0.689393 0.139086 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5001.85 MB
Peak resident set size usage (VmHWM): 2640.73 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup.root
\tHists: np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450810.0,
"core.end_time": 1727453496.0,
"core.events": [
10224,
10228,
10232,
10236,
10240,
10244,
10248,
10252,
10256,
10260,
10264,
10268,
10272,
10276,
10280,
10284,
10288,
10292,
10296,
10300,
10304,
10308,
10312,
10316,
10320,
10324,
10328,
10332,
10336,
10340,
10344,
10348,
10352,
10356,
10360
],
"core.event_count": 35,
"core.first_event_number": 10224,
"core.last_event_number": 10360,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27406
],
"core.runs_subruns": [
2740600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419_reco_stage1_reco_stage2_20240927T161136_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450810.0,
"core.end_time": 1727453496.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27406
],
"core.runs_subruns": [
2740600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027406_0073_dataflow0_datawriter_0_20240624T140419.hdf5"
}
]
} 