Jobsub ID 79880.11@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 79880.11@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3517 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-27 06:42:54 |
Site | US_BNL |
Entry | DUNE_US_BNL_sp02 |
Last heartbeat | 2024-09-27 15:32:28 |
From worker node | Hostname | spool0752.sdcc.bnl.gov |
cpuinfo | Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | False |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-27 10:40:33 |
Input files | hd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5
|
Outputting started | 2024-09-27 12:57:57 |
Output files | |
Finished | 2024-09-27 15:32:28 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ked to 5859 ticks
wclsFrameSaver: saving 63431 traces tagged "gauss"
FrameSaver: q=2.37577e+06 n=1116351 tag=gauss
wclsFrameSaver: saving 87464 traces tagged "wiener"
FrameSaver: q=2.60357e+06 n=1013852 tag=wiener
3706 hits in TPC 0
3271 hits in TPC 1
6798 hits in TPC 2
4502 hits in TPC 3
6757 hits in TPC 4
11704 hits in TPC 5
8018 hits in TPC 6
3617 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 0 XUs and 0 XVs -> 0 XUVs
C:0 T:1 7781 XUs and 3794 XVs -> 486 XUVs
C:0 T:2 19857 XUs and 25127 XVs -> 595 XUVs
C:0 T:3 659 XUs and 1018 XVs -> 48 XUVs
C:0 T:4 306 XUs and 264 XVs -> 6 XUVs
C:0 T:5 60491 XUs and 53390 XVs -> 2577 XUVs
C:0 T:6 57866 XUs and 40519 XVs -> 891 XUVs
C:0 T:7 186 XUs and 184 XVs -> 3 XUVs
4606 XUVs total
2283 collection wire objects
4606 potential space points
Neighbour search...
101108 tests to find 53940 neighbours
Iterating with no regularization...
Begin: 4.76773e+07
0 4.32723e+07
1 4.30112e+07
2 4.29764e+07
Now with regularization...
Begin: 4.09475e+07
0 4.0935e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 12:57:12 UTC Closed output file "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root"
27-Sep-2024 12:57:12 UTC Closed input file "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 100.749 165.877 264.102 163.151 34.3454 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000538059 0.00362401 0.0239628 0.00328514 0.00385815 35
produce:fembfilter:PDHDFEMBFilter 0.729295 1.06514 1.35369 1.07422 0.153744 35
produce:wclsdatahd:WireCellToolkit 63.4173 73.03 78.2809 74.5871 4.58472 35
produce:gaushit:GausHitFinder 0.497674 1.09327 1.65536 1.13127 0.27839 35
produce:nhitsfilter:NumberOfHitsFilter 0.000324876 0.000463429 0.000759292 0.000453863 9.95497e-05 35
produce:reco3d:SpacePointSolver 0.200176 1.56642 7.67583 1.09117 1.42146 35
produce:hitpdune:DisambigFromSpacePoints 0.166793 1.02894 3.35378 0.913848 0.643185 35
produce:pandora:StandardPandora 7.58888 29.6909 105.282 24.9143 17.1633 35
produce:pandoraWriter:StandardPandora 0.0895473 0.20843 0.309735 0.210146 0.0478678 35
produce:pandoraTrack:LArPandoraTrackCreation 1.04333 2.4552 6.96102 2.15708 1.0998 35
produce:pandoraShower:LArPandoraShowerCreation 0.782965 2.69987 7.52175 2.60905 1.33223 35
produce:pandoracalo:Calorimetry 0.616702 1.2454 3.4777 1.12364 0.497065 35
produce:pandoracalonosce:Calorimetry 0.451943 1.14433 3.61189 1.08173 0.527223 35
produce:pandorapid:Chi2ParticleID 0.0016243 0.00271982 0.00575391 0.00267073 0.000769182 35
produce:pandoraShowercalo:ShowerCalorimetry 0.712605 2.68046 7.76396 2.49372 1.31982 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.611379 2.58918 7.47938 2.42866 1.27611 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0717734 0.174738 0.298974 0.165747 0.0517839 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0256157 0.0615343 0.110541 0.0599231 0.0176726 35
produce:emtrkmichelid:EmTrackMichelId 20.9283 42.8652 66.9843 44.7016 10.0417 35
[art]:TriggerResults:TriggerResultInserter 2.6249e-05 4.14955e-05 0.000107466 3.9052e-05 1.37332e-05 35
end_path:out1:RootOutput 9.176e-06 1.1877e-05 3.9442e-05 1.0873e-05 4.85031e-06 35
end_path:michelremoving:michelremoving 0.0289068 0.0860079 0.490191 0.0461048 0.102767 35
end_path:michelremovinggnocchi:michelremoving 0.0197876 0.0753368 0.404076 0.0411585 0.0847207 35
end_path:calibanagnocchi:CalibAnaTree 0.423584 0.921324 2.76525 0.869824 0.399187 35
end_path:out1:RootOutput(write) 0.547479 1.06972 2.03237 1.00083 0.282907 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4950.38 MB
Peak resident set size usage (VmHWM): 2349.36 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root
\tHists: np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727435964.0,
"core.end_time": 1727441835.0,
"core.events": [
81342,
81346,
81350,
81354,
81358,
81362,
81366,
81370,
81374,
81378,
81382,
81386,
81390,
81394,
81398,
81402,
81406,
81410,
81414,
81418,
81422,
81426,
81430,
81434,
81438,
81442,
81446,
81450,
81454,
81458,
81462,
81466,
81470,
81474,
81478
],
"core.event_count": 35,
"core.first_event_number": 81342,
"core.last_event_number": 81478,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27398
],
"core.runs_subruns": [
2739800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709_reco_stage1_reco_stage2_20240927T125712_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727435964.0,
"core.end_time": 1727441835.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27398
],
"core.runs_subruns": [
2739800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027398_0581_dataflow2_datawriter_0_20240624T041709.hdf5"
}
]
}