Jobsub ID 244283.3@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 244283.3@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 2865 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-08-18 01:20:18 |
Site | NL_NIKHEF |
Entry | VIRGO_NL_NIKHEF_brug |
Last heartbeat | 2024-08-18 02:52:57 |
From worker node | Hostname | wn-sate-043.farm.nikhef.nl |
cpuinfo | AMD EPYC 7551P 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 129600 (36 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-08-18 01:22:11 |
Input files | hd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5
|
Outputting started | 2024-08-18 02:51:42 |
Output files | |
Finished | 2024-08-18 02:52:57 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
auss
wclsFrameSaver: saving 121501 traces tagged "wiener"
FrameSaver: q=2.16225e+06 n=1438610 tag=wiener
9232 hits in TPC 0
6556 hits in TPC 1
8573 hits in TPC 2
3437 hits in TPC 3
5510 hits in TPC 4
9432 hits in TPC 5
13665 hits in TPC 6
7924 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3930 XUs and 3525 XVs -> 307 XUVs
C:0 T:2 85854 XUs and 84205 XVs -> 2489 XUVs
C:0 T:3 965 XUs and 1753 XVs -> 61 XUVs
C:0 T:4 30 XUs and 22 XVs -> 0 XUVs
C:0 T:5 35094 XUs and 61689 XVs -> 2299 XUVs
C:0 T:6 112807 XUs and 121569 XVs -> 4304 XUVs
C:0 T:7 602 XUs and 495 XVs -> 4 XUVs
9464 XUVs total
3605 collection wire objects
9464 potential space points
Neighbour search...
416794 tests to find 246762 neighbours
Iterating with no regularization...
Begin: 2.55577e+07
0 2.34962e+07
1 2.3387e+07
2 2.33732e+07
Now with regularization...
Begin: 2.22339e+07
0 2.22279e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
18-Aug-2024 04:51:33 CEST Closed output file "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root"
18-Aug-2024 04:51:33 CEST Closed input file "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 93.1732 138.205 238.283 130.311 31.8106 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000583927 0.00273424 0.00507532 0.00297086 0.00134342 30
produce:fembfilter:PDHDFEMBFilter 0.676534 0.708396 1.37185 0.682754 0.123601 30
produce:wclsdatahd:WireCellToolkit 36.7212 41.0299 49.7804 38.7809 4.27569 30
produce:gaushit:GausHitFinder 0.579228 0.866188 1.27309 0.859762 0.168915 30
produce:nhitsfilter:NumberOfHitsFilter 0.000324119 0.000415592 0.00058027 0.000404555 7.17208e-05 30
produce:reco3d:SpacePointSolver 0.244204 1.35178 4.01832 1.09477 0.908336 30
produce:hitpdune:DisambigFromSpacePoints 0.258038 0.654891 1.75759 0.638991 0.29832 30
produce:pandora:StandardPandora 8.51826 24.5504 66.6201 22.0563 12.3352 30
produce:pandoraWriter:StandardPandora 0.124358 0.198956 0.316671 0.203084 0.0408757 30
produce:pandoraTrack:LArPandoraTrackCreation 0.697176 2.67763 7.04169 2.3992 1.26537 30
produce:pandoraShower:LArPandoraShowerCreation 0.701168 3.31771 8.95549 2.90134 1.73234 30
produce:pandoracalo:Calorimetry 0.390093 1.20119 3.45492 1.04184 0.59127 30
produce:pandoracalonosce:Calorimetry 0.3555 1.14492 3.32819 1.04962 0.571132 30
produce:pandorapid:Chi2ParticleID 0.00172403 0.00232507 0.00327219 0.00223888 0.000397474 30
produce:pandoraShowercalo:ShowerCalorimetry 0.663614 2.66857 8.52475 2.40123 1.56426 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.631946 2.54214 7.7726 2.25105 1.43891 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.109176 0.171724 0.252566 0.165564 0.037145 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0380618 0.0614101 0.094541 0.0583936 0.0144737 30
produce:emtrkmichelid:EmTrackMichelId 35.0841 52.7104 79.7271 52.9858 11.0177 30
[art]:TriggerResults:TriggerResultInserter 3.8642e-05 5.15304e-05 7.4981e-05 5.0961e-05 6.70505e-06 30
end_path:out1:RootOutput 8.606e-06 1.47248e-05 2.2342e-05 1.48325e-05 3.05169e-06 30
end_path:michelremoving:michelremoving 0.0269531 0.116644 0.334926 0.122405 0.0814178 30
end_path:michelremovinggnocchi:michelremoving 0.0230131 0.111142 0.332964 0.115345 0.0835403 30
end_path:calibanagnocchi:CalibAnaTree 0.363347 0.842803 2.37571 0.732813 0.418253 30
end_path:out1:RootOutput(write) 0.685067 1.07039 1.64874 1.06871 0.225531 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4990.66 MB
Peak resident set size usage (VmHWM): 2673.41 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root
\tHists: np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root
Ran successfully
{
"name": "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1723945300.0,
"core.end_time": 1723949494.0,
"core.events": [
28308,
28316,
28324,
28348,
28356,
28364,
28372,
28380,
28388,
28396,
28404,
28412,
28420,
28428,
28436,
28444,
28452,
28460,
28468,
28476,
28484,
28492,
28500,
28508,
28516,
28532,
28540,
28548,
28556,
28564
],
"core.event_count": 30,
"core.first_event_number": 28308,
"core.last_event_number": 28564,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28759
],
"core.runs_subruns": [
2875900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030_reco_stage1_reco_stage2_20240818T025133_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1723945300.0,
"core.end_time": 1723949494.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28759
],
"core.runs_subruns": [
2875900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028759_0118_dataflow4_datawriter_0_20240818T000030.hdf5"
}
]
}