Jobsub ID 70381.6@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 70381.6@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3196 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-12 15:51:34 |
Site | UK_Durham |
Entry | DUNE_UK_SGridDurham_ce3 |
Last heartbeat | 2024-09-12 18:17:09 |
From worker node | Hostname | n250.dur.scotgrid.ac.uk |
cpuinfo | AMD EPYC 7763 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-12 16:59:59 |
Input files | hd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5
|
Outputting started | 2024-09-12 18:14:55 |
Output files | |
Finished | 2024-09-12 18:17:09 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
: tagging trace set: gauss with 23305 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 23305 traces tagged "gauss"
FrameSaver: q=515907 n=447533 tag=gauss
wclsFrameSaver: saving 30855 traces tagged "wiener"
FrameSaver: q=564259 n=416640 tag=wiener
2529 hits in TPC 0
1627 hits in TPC 1
1265 hits in TPC 2
898 hits in TPC 3
3345 hits in TPC 4
4818 hits in TPC 5
1596 hits in TPC 6
510 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 172 XUs and 175 XVs -> 38 XUVs
C:0 T:2 775 XUs and 1056 XVs -> 103 XUVs
C:0 T:3 85 XUs and 164 XVs -> 1 XUVs
C:0 T:4 322 XUs and 530 XVs -> 14 XUVs
C:0 T:5 21142 XUs and 26180 XVs -> 2987 XUVs
C:0 T:6 1362 XUs and 1507 XVs -> 81 XUVs
C:0 T:7 14 XUs and 10 XVs -> 0 XUVs
3224 XUVs total
895 collection wire objects
3224 potential space points
Neighbour search...
134558 tests to find 81510 neighbours
Iterating with no regularization...
Begin: 5.75002e+06
0 4.92548e+06
1 4.84005e+06
2 4.82653e+06
3 4.82299e+06
Now with regularization...
Begin: 4.36654e+06
0 4.36447e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
12-Sep-2024 19:14:48 BST Closed output file "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root"
12-Sep-2024 19:14:48 BST Closed input file "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 40.24 61.2721 108.317 60.5492 12.8371 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000436394 0.00130994 0.00260981 0.00117433 0.000553087 30
produce:fembfilter:PDHDFEMBFilter 0.445131 0.479036 0.666262 0.451034 0.0696958 30
produce:wclsdatahd:WireCellToolkit 24.6934 26.4052 34.6484 25.4652 2.59549 30
produce:gaushit:GausHitFinder 0.209145 0.457136 0.766604 0.440273 0.126786 30
produce:nhitsfilter:NumberOfHitsFilter 0.000138692 0.000243858 0.000341955 0.000236532 4.40609e-05 30
produce:reco3d:SpacePointSolver 0.145799 0.627948 1.85003 0.501552 0.437971 30
produce:hitpdune:DisambigFromSpacePoints 0.0732958 0.34564 0.888871 0.334977 0.182044 30
produce:pandora:StandardPandora 3.25578 9.32915 46.1189 7.74114 7.37609 30
produce:pandoraWriter:StandardPandora 0.0395017 0.0968108 0.15427 0.0986016 0.0268707 30
produce:pandoraTrack:LArPandoraTrackCreation 0.160168 0.715171 1.56354 0.68905 0.277149 30
produce:pandoraShower:LArPandoraShowerCreation 0.177286 0.863062 1.73445 0.880669 0.354205 30
produce:pandoracalo:Calorimetry 0.117791 0.401786 0.796102 0.398501 0.142091 30
produce:pandoracalonosce:Calorimetry 0.0941988 0.365073 0.717851 0.361905 0.129202 30
produce:pandorapid:Chi2ParticleID 0.000760315 0.00125959 0.00186004 0.00119049 0.00025668 30
produce:pandoraShowercalo:ShowerCalorimetry 0.163326 0.839951 1.62653 0.870183 0.337833 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.161054 0.800943 1.52204 0.835533 0.323328 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0412766 0.0860888 0.194815 0.0856703 0.0277255 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0142187 0.0297764 0.0621477 0.0308264 0.00952323 30
produce:emtrkmichelid:EmTrackMichelId 8.61781 18.3514 27.137 18.5043 4.2356 30
[art]:TriggerResults:TriggerResultInserter 1.4428e-05 2.04965e-05 7.4551e-05 1.8099e-05 1.05255e-05 30
end_path:out1:RootOutput 6.492e-06 9.2192e-06 2.7983e-05 8.571e-06 3.71935e-06 30
end_path:michelremoving:michelremoving 0.0112758 0.0574196 0.263496 0.0199558 0.0635171 30
end_path:michelremovinggnocchi:michelremoving 0.0100542 0.0554871 0.260946 0.0188706 0.0633162 30
end_path:calibanagnocchi:CalibAnaTree 0.0867417 0.317826 0.560874 0.32266 0.113841 30
end_path:out1:RootOutput(write) 0.265837 0.564538 0.784898 0.589379 0.125822 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4920.44 MB
Peak resident set size usage (VmHWM): 2586.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root
\tHists: np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root
Ran successfully
{
"name": "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726163019.0,
"core.end_time": 1726164889.0,
"core.events": [
205926,
205934,
205942,
205950,
205958,
205966,
205974,
205982,
205990,
205998,
206006,
206014,
206022,
206030,
206038,
206046,
206054,
206062,
206070,
206078,
206086,
206094,
206102,
206110,
206118,
206126,
206134,
206142,
206150,
206158
],
"core.event_count": 30,
"core.first_event_number": 205926,
"core.last_event_number": 206158,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28563
],
"core.runs_subruns": [
2856300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317_reco_stage1_reco_stage2_20240912T181448_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726163019.0,
"core.end_time": 1726164889.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28563
],
"core.runs_subruns": [
2856300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028563_0858_dataflow6_datawriter_0_20240808T015317.hdf5"
}
]
}