Jobsub ID 261571.38@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 261571.38@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3389 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-24 19:53:14 |
Site | UK_Liverpool |
Entry | DUNE_UK_Liverpool_hepgrid5 |
Last heartbeat | 2024-09-24 22:43:26 |
From worker node | Hostname | r12-n04.ph.liv.ac.uk |
cpuinfo | AMD EPYC 7453 28-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 259200 (72 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-24 21:36:05 |
Input files | hd-protodune:np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341.hdf5
|
Outputting started | 2024-09-24 22:38:29 |
Output files | |
Finished | 2024-09-24 22:43:26 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
agger: tagging trace set: wiener with 50137 traces, 50137 summary
Retagger: tagging trace set: gauss with 38326 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38326 traces tagged "gauss"
FrameSaver: q=754458 n=722044 tag=gauss
wclsFrameSaver: saving 50137 traces tagged "wiener"
FrameSaver: q=807332 n=653075 tag=wiener
4022 hits in TPC 0
3452 hits in TPC 1
4345 hits in TPC 2
2466 hits in TPC 3
2107 hits in TPC 4
6206 hits in TPC 5
3151 hits in TPC 6
2020 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 320 XUs and 285 XVs -> 16 XUVs
C:0 T:2 20565 XUs and 19241 XVs -> 736 XUVs
C:0 T:3 225 XUs and 162 XVs -> 2 XUVs
C:0 T:4 86 XUs and 83 XVs -> 5 XUVs
C:0 T:5 30758 XUs and 30845 XVs -> 1037 XUVs
C:0 T:6 11115 XUs and 10547 XVs -> 275 XUVs
C:0 T:7 60 XUs and 101 XVs -> 1 XUVs
2072 XUVs total
711 collection wire objects
2072 potential space points
Neighbour search...
194520 tests to find 98968 neighbours
Iterating with no regularization...
Begin: 1.646e+06
0 1.55862e+06
1 1.54829e+06
2 1.54669e+06
3 1.54609e+06
Now with regularization...
Begin: 1.44939e+06
0 1.44903e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
24-Sep-2024 23:38:18 BST Closed output file "np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup.root"
24-Sep-2024 23:38:18 BST Closed input file "np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 46.2954 69.4619 122.904 68.1152 15.7793 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000366508 0.00252473 0.00395517 0.00266076 0.00095865 30
produce:fembfilter:PDHDFEMBFilter 0.452488 0.485335 0.545619 0.480155 0.0228186 30
produce:wclsdatahd:WireCellToolkit 26.5994 29.4543 32.2023 29.5017 1.3813 30
produce:gaushit:GausHitFinder 0.21432 0.456812 0.855793 0.452012 0.138797 30
produce:nhitsfilter:NumberOfHitsFilter 0.000140744 0.000302881 0.000716836 0.000286307 0.00010394 30
produce:reco3d:SpacePointSolver 0.0318836 0.825832 2.49403 0.720642 0.616383 30
produce:hitpdune:DisambigFromSpacePoints 0.0434763 0.333297 1.08008 0.289509 0.200884 30
produce:pandora:StandardPandora 2.33592 8.01731 21.5645 7.27998 3.96306 30
produce:pandoraWriter:StandardPandora 0.0585219 0.111016 0.183302 0.113286 0.0293508 30
produce:pandoraTrack:LArPandoraTrackCreation 0.276871 1.13633 3.27895 0.974582 0.648573 30
produce:pandoraShower:LArPandoraShowerCreation 0.24767 1.43835 6.45617 1.20141 1.20648 30
produce:pandoracalo:Calorimetry 0.161002 0.545545 1.50834 0.506182 0.280801 30
produce:pandoracalonosce:Calorimetry 0.152518 0.511832 1.47084 0.463294 0.271424 30
produce:pandorapid:Chi2ParticleID 0.000962007 0.00145499 0.00296211 0.00133775 0.000399639 30
produce:pandoraShowercalo:ShowerCalorimetry 0.219182 1.26311 5.47787 1.10693 0.974077 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.201299 1.27747 5.49493 1.10558 0.996058 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0386485 0.0885307 0.147139 0.0883067 0.0249609 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0164967 0.0331664 0.0614118 0.0321212 0.0101406 30
produce:emtrkmichelid:EmTrackMichelId 10.9503 22.2704 38.5665 22.169 5.98816 30
[art]:TriggerResults:TriggerResultInserter 1.9617e-05 4.42784e-05 9.9196e-05 4.60565e-05 1.75047e-05 30
end_path:out1:RootOutput 7.063e-06 1.32317e-05 3.4004e-05 1.21175e-05 5.6414e-06 30
end_path:michelremoving:michelremoving 0.0160019 0.0573819 0.162387 0.0297182 0.0467839 30
end_path:michelremovinggnocchi:michelremoving 0.0142912 0.0534224 0.153547 0.0295799 0.0437125 30
end_path:calibanagnocchi:CalibAnaTree 0.150328 0.412897 1.51535 0.372603 0.246102 30
end_path:out1:RootOutput(write) 0.244073 0.517175 0.929113 0.505018 0.142086 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4965.73 MB
Peak resident set size usage (VmHWM): 2370.79 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup.root
\tHists: np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727215385.0,
"core.end_time": 1727217499.0,
"core.events": [
575277,
575285,
575293,
575301,
575317,
575325,
575333,
575341,
575349,
575357,
575365,
575373,
575381,
575389,
575397,
575405,
575413,
575421,
575429,
575437,
575445,
575453,
575461,
575469,
575477,
575485,
575493,
575501,
575509,
575517
],
"core.event_count": 30,
"core.first_event_number": 575277,
"core.last_event_number": 575517,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29006
],
"core.runs_subruns": [
2900600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341_reco_stage1_reco_stage2_20240924T223818_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727215385.0,
"core.end_time": 1727217499.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29006
],
"core.runs_subruns": [
2900600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029006_2397_dataflow5_datawriter_0_20240901T054341.hdf5"
}
]
}