Jobsub ID 264942.56@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 264942.56@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3511 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-27 12:54:00 |
Site | US_UConn-HPC |
Entry | GLUEX_US_UConn-HPC_osgce |
Last heartbeat | 2024-09-27 17:04:03 |
From worker node | Hostname | cn432 |
cpuinfo | AMD EPYC 7452 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 172800 (48 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-27 12:56:06 |
Input files | hd-protodune:np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746.hdf5
|
Outputting started | 2024-09-27 16:28:52 |
Output files | |
Finished | 2024-09-27 17:04:03 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
-view 0: 0.00015831 0.000460207 6.10352e-05 0.000100136 0.000167489 0.0012995 0.00134474 0.000386596 0.000362992 0.000125051 9.58443e-05
----view 1: 5.6088e-05 5.61476e-05 5.6088e-05 5.6088e-05 5.6088e-05 5.6088e-05 5.6088e-05 5.61476e-05 5.6088e-05 5.6088e-05 0.00041312
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000456274 0.000136852 0.00131762 0.000150979 0.000322759 0.000160754 0.000154138 0.000154138 0.000154197 0.00235218 0.00111908
----view 1: 0.000169575 0.000133514 0.000157475 5.1558e-05 0.000158072 2.43187e-05 2.43783e-05 2.43187e-05 2.43783e-05 2.43187e-05 3.32594e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000379443 0.000379443 0.000379503 0.000379503 0.000379443 0.000379443 0.000379503 0.000379503 0.000379443 0.000379503 0.000379443
----view 1: 0.125539 0.0329318 0.0243626 0.0143352 0.0683765 0.0379248 0.109237 0.0455092 0.0360053 0.0815306 0.0282273
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 12:28:24 EDT Closed output file "np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup.root"
27-Sep-2024 12:28:24 EDT Closed input file "np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 51.3996 130.605 237.981 135.956 45.0991 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000433287 0.00283588 0.00601616 0.00229416 0.00170926 35
produce:fembfilter:PDHDFEMBFilter 0.550574 0.648998 0.925336 0.604099 0.0957875 35
produce:wclsdatahd:WireCellToolkit 26.7354 34.0181 44.8592 32.9557 5.09322 35
produce:gaushit:GausHitFinder 0.407963 0.863828 1.40147 0.861852 0.255153 35
produce:nhitsfilter:NumberOfHitsFilter 0.000243279 0.000556636 0.00194769 0.000501557 0.000297377 35
produce:reco3d:SpacePointSolver 0.126864 1.7176 4.92734 1.55618 1.08228 35
produce:hitpdune:DisambigFromSpacePoints 0.16683 0.920523 1.78097 0.954162 0.425211 35
produce:pandora:StandardPandora 4.87014 43.184 120.718 36.5001 27.5075 35
produce:pandoraWriter:StandardPandora 0.0797261 0.213428 0.349063 0.216975 0.0725274 35
produce:pandoraTrack:LArPandoraTrackCreation 0.588399 2.96138 7.33581 3.14283 1.57468 35
produce:pandoraShower:LArPandoraShowerCreation 0.601639 2.86807 7.72131 2.76059 1.69599 35
produce:pandoracalo:Calorimetry 0.300533 1.24153 2.89772 1.28838 0.592173 35
produce:pandoracalonosce:Calorimetry 0.270285 1.18089 2.91594 1.23249 0.587283 35
produce:pandorapid:Chi2ParticleID 0.00107069 0.00239748 0.0041678 0.00220128 0.000843458 35
produce:pandoraShowercalo:ShowerCalorimetry 0.529836 2.35846 5.65345 2.20381 1.34691 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.511346 2.26506 5.23267 2.07393 1.2809 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0601809 0.155236 0.294172 0.149916 0.0531812 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0228447 0.0544732 0.0982987 0.0539415 0.0187383 35
produce:emtrkmichelid:EmTrackMichelId 13.9487 33.5751 50.6466 35.6398 10.4772 35
[art]:TriggerResults:TriggerResultInserter 1.7112e-05 4.16456e-05 0.000157888 2.9546e-05 3.07258e-05 35
end_path:out1:RootOutput 1.076e-05 1.67937e-05 4.8902e-05 1.3176e-05 8.79516e-06 35
end_path:michelremoving:michelremoving 0.0142617 0.0895449 0.574442 0.036289 0.108181 35
end_path:michelremovinggnocchi:michelremoving 0.0115639 0.0857693 0.590506 0.0338929 0.111472 35
end_path:calibanagnocchi:CalibAnaTree 0.215589 1.01043 2.26212 1.00543 0.513136 35
end_path:out1:RootOutput(write) 0.461987 1.02008 1.55977 1.06821 0.294423 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5080.64 MB
Peak resident set size usage (VmHWM): 2726.03 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup.root
\tHists: np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449878.0,
"core.end_time": 1727454504.0,
"core.events": [
54743,
54747,
54751,
54755,
54759,
54763,
54767,
54771,
54775,
54779,
54783,
54787,
54791,
54795,
54799,
54803,
54807,
54811,
54815,
54819,
54823,
54827,
54831,
54835,
54839,
54843,
54847,
54851,
54855,
54859,
54863,
54867,
54871,
54875,
54879
],
"core.event_count": 35,
"core.first_event_number": 54743,
"core.last_event_number": 54879,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746_reco_stage1_reco_stage2_20240927T162824_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449878.0,
"core.end_time": 1727454504.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0391_dataflow3_datawriter_0_20240621T004746.hdf5"
}
]
}