Jobsub ID 80058.28@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80058.28@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3493 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:44:42 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:41:35 |
| From worker node | Hostname | mh-7662-7.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:30:14 |
| Input files | hd-protodune:np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6098s) |
| CPU time | 1h (4750s = 77%) |
| Outputting started | 2024-09-27 16:11:53 |
| Output files | |
| Finished | 2024-09-27 16:41:35 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
0 0 0 0 0
----view 1: 1.72257e-05 1.72853e-05 1.72257e-05 1.72257e-05 0.0002864 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 0 0
----view 1: 1.72853e-05 1.72257e-05 1.72257e-05 0.0002864 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 0 0
----view 1: 1.72257e-05 1.72257e-05 0.0002864 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66704e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0 0 0 0 0 0 0 0 0 0 0 0 0
----view 1: 1.72257e-05 0.0002864 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66108e-05 4.66704e-05 4.66108e-05 4.66704e-05 4.66108e-05
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:11:44 PDT Closed output file "np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup.root"
27-Sep-2024 09:11:44 PDT Closed input file "np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 40.4736 115.214 243.856 103.321 43.7259 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000623026 0.00272523 0.0051172 0.00273721 0.00128837 35
produce:fembfilter:PDHDFEMBFilter 0.60263 0.640845 0.735356 0.636539 0.0265932 35
produce:wclsdatahd:WireCellToolkit 29.4934 31.7818 35.7967 31.263 1.60106 35
produce:gaushit:GausHitFinder 0.498324 0.873338 2.93897 0.791139 0.398782 35
produce:nhitsfilter:NumberOfHitsFilter 0.000287467 0.000487025 0.00162443 0.000434169 0.000216562 35
produce:reco3d:SpacePointSolver 0.210561 1.78929 5.61216 1.42681 1.27944 34
produce:hitpdune:DisambigFromSpacePoints 0.268416 0.811633 1.90584 0.749544 0.398181 34
produce:pandora:StandardPandora 8.70664 38.3534 138.041 26.6793 30.5969 34
produce:pandoraWriter:StandardPandora 0.10434 0.191308 0.319247 0.191073 0.0484747 34
produce:pandoraTrack:LArPandoraTrackCreation 0.625985 2.28789 5.63327 1.98952 1.16974 34
produce:pandoraShower:LArPandoraShowerCreation 0.705807 2.40449 6.89325 2.2667 1.22632 34
produce:pandoracalo:Calorimetry 0.340408 1.0382 2.19895 0.925177 0.479528 34
produce:pandoracalonosce:Calorimetry 0.302645 0.971375 2.16886 0.875561 0.465085 34
produce:pandorapid:Chi2ParticleID 0.001251 0.00219876 0.00359411 0.00211085 0.000520663 34
produce:pandoraShowercalo:ShowerCalorimetry 0.629014 2.03135 5.2212 1.91344 0.953978 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.625563 1.94987 4.90615 1.82837 0.896945 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0916079 0.14833 0.254376 0.146381 0.0319859 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0296364 0.0521961 0.0863054 0.0509819 0.0115215 34
produce:emtrkmichelid:EmTrackMichelId 18.3695 30.2015 47.484 30.1056 6.87677 34
[art]:TriggerResults:TriggerResultInserter 1.825e-05 3.24173e-05 8.7312e-05 2.826e-05 1.30906e-05 35
end_path:out1:RootOutput 5.651e-06 9.89754e-06 2.753e-05 9.01e-06 3.69265e-06 35
end_path:michelremoving:michelremoving 2.272e-05 0.0578276 0.270547 0.029512 0.0600706 35
end_path:michelremovinggnocchi:michelremoving 5.32e-06 0.0551168 0.262029 0.0267422 0.0589213 35
end_path:calibanagnocchi:CalibAnaTree 4.8e-06 0.787173 2.09233 0.688611 0.431604 35
end_path:out1:RootOutput(write) 0.576353 0.990477 1.67423 0.985964 0.227229 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5149.04 MB
Peak resident set size usage (VmHWM): 2790.81 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup.root
\tHists: np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449431.0,
"core.end_time": 1727453505.0,
"core.events": [
708,
712,
716,
720,
724,
728,
732,
736,
740,
744,
748,
752,
756,
760,
764,
768,
772,
776,
780,
784,
788,
792,
796,
800,
804,
808,
812,
816,
820,
824,
828,
832,
836,
840,
844
],
"core.event_count": 35,
"core.first_event_number": 708,
"core.last_event_number": 844,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308_reco_stage1_reco_stage2_20240927T161144_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449431.0,
"core.end_time": 1727453505.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27311
],
"core.runs_subruns": [
2731100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027311_0005_dataflow0_datawriter_0_20240620T044308.hdf5"
}
]
} 