Jobsub ID 79974.111@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79974.111@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3511 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 08:27:58 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:40:35 |
| From worker node | Hostname | mh-7763-1.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 13:12:23 |
| Input files | hd-protodune:np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11604s) |
| CPU time | 1h (4028s = 34%) |
| Outputting started | 2024-09-27 16:25:49 |
| Output files | |
| Finished | 2024-09-27 16:40:35 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ew 0: 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.91467e-05 2.92063e-05
----view 1: 0.00707459 0.00385255 0.00064218 0.00517017 0.0029096 0.00193799 0.00184292 0.00279981 0.00258636 0.00230551 0.00288302
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.91467e-05 2.92063e-05 2.92063e-05
----view 1: 0.00385255 0.00064218 0.00517017 0.0029096 0.00193799 0.00184292 0.00279981 0.00258636 0.00230551 0.00288302 0.00304693
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.92063e-05 2.91467e-05 2.92063e-05 2.92063e-05 2.92063e-05
----view 1: 0.00064218 0.00517017 0.0029096 0.00193799 0.00184292 0.00279981 0.00258636 0.00230551 0.00288302 0.00304693 0.0025714
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:25:42 PDT Closed output file "np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup.root"
27-Sep-2024 09:25:42 PDT Closed input file "np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 30.551 96.9169 179.742 94.2936 27.4141 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000500967 0.0019497 0.0051238 0.00149697 0.0012396 35
produce:fembfilter:PDHDFEMBFilter 0.518831 0.543657 0.577311 0.543996 0.0132476 35
produce:wclsdatahd:WireCellToolkit 26.1565 27.674 33.211 27.214 1.43729 35
produce:gaushit:GausHitFinder 0.433398 0.664081 1.03482 0.644388 0.125354 35
produce:nhitsfilter:NumberOfHitsFilter 0.000241748 0.000333016 0.000509887 0.000321358 5.9954e-05 35
produce:reco3d:SpacePointSolver 0.396594 1.07926 2.59614 1.0029 0.547022 34
produce:hitpdune:DisambigFromSpacePoints 0.277745 0.644842 1.43739 0.59242 0.271252 34
produce:pandora:StandardPandora 9.03921 30.1643 85.2164 27.8177 16.4534 34
produce:pandoraWriter:StandardPandora 0.0963797 0.143718 0.208839 0.139523 0.0285044 34
produce:pandoraTrack:LArPandoraTrackCreation 0.757942 1.84617 3.88025 1.58913 0.795498 34
produce:pandoraShower:LArPandoraShowerCreation 0.886857 1.83173 4.8958 1.69893 0.85636 34
produce:pandoracalo:Calorimetry 0.479697 0.930583 1.8466 0.791508 0.351284 34
produce:pandoracalonosce:Calorimetry 0.435967 0.882364 1.75987 0.736928 0.340147 34
produce:pandorapid:Chi2ParticleID 0.001266 0.00186248 0.00342145 0.00181325 0.00042055 34
produce:pandoraShowercalo:ShowerCalorimetry 0.875905 1.7703 3.69051 1.47882 0.775474 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.848065 1.67559 3.51728 1.40187 0.723493 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0626852 0.101837 0.14692 0.0992441 0.020676 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0215408 0.0351332 0.0534237 0.034157 0.00717342 34
produce:emtrkmichelid:EmTrackMichelId 17.8687 27.2453 39.4094 27.4756 4.96713 34
[art]:TriggerResults:TriggerResultInserter 1.8349e-05 2.73388e-05 8.8309e-05 2.428e-05 1.22165e-05 35
end_path:out1:RootOutput 3.38e-06 6.926e-06 2.782e-05 6.36e-06 4.19733e-06 35
end_path:michelremoving:michelremoving 1.904e-05 0.0530792 0.151882 0.026506 0.0479683 35
end_path:michelremovinggnocchi:michelremoving 5.24e-06 0.0493479 0.145059 0.0221421 0.0474271 35
end_path:calibanagnocchi:CalibAnaTree 5.51e-06 0.676541 1.35683 0.602909 0.300056 35
end_path:out1:RootOutput(write) 0.343431 0.725233 1.02117 0.710916 0.149115 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5053.5 MB
Peak resident set size usage (VmHWM): 2678.89 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup.root
\tHists: np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450921.0,
"core.end_time": 1727454343.0,
"core.events": [
19486,
19490,
19494,
19498,
19502,
19506,
19510,
19514,
19518,
19522,
19526,
19530,
19534,
19538,
19542,
19546,
19550,
19554,
19558,
19562,
19566,
19570,
19574,
19578,
19582,
19586,
19590,
19594,
19598,
19602,
19606,
19610,
19614,
19618,
19622
],
"core.event_count": 35,
"core.first_event_number": 19486,
"core.last_event_number": 19622,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27333
],
"core.runs_subruns": [
2733300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903_reco_stage1_reco_stage2_20240927T162542_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450921.0,
"core.end_time": 1727454343.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27333
],
"core.runs_subruns": [
2733300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027333_0139_dataflow2_datawriter_0_20240621T023903.hdf5"
}
]
} 