Jobsub ID 79974.107@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79974.107@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3511 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 08:27:58 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:55:00 |
| From worker node | Hostname | mh-7763-1.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 13:32:41 |
| Input files | hd-protodune:np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11066s) |
| CPU time | 1h (3748s = 33%) |
| Outputting started | 2024-09-27 16:37:08 |
| Output files | |
| Finished | 2024-09-27 16:55:00 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s to find 155414 neighbours
Iterating with no regularization...
Begin: 6.73902e+07
0 6.04966e+07
1 6.00927e+07
2 6.00115e+07
3 5.99934e+07
Now with regularization...
Begin: 5.71908e+07
0 5.71704e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.26498e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.26498e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.26498e-05 2.25902e-05
----view 1: 0.00881118 0.00157696 0.00294828 0.000294447 8.85725e-05 8.85725e-05 0.00183511 0.00449795 0.000187337 0.000160933 0.000160933 0.00116736 0.000654995
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 2.26498e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.26498e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.25902e-05 2.26498e-05 2.25902e-05
----view 1: 0.00881118 0.00157696 0.00294828 0.000294447 8.85725e-05 8.85725e-05 0.00183511 0.00449795 0.000187337 0.000160933 0.000160933 0.00116736 0.000654995
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:37:01 PDT Closed output file "np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup.root"
27-Sep-2024 09:37:01 PDT Closed input file "np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 52.3643 88.8499 162.199 86.8458 21.7572 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000494576 0.00198346 0.00456166 0.00186511 0.00116279 35
produce:fembfilter:PDHDFEMBFilter 0.492332 0.524723 0.581836 0.522719 0.0168603 35
produce:wclsdatahd:WireCellToolkit 26.3331 27.8563 33.5468 27.2421 1.47625 35
produce:gaushit:GausHitFinder 0.387111 0.623875 0.916539 0.613046 0.123734 35
produce:nhitsfilter:NumberOfHitsFilter 0.000209468 0.000326068 0.000518566 0.000307077 6.30509e-05 35
produce:reco3d:SpacePointSolver 0.204628 1.04479 3.09937 1.06037 0.616389 35
produce:hitpdune:DisambigFromSpacePoints 0.197701 0.570503 1.27285 0.538496 0.228934 35
produce:pandora:StandardPandora 5.25021 22.7262 68.9377 22.0736 12.9034 35
produce:pandoraWriter:StandardPandora 0.0723472 0.139506 0.225255 0.136557 0.0309168 35
produce:pandoraTrack:LArPandoraTrackCreation 0.700261 1.68296 4.15583 1.37628 0.780521 35
produce:pandoraShower:LArPandoraShowerCreation 0.755718 1.82088 4.57721 1.63142 0.800929 35
produce:pandoracalo:Calorimetry 0.360134 0.879506 2.25824 0.723513 0.402868 35
produce:pandoracalonosce:Calorimetry 0.332007 0.826667 1.90388 0.667693 0.365074 35
produce:pandorapid:Chi2ParticleID 0.00128002 0.0019329 0.00430399 0.00179348 0.000600076 35
produce:pandoraShowercalo:ShowerCalorimetry 0.651201 1.73974 3.55926 1.69856 0.686846 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.620498 1.64818 3.37714 1.59038 0.648687 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0560491 0.099902 0.134782 0.10191 0.0204563 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.020798 0.0345947 0.0471046 0.033877 0.00683661 35
produce:emtrkmichelid:EmTrackMichelId 14.6301 25.0693 39.1913 24.8566 5.09203 35
[art]:TriggerResults:TriggerResultInserter 1.6519e-05 3.19321e-05 8.0929e-05 2.7539e-05 1.28854e-05 35
end_path:out1:RootOutput 3.86e-06 6.97254e-06 2.901e-05 6.19e-06 5.26842e-06 35
end_path:michelremoving:michelremoving 0.0124447 0.0465783 0.245027 0.0240139 0.0509795 35
end_path:michelremovinggnocchi:michelremoving 0.0122872 0.0440562 0.244001 0.0211658 0.0512012 35
end_path:calibanagnocchi:CalibAnaTree 0.232408 0.642435 1.57 0.509461 0.28791 35
end_path:out1:RootOutput(write) 0.396486 0.693373 1.02189 0.710775 0.138957 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5083.05 MB
Peak resident set size usage (VmHWM): 2702.46 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup.root
\tHists: np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451883.0,
"core.end_time": 1727455022.0,
"core.events": [
7842,
7846,
7850,
7854,
7858,
7862,
7866,
7870,
7874,
7878,
7882,
7886,
7890,
7894,
7898,
7902,
7906,
7910,
7914,
7918,
7922,
7926,
7930,
7934,
7938,
7942,
7946,
7950,
7954,
7958,
7962,
7966,
7970,
7974,
7978
],
"core.event_count": 35,
"core.first_event_number": 7842,
"core.last_event_number": 7978,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908_reco_stage1_reco_stage2_20240927T163701_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451883.0,
"core.end_time": 1727455022.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0056_dataflow2_datawriter_0_20240621T033908.hdf5"
}
]
} 