Jobsub ID 265388.1@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 265388.1@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3511 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-27 20:42:55 | |
| Site | US_BNL | |
| Entry | DUNE_US_BNL_sp02 | |
| Last heartbeat | 2024-09-27 22:17:34 | |
| From worker node | Hostname | spool1569.sdcc.bnl.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | False | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-27 20:44:15 | |
| Input files | hd-protodune:np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 0m (0s) | |
| CPU time | 0m (0s = 0%) | |
| Outputting started | 2024-09-27 22:15:39 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup.root hd-protodune-det-reco:np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup_hists.root | |
| Finished | 2024-09-27 22:17:34 | |
| Saved logs | justin-logs:265388.1-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
bour search...
438857 tests to find 212462 neighbours
Iterating with no regularization...
Begin: 6.55133e+07
0 6.02758e+07
1 5.97455e+07
2 5.96945e+07
Now with regularization...
Begin: 5.75119e+07
0 5.7492e+07
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/AlmaLinux-9.4/build/larpandoracontent/v04_09_00-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0087, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 22:15:29 UTC Closed output file "np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup.root"
27-Sep-2024 22:15:29 UTC Closed input file "np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 81.6297 130.791 366.62 117.133 50.3523 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000337442 0.00138825 0.0035647 0.00094535 0.00095419 35
produce:fembfilter:PDHDFEMBFilter 0.635534 0.658766 0.696061 0.655709 0.0117109 35
produce:wclsdatahd:WireCellToolkit 42.118 46.1776 83.1545 45.0428 6.47852 35
produce:gaushit:GausHitFinder 0.603264 0.924509 1.36706 0.879751 0.185799 35
produce:nhitsfilter:NumberOfHitsFilter 0.000357519 0.000499009 0.000751929 0.000490283 9.14387e-05 35
produce:reco3d:SpacePointSolver 0.349408 1.9298 8.12241 1.41352 1.72463 35
produce:hitpdune:DisambigFromSpacePoints 0.281951 0.719957 1.77353 0.659571 0.334981 35
produce:pandora:StandardPandora 12.41 43.0555 221.902 36.8217 36.4096 35
produce:pandoraWriter:StandardPandora 0.118847 0.194043 0.326721 0.180386 0.0424217 35
produce:pandoraTrack:LArPandoraTrackCreation 1.61322 3.50632 12.8099 2.7916 2.13288 35
produce:pandoraShower:LArPandoraShowerCreation 1.38261 3.71249 13.9295 2.81063 2.3083 35
produce:pandoracalo:Calorimetry 0.702224 1.40188 4.25467 1.1017 0.723825 35
produce:pandoracalonosce:Calorimetry 0.635873 1.33205 4.24659 1.03446 0.717408 35
produce:pandorapid:Chi2ParticleID 0.00161434 0.00225427 0.0037867 0.00209826 0.000523373 35
produce:pandoraShowercalo:ShowerCalorimetry 1.18929 2.94559 9.06912 2.22506 1.70993 35
produce:pandoraShowercalonosce:ShowerCalorimetry 1.16771 2.82545 8.09239 2.1814 1.57256 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0782014 0.116706 0.165928 0.117331 0.0234118 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0313822 0.0460972 0.0694419 0.0438772 0.00960803 35
produce:emtrkmichelid:EmTrackMichelId 11.7663 18.9736 28.7321 18.4637 4.17837 35
[art]:TriggerResults:TriggerResultInserter 2.6386e-05 4.2803e-05 0.000141509 4.0318e-05 1.87489e-05 35
end_path:out1:RootOutput 7.588e-06 1.11568e-05 1.8264e-05 1.0389e-05 2.54462e-06 35
end_path:michelremoving:michelremoving 0.0184032 0.0689833 0.255848 0.0393015 0.0569297 35
end_path:michelremovinggnocchi:michelremoving 0.0170654 0.0660585 0.254505 0.0367347 0.0564684 35
end_path:calibanagnocchi:CalibAnaTree 0.489993 1.00657 2.50141 0.880398 0.49598 35
end_path:out1:RootOutput(write) 0.590514 0.853235 1.26014 0.806841 0.175634 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5957.72 MB
Peak resident set size usage (VmHWM): 2747.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup.root
\tHists: np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727470719.0,
"core.end_time": 1727475330.0,
"core.events": [
25628,
25632,
25636,
25640,
25644,
25648,
25652,
25656,
25660,
25664,
25668,
25672,
25676,
25680,
25684,
25688,
25692,
25696,
25700,
25704,
25708,
25712,
25716,
25720,
25724,
25728,
25732,
25736,
25740,
25744,
25748,
25752,
25756,
25760,
25764
],
"core.event_count": 35,
"core.first_event_number": 25628,
"core.last_event_number": 25764,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605_reco_stage1_reco_stage2_20240927T221529_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727470719.0,
"core.end_time": 1727475330.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0183_dataflow0_datawriter_0_20240621T043605.hdf5"
}
]
}