Jobsub ID 265210.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 265210.0@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3493 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-27 17:46:45 | |
| Site | US_UCSD | |
| Entry | CMSHTPC_T2_US_UCSD_gw7 | |
| Last heartbeat | 2024-09-27 19:20:51 | |
| From worker node | Hostname | mh-7662-5.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-27 17:47:54 | |
| Input files | hd-protodune:np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5494s) | |
| CPU time | 1h (4251s = 77%) | |
| Outputting started | 2024-09-27 19:19:29 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup.root hd-protodune-det-reco:np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup_hists.root | |
| Finished | 2024-09-27 19:20:51 | |
| Saved logs | justin-logs:265210.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ation...
Begin: 1.30387e+08
0 1.24173e+08
1 1.23566e+08
2 1.23553e+08
Now with regularization...
Begin: 1.21831e+08
0 1.21827e+08
this->SetupTestBeamPfo(pNuPfo, pTestBeamPfo, testBeamStartVertex) return STATUS_CODE_NOT_FOUND
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/AlmaLinux-9.4/build/larpandoracontent/v04_09_00-buildFW/src/larpandoracontent/LArThreeDReco/LArEventBuilding/TestBeamParticleCreationAlgorithm.cc line#: 43
iter->second->Run() throw STATUS_CODE_NOT_FOUND
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0087, LArTestBeamParticleCreation, STATUS_CODE_NOT_FOUND
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 12:19:21 PDT Closed output file "np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup.root"
27-Sep-2024 12:19:21 PDT Closed input file "np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 53.7985 101.028 171.488 102.425 34.0676 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000444289 0.00228182 0.00516097 0.00188514 0.00133317 35
produce:fembfilter:PDHDFEMBFilter 0.61672 0.640014 0.667926 0.636075 0.0136503 35
produce:wclsdatahd:WireCellToolkit 30.6766 32.0401 34.5645 31.9139 0.987151 35
produce:gaushit:GausHitFinder 0.347773 0.73195 1.18899 0.750934 0.218857 35
produce:nhitsfilter:NumberOfHitsFilter 0.000202424 0.000400056 0.000706216 0.000394709 0.000115826 35
produce:reco3d:SpacePointSolver 0.115908 1.38977 5.19966 1.08622 1.15391 35
produce:hitpdune:DisambigFromSpacePoints 0.129057 0.679874 1.85923 0.602287 0.399726 35
produce:pandora:StandardPandora 4.14657 27.3388 85.6665 25.5235 19.8235 35
produce:pandoraWriter:StandardPandora 0.0761712 0.172228 0.306632 0.175417 0.0575992 35
produce:pandoraTrack:LArPandoraTrackCreation 0.440903 1.84739 4.77514 1.75929 1.0676 35
produce:pandoraShower:LArPandoraShowerCreation 0.275586 1.9798 6.20141 1.51723 1.39646 35
produce:pandoracalo:Calorimetry 0.212493 0.871426 2.16628 0.813961 0.480861 35
produce:pandoracalonosce:Calorimetry 0.189705 0.811695 2.04551 0.747129 0.457916 35
produce:pandorapid:Chi2ParticleID 0.00114997 0.0020333 0.00398949 0.00186714 0.00061624 35
produce:pandoraShowercalo:ShowerCalorimetry 0.234683 1.71215 4.90772 1.38795 1.15586 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.227316 1.64356 4.70082 1.32059 1.11048 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0574578 0.136785 0.230571 0.136643 0.0405904 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0206257 0.0475524 0.0851077 0.0472481 0.0145418 35
produce:emtrkmichelid:EmTrackMichelId 13.5779 27.1944 45.7537 27.974 8.20579 35
[art]:TriggerResults:TriggerResultInserter 1.704e-05 3.2811e-05 9.2632e-05 2.7251e-05 1.64835e-05 35
end_path:out1:RootOutput 8.35e-06 1.46093e-05 5.3082e-05 1.2601e-05 9.61638e-06 35
end_path:michelremoving:michelremoving 0.00981151 0.0557503 0.221658 0.0293035 0.05216 35
end_path:michelremovinggnocchi:michelremoving 0.00969791 0.0525882 0.208735 0.0258322 0.05049 35
end_path:calibanagnocchi:CalibAnaTree 0.147369 0.665341 1.81016 0.63634 0.37622 35
end_path:out1:RootOutput(write) 0.4125 0.887513 1.54111 0.920745 0.276657 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5097.71 MB
Peak resident set size usage (VmHWM): 2721.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup.root
\tHists: np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727461189.0,
"core.end_time": 1727464761.0,
"core.events": [
96227,
96231,
96235,
96239,
96243,
96247,
96251,
96255,
96259,
96263,
96267,
96271,
96275,
96279,
96283,
96287,
96291,
96295,
96299,
96303,
96307,
96311,
96315,
96319,
96323,
96327,
96331,
96335,
96339,
96343,
96347,
96351,
96355,
96359,
96363
],
"core.event_count": 35,
"core.first_event_number": 96227,
"core.last_event_number": 96363,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27310
],
"core.runs_subruns": [
2731000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732_reco_stage1_reco_stage2_20240927T191921_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727461189.0,
"core.end_time": 1727464761.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27310
],
"core.runs_subruns": [
2731000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027310_0687_dataflow3_datawriter_0_20240620T035732.hdf5"
}
]
}