Jobsub ID 207356.116@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 207356.116@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7090 | |
| Stage ID | 1 | |
| User name | ichong@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-05-21 18:15:02 | |
| Site | UK_Durham | |
| Entry | DUNE_UK_SGridDurham_ce3 | |
| Last heartbeat | 2025-05-21 19:24:18 | |
| From worker node | Hostname | n257.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-05-21 18:52:20 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 31m (1880s) | |
| CPU time | 6m (411s = 21%) | |
| Max RSS bytes | 2195030016 (2093 MiB) | |
| Outputting started | 2025-05-21 19:23:41 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training2_CaloHitListV_graph.data https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training1_CaloHitListV_graph.data https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training1_CaloHitListW_graph.data https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_analysiseid.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training1_CaloHitListU_graph.data https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training2_CaloHitListW_graph.data https://fndcadoor.fnal.gov:2880/dune/scratch/users/ichong/07090/1/021/graph_output_2025-05-21T_185227Z_2_training2_CaloHitListU_graph.data | |
| Finished | 2025-05-21 19:24:18 | |
| Saved logs | justin-logs:207356.116-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
89485 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 36508.7 VmHWM = 1175.76 Art has completed and will exit with status 0. === End last 100 lines of secondary lar log file === Renamed training1_CaloHitListU_graph.data -> graph_output_2025-05-21T_185227Z_2_training1_CaloHitListU_graph.data Renamed training1_CaloHitListV_graph.data -> graph_output_2025-05-21T_185227Z_2_training1_CaloHitListV_graph.data Renamed training1_CaloHitListW_graph.data -> graph_output_2025-05-21T_185227Z_2_training1_CaloHitListW_graph.data Renamed training2_CaloHitListU_graph.data -> graph_output_2025-05-21T_185227Z_2_training2_CaloHitListU_graph.data Renamed training2_CaloHitListV_graph.data -> graph_output_2025-05-21T_185227Z_2_training2_CaloHitListV_graph.data Renamed training2_CaloHitListW_graph.data -> graph_output_2025-05-21T_185227Z_2_training2_CaloHitListW_graph.data Renamed analysiseid.root -> graph_output_2025-05-21T_185227Z_2_analysiseid.root === Start last 100 lines of lar log file === --Primary 0, MCPDG 13, Energy 0.452288, Dist. 143.525, nMCHits 477 (251, 90, 136) MCPDG 13, Energy 0.452288, Dist. 143.525, nMCHits 426 (240, 68, 118) \_ MCPDG 11, Energy 0.0427158, Dist. 11.7431, nMCHits 51 (11, 22, 18) --Primary 1, MCPDG 2212, Energy 1.27759, Dist. 62.0076, nMCHits 219 (118, 21, 80) MCPDG 2212, Energy 1.27759, Dist. 62.0076, nMCHits 219 (118, 21, 80) --Primary 2, MCPDG 211, Energy 0.246604, Dist. 30.2625, nMCHits 159 (45, 65, 49) MCPDG 211, Energy 0.246604, Dist. 30.2625, nMCHits 84 (14, 43, 27) \_ MCPDG -11, Energy 0.0437842, Dist. 7.56205, nMCHits 75 (31, 22, 22) --Primary 3, MCPDG -211, Energy 0.329902, Dist. 39.8574, nMCHits 76 (31, 25, 20) MCPDG -211, Energy 0.329902, Dist. 39.8574, nMCHits 46 (22, 14, 10) \_ MCPDG 2212, Energy 1.03042, Dist. 6.7295, nMCHits 30 (9, 11, 10) --Primary 4, MCPDG 2212, Energy 1.06062, Dist. 0.0853157, nMCHits 32 (7, 15, 10) \_ MCPDG 2212, Energy 1.03674, Dist. 7.58516, nMCHits 32 (7, 15, 10) ------------------------------------------------------------------------------------------------ Operating in training mode. The eid is 99 Graph saved to training1_CaloHitListW_graph.data Size of file training1_CaloHitListW_graph.data is 1211496 bytes. The eid is 99 Graph saved to training1_CaloHitListU_graph.data Size of file training1_CaloHitListU_graph.data is 1787224 bytes. The eid is 99 Graph saved to training1_CaloHitListV_graph.data Size of file training1_CaloHitListV_graph.data is 1498864 bytes. Operating in inference mode. Operating in training mode. The eid is -1 Graph saved to training2_CaloHitListW_graph.data Size of file training2_CaloHitListW_graph.data is 1211196 bytes. The eid is -1 Graph saved to training2_CaloHitListU_graph.data Size of file training2_CaloHitListU_graph.data is 1784936 bytes. The eid is -1 Graph saved to training2_CaloHitListV_graph.data Size of file training2_CaloHitListV_graph.data is 1496464 bytes. Boundary wire vector sizes: 457, 253, 315 minwire 0: 2135 minwire 1: 1186 minwire 2: 1834 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499 Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499 Classifier summary: Output 0: 0.0115245, Output 1: 0.533887, 0.0302335, 0.0064696, 0.42941, Output 2: 0.0152972, 0.840509, 0.140813, 0.00338118, Output 3: 0.12841, 0.0886494, 0.245911, 0.53703, Output 4: 0.0517904, 0.256857, 0.585886, 0.105466, Output 5: 0.995898, 0.00395425, 0.000122347, 2.56433e-05, Output 6: 0.0112522, 0.10908, 0.200752, 0.678916, Running Ophitfinder with InputDigiType = 'recob' Found hits: 368! 21-May-2025 20:21:13 BST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2_graph_2025-05-21T_185227Z.root" 21-May-2025 20:21:13 BST Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/8f/83/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1.54094 3.82839 44.6696 3.13533 5.4327 100 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0352198 0.0659785 0.115293 0.067441 0.0197536 100 reco:gaushit:GausHitFinder 0.115407 0.199092 1.74483 0.131812 0.233241 100 reco:spsolve:SpacePointSolver 0.000104568 0.157168 5.81714 0.0029254 0.789444 100 reco:hitfd:DisambigFromSpacePoints 0.000196824 0.0221077 0.890497 0.00077922 0.109982 100 reco:rns:RandomNumberSaver 1.8304e-05 2.75224e-05 0.000396513 2.2227e-05 3.74293e-05 100 reco:pandora:StandardPandora 0.871217 1.65368 34.4457 0.913284 4.12416 100 reco:pandoraTrack:LArPandoraTrackCreation 0.000118975 0.000190317 0.00388203 0.000140196 0.000372976 100 reco:pandoraShower:LArPandoraModularShowerCreation 0.000155335 0.000212753 0.00336814 0.000171737 0.000318084 100 reco:pandoracalo:Calorimetry 0.000101613 0.000139482 0.00168011 0.00011851 0.000156083 100 reco:pandorapid:Chi2ParticleID 3.4847e-05 4.98353e-05 0.000877808 3.85025e-05 8.35231e-05 100 reco:cvnmap:CVNMapper 2.2863e-05 0.0137557 0.0731114 0.0155286 0.011822 100 reco:cvneva:CVNEvaluator 1.6932e-05 0.713017 2.93145 0.942541 0.499447 100 reco:energyrecnumu:EnergyReco 0.00168085 0.0036285 0.0134923 0.00327268 0.00210515 100 reco:energyrecnue:EnergyReco 0.00163789 0.0024451 0.0129384 0.00194188 0.00163039 100 reco:energyrecnc:EnergyReco 0.00150058 0.00238975 0.0129513 0.00186729 0.00163259 100 reco:energyrecnumurange:EnergyReco 0.00166399 0.00238914 0.0129611 0.00185934 0.00163892 100 reco:energyrecnumumcs:EnergyReco 0.00164989 0.00239101 0.0131435 0.00186836 0.00165833 100 reco:opdec:Deconvolution 0.163423 0.364809 0.653452 0.35936 0.0986662 100 reco:ophitspe:OpHitFinderDeco 0.311304 0.315763 0.33301 0.315031 0.0031726 100 reco:opflash:OpFlashFinder 0.000118836 0.000362456 0.00463737 0.000295316 0.00044449 100 reco:opslicer:OpSlicer 3.4876e-05 0.0100491 0.0620948 0.00454471 0.0130508 100 [art]:TriggerResults:TriggerResultInserter 1.0049e-05 1.45636e-05 8.8327e-05 1.3235e-05 7.84611e-06 100 end_path:out1:RootOutput 2.925e-06 4.12592e-06 2.631e-05 3.8525e-06 2.30644e-06 100 end_path:out1:RootOutput(write) 0.0155341 0.297812 0.799276 0.351905 0.183814 100 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 38102.8 MB Peak resident set size usage (VmHWM): 2195.03 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === === Generated output files === 207356.116_justin-prod-sched02.dune.hep.ac.uk.logs.tgz atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2_graph_2025-05-21T_185227Z.log atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2_graph_2025-05-21T_185227Z.root debugprod.log graph_output_2025-05-21T_185227Z_2_analysiseid.root graph_output_2025-05-21T_185227Z_2_training1_CaloHitListU_graph.data graph_output_2025-05-21T_185227Z_2_training1_CaloHitListV_graph.data graph_output_2025-05-21T_185227Z_2_training1_CaloHitListW_graph.data graph_output_2025-05-21T_185227Z_2_training2_CaloHitListU_graph.data graph_output_2025-05-21T_185227Z_2_training2_CaloHitListV_graph.data graph_output_2025-05-21T_185227Z_2_training2_CaloHitListW_graph.data jobscript.log justin-processed-pfns.txt reco_hist.root secondary_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50649927_11_20231208T040156Z_gen_g4_detsim_hitreco__20240510T065220Z_reco2_graph_2025-05-21T_185227Z.log training1_CaloHitListU.csv training1_CaloHitListV.csv training1_CaloHitListW.csv training2_CaloHitListU.csv training2_CaloHitListV.csv training2_CaloHitListW.csv