21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 209655.28@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 209655.28@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7131 | |
| Stage ID | 1 | |
| User name | smanthey@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-05-26 14:31:38 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-05-27 12:24:16 | |
| From worker node | Hostname | dunegli-42167-0-cmswn2411.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-05-27 09:50:00 | |
| Input files | usertests:fdvd_lowBg_reco2_2025-05-12T_120723Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 2h (9243s) | |
| CPU time | 2h (9153s = 99%) | |
| Max RSS bytes | 1385148416 (1320 MiB) | |
| Outputting started | 2025-05-27 12:24:04 | |
| Output files | ||
| Finished | 2025-05-27 12:24:16 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
nInAnode # of particles 0 from gen 18 Rn222ChainGenInPDS # of particles 3 from gen 19 K42From42ArGenInUpperMesh # of particles 3 from gen 20 Rn222ChainFromPo218GenInUpperMesh # of particles 24 from gen 21 Rn222ChainFromPb214GenInUpperMesh # of particles 35 from gen 22 Rn222ChainFromBi214GenInUpperMesh # of particles 64 from gen 23 Rn222ChainFromPb210GenInUpperMesh # of particles 34 from gen 24 Rn222ChainFromBi210GenInUpperMesh # of particles 44 from gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 27779 from gen 26 CavernwallGammasAtLAr # of particles 3595 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:51:09 UTC run: 20000047 subRun: 0 event: 9 [33m Number of Signal Particles: 8 Neutrino Interaction: -1 Neutrino Energy: 58.04 MeV Position (-249.29, 84.30, 336.65) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 11 1.05 (-249.30, 84.28, 336.71) 76908 marley -12 0.78 (-1116.19, 5033.92, -784.51) 76908 marley 22 0.03 (-249.29, 84.26, 336.65) 0 marley 22 0.77 (-230.24, 86.52, 334.09) 0 marley 22 1.62 (-242.40, 85.15, 349.35) 0 marley 22 3.27 (-273.48, 80.33, 322.52) 0 marley 1000190400 37216.68 (-249.29, 84.30, 336.65) 0 marley 11 51.21 (-235.90, 78.89, 337.43) 0 Signal Track IDs: 76907; 76908; 76909; 76910; 76911; 76912; 76948; 76949; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:51:10 UTC run: 20000047 subRun: 0 event: 9 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:51:10 UTC run: 20000047 subRun: 0 event: 9 [36m # OpHits (ophit10ppm) in full geometry: 25580 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3090, 3075, 4113, 0 # Cluster from the hits: 1398, 1421, 3518, 0 # Tracks (pmtracktc) in full geometry: 192[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:14 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76909 - Purity 1.00 Hits 3 - #AdjCl 9 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7291.19, 91.59, 326.58) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:14 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76907 - Purity 1.00 Hits 2 - #AdjCl 12 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6543.48, 39.27, 327.80) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:14 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76910 - Purity 1.00 Hits 2 - #AdjCl 10 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7145.50, 86.07, 330.37) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:14 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76907 - Purity 1.00 Hits 2 - #AdjCl 14 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6752.17, 66.16, 331.09) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:14 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76907 - Purity 1.00 Hits 6 - #AdjCl 13 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6622.43, 72.69, 332.23) [0m %MSG Begin processing the 10th record. run: 20000047 subRun: 0 event: 10 at 27-May-2025 12:07:14 UTC %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:17 UTC run: 20000047 subRun: 0 event: 10 [35m TPC Frequency in [MHz]: 2.00 TPC Tick in [us]: 0.50 Event Flag: 1521671123 Succesfull reset of variables for evt 10 #########################################[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:18 UTC run: 20000047 subRun: 0 event: 10 [91m There are a total of 76497 Particles in the event # of particles 9 from gen 1 marley # of particles 30926 from gen 2 Ar39GenInLAr # of particles 3498 from gen 3 Kr85GenInLAr # of particles 1 from gen 4 Ar42GenInLAr # of particles 0 from gen 5 K42From42ArGenInLAr # of particles 33 from gen 6 Rn222ChainRn222GenInLAr # of particles 25 from gen 7 Rn222ChainPo218GenInLAr # of particles 53 from gen 8 Rn222ChainPb214GenInLAr # of particles 41 from gen 9 Rn222ChainBi214GenInLAr # of particles 18 from gen 10 Rn222ChainPb210GenInLAr # of particles 27 from gen 11 Rn220ChainPb212GenInLAr # of particles 215 from gen 12 K40GenInCathode # of particles 2991 from gen 13 U238ChainGenInCathode # of particles 3836 from gen 14 Th232ChainGenInCathode # of particles 86 from gen 15 K40GenInAnode # of particles 1379 from gen 16 U238ChainGenInAnode # of particles 1577 from gen 17 Th232ChainGenInAnode # of particles 0 from gen 18 Rn222ChainGenInPDS # of particles 4 from gen 19 K42From42ArGenInUpperMesh # of particles 0 from gen 20 Rn222ChainFromPo218GenInUpperMesh # of particles 18 from gen 21 Rn222ChainFromPb214GenInUpperMesh # of particles 47 from gen 22 Rn222ChainFromBi214GenInUpperMesh # of particles 79 from gen 23 Rn222ChainFromPb210GenInUpperMesh # of particles 30 from gen 24 Rn222ChainFromBi210GenInUpperMesh # of particles 50 from gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 28057 from gen 26 CavernwallGammasAtLAr # of particles 3497 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:18 UTC run: 20000047 subRun: 0 event: 10 [33m Number of Signal Particles: 8 Neutrino Interaction: -1 Neutrino Energy: 44.75 MeV Position (-260.70, -613.78, 1216.86) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 11 0.79 (-260.69, -613.79, 1216.82) 76490 marley -12 0.43 (2264.78, -5033.92, -1042.54) 76490 marley 1000180360 33494.37 (-260.70, -613.78, 1216.86) 76490 marley 22 2.99 (-231.03, -579.44, 1228.48) 0 marley 22 0.67 (-262.86, -605.45, 1211.99) 0 marley 22 4.74 (-260.97, -610.75, 1234.65) 0 marley 1000020040 3733.57 (-260.70, -613.78, 1216.86) 0 marley 1000170360 33496.54 (-260.70, -613.78, 1216.86) 0 marley 11 21.78 (-263.74, -613.05, 1220.52) 0 Signal Track IDs: 76489; 76490; 76491; 76492; 76493; 76494; 76546; 76547; 76548; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:18 UTC run: 20000047 subRun: 0 event: 10 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:07:18 UTC run: 20000047 subRun: 0 event: 10 [36m # OpHits (ophit10ppm) in full geometry: 25065 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3287, 3248, 4229, 0 # Cluster from the hits: 1500, 1494, 3594, 0 # Tracks (pmtracktc) in full geometry: 190[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:24:03 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76489 - Purity 1.00 Hits 12 - #AdjCl 4 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7327.64, -613.14, 1218.38) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:24:03 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76492 - Purity 1.00 Hits 3 - #AdjCl 5 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7360.23, -607.43, 1227.64) [0m %MSG 27-May-2025 12:24:03 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/5f/ae/fdvd_lowBg_reco2_2025-05-12T_120723Z.root" ==================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================== Full event 557.056 919.014 1172.07 985.496 216.97 10 -------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000706037 0.0109868 0.0265289 0.0084274 0.0106742 10 end_path:solarnuana:SolarNuAna 557.055 919.003 1172.04 985.483 216.968 10 ==================================================================================================================== %MSG-i NuRandomService: SolarNuAna:solarnuana@EndJob 27-May-2025 12:24:03 UTC ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2008.4 MB Peak resident set size usage (VmHWM): 1385.15 MB ==================================================================================================== TrigReport ---------- Event summary ------------- TrigReport Events total = 10 passed = 10 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 10 10 0 solarnuana TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 9132.286900 Real = 9219.480197 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 2008.4 VmHWM = 1385.15 Art has completed and will exit with status 0. === End last 100 lines of lar log file === Output file: fdhd_ana_2025-05-27T_095010Z.root Output hist file: fdhd_ana_2025-05-27T_095010Z_hist.root lar exit code 0