21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 209654.153@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 209654.153@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7131 | |
| Stage ID | 1 | |
| User name | smanthey@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-05-26 09:06:17 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-05-27 11:03:12 | |
| From worker node | Hostname | dunegli-42167-0-cmswn2411.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-05-27 07:55:15 | |
| Input files | usertests:fdvd_lowBg_reco2_2025-05-11T_221049Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 3h (11264s) | |
| CPU time | 3h (11137s = 98%) | |
| Max RSS bytes | 1384521728 (1320 MiB) | |
| Outputting started | 2025-05-27 11:03:00 | |
| Output files | ||
| Finished | 2025-05-27 11:03:12 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ster: - MainTrackID 76090 - Purity 1.00 Hits 7 - #AdjCl 6 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6941.52, 549.42, 1183.71) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:44 UTC run: 20000047 subRun: 0 event: 8 [32m*** Matched preselection cluster: - MainTrackID 76093 - Purity 1.00 Hits 2 - #AdjCl 5 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6832.95, 542.40, 1190.28) [0m %MSG Begin processing the 9th record. run: 20000047 subRun: 0 event: 9 at 27-May-2025 10:24:45 UTC %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:50 UTC run: 20000047 subRun: 0 event: 9 [35m TPC Frequency in [MHz]: 2.00 TPC Tick in [us]: 0.50 Event Flag: 1285195321 Succesfull reset of variables for evt 9 #########################################[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:51 UTC run: 20000047 subRun: 0 event: 9 [91m There are a total of 76332 Particles in the event # of particles 8 from gen 1 marley # of particles 30964 from gen 2 Ar39GenInLAr # of particles 3512 from gen 3 Kr85GenInLAr # of particles 1 from gen 4 Ar42GenInLAr # of particles 1 from gen 5 K42From42ArGenInLAr # of particles 27 from gen 6 Rn222ChainRn222GenInLAr # of particles 26 from gen 7 Rn222ChainPo218GenInLAr # of particles 36 from gen 8 Rn222ChainPb214GenInLAr # of particles 20 from gen 9 Rn222ChainBi214GenInLAr # of particles 12 from gen 10 Rn222ChainPb210GenInLAr # of particles 38 from gen 11 Rn220ChainPb212GenInLAr # of particles 219 from gen 12 K40GenInCathode # of particles 3021 from gen 13 U238ChainGenInCathode # of particles 3618 from gen 14 Th232ChainGenInCathode # of particles 112 from gen 15 K40GenInAnode # of particles 1403 from gen 16 U238ChainGenInAnode # of particles 1705 from gen 17 Th232ChainGenInAnode # of particles 3 from gen 18 Rn222ChainGenInPDS # of particles 0 from gen 19 K42From42ArGenInUpperMesh # of particles 2 from gen 20 Rn222ChainFromPo218GenInUpperMesh # of particles 22 from gen 21 Rn222ChainFromPb214GenInUpperMesh # of particles 40 from gen 22 Rn222ChainFromBi214GenInUpperMesh # of particles 65 from gen 23 Rn222ChainFromPb210GenInUpperMesh # of particles 52 from gen 24 Rn222ChainFromBi210GenInUpperMesh # of particles 51 from gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 27779 from gen 26 CavernwallGammasAtLAr # of particles 3595 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:51 UTC run: 20000047 subRun: 0 event: 9 [33m Number of Signal Particles: 7 Neutrino Interaction: -1 Neutrino Energy: 31.96 MeV Position (-232.10, 639.47, 231.35) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 11 1.48 (-232.20, 639.59, 231.22) 76326 marley -12 0.35 (1031.80, 5033.92, 4379.07) 76326 marley 1000200400 37214.71 (-232.10, 639.47, 231.35) 76326 marley 22 0.03 (-232.16, 639.33, 231.37) 0 marley 22 1.61 (-206.03, 645.65, 247.52) 0 marley 22 1.09 (-178.73, 616.63, 182.99) 0 marley 1000190400 37216.57 (-232.10, 639.47, 231.35) 0 marley 11 28.21 (-232.23, 646.09, 231.76) 0 Signal Track IDs: 76325; 76326; 76327; 76328; 76329; 76387; 76388; 76389; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:51 UTC run: 20000047 subRun: 0 event: 9 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:24:51 UTC run: 20000047 subRun: 0 event: 9 [36m # OpHits (ophit10ppm) in full geometry: 24832 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3369, 3281, 4246, 0 # Cluster from the hits: 1522, 1493, 3619, 0 # Tracks (pmtracktc) in full geometry: 184[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:13 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76325 - Purity 1.00 Hits 5 - #AdjCl 8 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (6942.59, 644.96, 231.95) [0m %MSG Begin processing the 10th record. run: 20000047 subRun: 0 event: 10 at 27-May-2025 10:44:13 UTC %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:20 UTC run: 20000047 subRun: 0 event: 10 [35m TPC Frequency in [MHz]: 2.00 TPC Tick in [us]: 0.50 Event Flag: 10249571 Succesfull reset of variables for evt 10 #########################################[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:21 UTC run: 20000047 subRun: 0 event: 10 [91m There are a total of 76380 Particles in the event # of particles 8 from gen 1 marley # of particles 31022 from gen 2 Ar39GenInLAr # of particles 3556 from gen 3 Kr85GenInLAr # of particles 4 from gen 4 Ar42GenInLAr # of particles 2 from gen 5 K42From42ArGenInLAr # of particles 33 from gen 6 Rn222ChainRn222GenInLAr # of particles 28 from gen 7 Rn222ChainPo218GenInLAr # of particles 54 from gen 8 Rn222ChainPb214GenInLAr # of particles 55 from gen 9 Rn222ChainBi214GenInLAr # of particles 10 from gen 10 Rn222ChainPb210GenInLAr # of particles 30 from gen 11 Rn220ChainPb212GenInLAr # of particles 237 from gen 12 K40GenInCathode # of particles 2972 from gen 13 U238ChainGenInCathode # of particles 3483 from gen 14 Th232ChainGenInCathode # of particles 103 from gen 15 K40GenInAnode # of particles 1355 from gen 16 U238ChainGenInAnode # of particles 1638 from gen 17 Th232ChainGenInAnode # of particles 1 from gen 18 Rn222ChainGenInPDS # of particles 3 from gen 19 K42From42ArGenInUpperMesh # of particles 5 from gen 20 Rn222ChainFromPo218GenInUpperMesh # of particles 28 from gen 21 Rn222ChainFromPb214GenInUpperMesh # of particles 37 from gen 22 Rn222ChainFromBi214GenInUpperMesh # of particles 54 from gen 23 Rn222ChainFromPb210GenInUpperMesh # of particles 39 from gen 24 Rn222ChainFromBi210GenInUpperMesh # of particles 69 from gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 28057 from gen 26 CavernwallGammasAtLAr # of particles 3497 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:21 UTC run: 20000047 subRun: 0 event: 10 [33m Number of Signal Particles: 7 Neutrino Interaction: -1 Neutrino Energy: 31.89 MeV Position (236.39, 718.74, 1007.78) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 11 1.51 (236.41, 718.64, 1007.64) 76374 marley -12 0.32 (-4655.16, 2143.17, 3230.23) 76374 marley 1000200400 37214.71 (236.39, 718.74, 1007.78) 76374 marley 22 0.03 (236.24, 718.75, 1007.84) 0 marley 22 1.61 (209.45, 727.29, 969.86) 0 marley 22 4.48 (239.68, 708.13, 1013.56) 0 marley 1000190400 37216.55 (236.39, 718.74, 1007.78) 0 marley 11 24.76 (235.78, 721.07, 1011.75) 0 Signal Track IDs: 76373; 76374; 76375; 76376; 76377; 76458; 76459; 76460; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:21 UTC run: 20000047 subRun: 0 event: 10 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 10:44:21 UTC run: 20000047 subRun: 0 event: 10 [36m # OpHits (ophit10ppm) in full geometry: 25224 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3214, 3207, 4074, 0 # Cluster from the hits: 1476, 1506, 3521, 0 # Tracks (pmtracktc) in full geometry: 194[0m %MSG 27-May-2025 11:02:59 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/72/df/fdvd_lowBg_reco2_2025-05-11T_221049Z.root" ==================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================== Full event 1060.56 1118.92 1190.66 1117.88 47.3724 10 -------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000717628 0.0185057 0.05433 0.0127454 0.0191144 10 end_path:solarnuana:SolarNuAna 1060.5 1118.91 1190.66 1117.88 47.3775 10 ==================================================================================================================== %MSG-i NuRandomService: SolarNuAna:solarnuana@EndJob 27-May-2025 11:02:59 UTC ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2010.65 MB Peak resident set size usage (VmHWM): 1384.52 MB ==================================================================================================== TrigReport ---------- Event summary ------------- TrigReport Events total = 10 passed = 10 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 10 10 0 solarnuana TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 11118.040081 Real = 11242.017102 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 2010.65 VmHWM = 1384.52 Art has completed and will exit with status 0. === End last 100 lines of lar log file === Output file: fdhd_ana_2025-05-27T_075525Z.root Output hist file: fdhd_ana_2025-05-27T_075525Z_hist.root lar exit code 0