21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 209655.39@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 209655.39@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7131 | |
| Stage ID | 1 | |
| User name | smanthey@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-05-26 14:31:38 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-05-27 12:56:48 | |
| From worker node | Hostname | dunegli-42167-0-cmswn2411.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-05-27 10:12:12 | |
| Input files | usertests:fdvd_lowBg_reco2_2025-05-12T_052806Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 2h (9864s) | |
| CPU time | 2h (9785s = 99%) | |
| Max RSS bytes | 1371496448 (1307 MiB) | |
| Outputting started | 2025-05-27 12:56:37 | |
| Output files | ||
| Finished | 2025-05-27 12:56:48 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
perMesh # of particles 27779 from gen 26 CavernwallGammasAtLAr # of particles 3595 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:22:58 UTC run: 20000047 subRun: 0 event: 9 [33m Number of Signal Particles: 8 Neutrino Interaction: -1 Neutrino Energy: 40.87 MeV Position (272.60, 268.68, 283.15) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 22 1.46 (274.98, 257.35, 279.16) 76353 marley 1000180400 37215.54 (272.60, 268.68, 283.15) 76353 marley 12 0.04 (-2361.84, -5033.92, 1648.87) 76353 marley 11 0.51 (272.60, 268.68, 283.15) 76353 marley 11 0.51 (272.60, 268.68, 283.15) 76353 marley 11 0.51 (272.60, 268.68, 283.15) 76353 marley 11 0.51 (272.60, 268.68, 283.15) 76353 marley 11 0.51 (272.60, 268.68, 283.15) 76353 marley 22 0.03 (272.25, 268.90, 283.04) 0 marley 22 1.61 (287.03, 262.94, 308.00) 0 marley 22 0.65 (293.08, 284.75, 274.23) 0 marley 22 2.09 (244.03, 283.73, 264.71) 0 marley 1000190400 37216.53 (272.60, 268.68, 283.15) 0 marley 11 35.49 (273.54, 274.30, 279.61) 0 Signal Track IDs: 76352; 76353; 76354; 76355; 76356; 76357; 76428; 76429; 76430; 76431; 76432; 76434; 76435; 76436; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:22:58 UTC run: 20000047 subRun: 0 event: 9 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:22:58 UTC run: 20000047 subRun: 0 event: 9 [36m # OpHits (ophit10ppm) in full geometry: 24680 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3261, 3207, 4111, 0 # Cluster from the hits: 1479, 1478, 3525, 0 # Tracks (pmtracktc) in full geometry: 203[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:32 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76352 - Purity 1.00 Hits 3 - #AdjCl 10 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (598.75, 292.08, 261.38) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:32 UTC run: 20000047 subRun: 0 event: 9 [32m*** Matched preselection cluster: - MainTrackID 76352 - Purity 1.00 Hits 10 - #AdjCl 12 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (645.78, 272.17, 280.83) [0m %MSG Begin processing the 10th record. run: 20000047 subRun: 0 event: 10 at 27-May-2025 12:39:32 UTC %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:35 UTC run: 20000047 subRun: 0 event: 10 [35m TPC Frequency in [MHz]: 2.00 TPC Tick in [us]: 0.50 Event Flag: 1434610668 Succesfull reset of variables for evt 10 #########################################[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:35 UTC run: 20000047 subRun: 0 event: 10 [91m There are a total of 76616 Particles in the event # of particles 7 from gen 1 marley # of particles 31138 from gen 2 Ar39GenInLAr # of particles 3517 from gen 3 Kr85GenInLAr # of particles 4 from gen 4 Ar42GenInLAr # of particles 1 from gen 5 K42From42ArGenInLAr # of particles 36 from gen 6 Rn222ChainRn222GenInLAr # of particles 32 from gen 7 Rn222ChainPo218GenInLAr # of particles 45 from gen 8 Rn222ChainPb214GenInLAr # of particles 48 from gen 9 Rn222ChainBi214GenInLAr # of particles 33 from gen 10 Rn222ChainPb210GenInLAr # of particles 30 from gen 11 Rn220ChainPb212GenInLAr # of particles 230 from gen 12 K40GenInCathode # of particles 3143 from gen 13 U238ChainGenInCathode # of particles 3604 from gen 14 Th232ChainGenInCathode # of particles 81 from gen 15 K40GenInAnode # of particles 1397 from gen 16 U238ChainGenInAnode # of particles 1511 from gen 17 Th232ChainGenInAnode # of particles 0 from gen 18 Rn222ChainGenInPDS # of particles 1 from gen 19 K42From42ArGenInUpperMesh # of particles 3 from gen 20 Rn222ChainFromPo218GenInUpperMesh # of particles 12 from gen 21 Rn222ChainFromPb214GenInUpperMesh # of particles 66 from gen 22 Rn222ChainFromBi214GenInUpperMesh # of particles 31 from gen 23 Rn222ChainFromPb210GenInUpperMesh # of particles 39 from gen 24 Rn222ChainFromBi210GenInUpperMesh # of particles 53 from gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 28057 from gen 26 CavernwallGammasAtLAr # of particles 3497 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:35 UTC run: 20000047 subRun: 0 event: 10 [33m Number of Signal Particles: 7 Neutrino Interaction: -1 Neutrino Energy: 40.98 MeV Position (127.10, 275.63, 186.78) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 11 0.68 (127.10, 275.62, 186.79) 76610 marley -12 0.39 (-4655.16, -279.09, -1748.26) 76610 marley 22 1.27 (140.32, 271.90, 176.09) 0 marley 22 2.02 (138.71, 287.14, 182.42) 0 marley 2212 943.55 (127.12, 275.59, 186.77) 0 marley 1000180390 36285.93 (127.10, 275.63, 186.78) 0 marley 11 23.74 (131.37, 276.09, 182.91) 0 Signal Track IDs: 76609; 76610; 76611; 76612; 76613; 76665; 76666; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:35 UTC run: 20000047 subRun: 0 event: 10 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:39:36 UTC run: 20000047 subRun: 0 event: 10 [36m # OpHits (ophit10ppm) in full geometry: 25278 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3310, 3258, 4147, 0 # Cluster from the hits: 1491, 1525, 3546, 0 # Tracks (pmtracktc) in full geometry: 176[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76609 - Purity 1.00 Hits 2 - #AdjCl 18 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (2316.85, 29.41, 120.60) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76609 - Purity 1.00 Hits 1 - #AdjCl 8 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (1832.72, 286.09, 164.46) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76609 - Purity 0.82 Hits 2 - #AdjCl 6 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (2283.19, 284.17, 176.10) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76609 - Purity 1.00 Hits 3 - #AdjCl 8 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (2375.99, 278.94, 178.26) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76609 - Purity 1.00 Hits 12 - #AdjCl 8 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (2440.67, 276.60, 184.28) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:56:36 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76612 - Purity 1.00 Hits 2 - #AdjCl 8 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (2535.27, 280.74, 183.54) [0m %MSG 27-May-2025 12:56:36 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/73/c7/fdvd_lowBg_reco2_2025-05-12T_052806Z.root" ==================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================== Full event 543.86 981.399 1173.72 1008.01 162.776 10 -------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000728498 0.0088239 0.0201449 0.00439638 0.00860229 10 end_path:solarnuana:SolarNuAna 543.859 981.39 1173.72 1008 162.775 10 ==================================================================================================================== %MSG-i NuRandomService: SolarNuAna:solarnuana@EndJob 27-May-2025 12:56:36 UTC ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2005.19 MB Peak resident set size usage (VmHWM): 1371.5 MB ==================================================================================================== TrigReport ---------- Event summary ------------- TrigReport Events total = 10 passed = 10 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 10 10 0 solarnuana TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 9765.750580 Real = 9841.255804 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 2005.19 VmHWM = 1371.5 Art has completed and will exit with status 0. === End last 100 lines of lar log file === Output file: fdhd_ana_2025-05-27T_101223Z.root Output hist file: fdhd_ana_2025-05-27T_101223Z_hist.root lar exit code 0