21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 209655.26@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 209655.26@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7131 | |
| Stage ID | 1 | |
| User name | smanthey@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-05-26 14:31:38 | |
| Site | US_FNAL-T1 | |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole | |
| Last heartbeat | 2025-05-27 12:14:26 | |
| From worker node | Hostname | dunegli-42167-0-cmswn2411.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 12582912000 (12000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-05-27 09:49:36 | |
| Input files | usertests:fdvd_lowBg_reco2_2025-05-12T_095927Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 2h (8677s) | |
| CPU time | 2h (8596s = 99%) | |
| Max RSS bytes | 1381330944 (1317 MiB) | |
| Outputting started | 2025-05-27 12:14:14 | |
| Output files | ||
| Finished | 2025-05-27 12:14:26 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
m gen 25 Rn220ChainFromPb212GenInUpperMesh # of particles 28057 from gen 26 CavernwallGammasAtLAr # of particles 3497 from gen 27 foamGammasAtLAr # of particles 0 from gen 28 CavernwallNeutronsAtLAr # of particles 0 from gen 29 CryostatNGammasAtLAr # of particles 0 from gen 30 CavernNGammasAtLAr[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:57:35 UTC run: 20000047 subRun: 0 event: 10 [33m Number of Signal Particles: 6 Neutrino Interaction: -1 Neutrino Energy: 68.21 MeV Position (-287.04, 661.32, 675.50) cm Gen. PdgCode Energy EndPosition Mother ------------------------------------------------------------------------ marley 1000260570 53021.73 (-119.36, 839.58, 1040.95) 76738 marley 22 7.65 (-109.52, 840.58, 1025.15) 76738 marley 22 7.65 (-134.31, 838.66, 1041.50) 76738 marley 22 7.65 (11.27, 835.49, 962.88) 76738 marley 22 7.65 (-120.93, 838.50, 1040.95) 76738 marley 22 7.65 (-122.21, 842.88, 1036.89) 76738 marley 22 7.65 (-121.06, 845.77, 1020.79) 76738 marley 2212 938.27 (-121.95, 833.73, 1030.37) 76738 marley 2212 938.27 (-136.58, 817.39, 1055.22) 76738 marley 2212 938.27 (-142.20, 816.23, 1059.00) 76738 marley 2212 938.27 (-143.02, 814.43, 1069.99) 76738 marley 2212 938.27 (-144.23, 814.13, 1073.44) 76738 marley 1000060120 11174.86 (-146.41, 818.72, 1077.01) 76738 marley 2212 938.27 (-149.88, 815.15, 1073.39) 76738 marley 2212 938.29 (-152.18, 813.93, 1074.32) 76738 marley 1000060120 11174.87 (-154.76, 806.67, 1068.93) 76738 marley 2212 938.28 (-150.36, 803.34, 1067.38) 76738 marley 2212 938.28 (-149.67, 800.91, 1066.26) 76738 marley 2212 938.29 (-150.33, 783.45, 1063.21) 76738 marley 1000130270 25126.51 (-83.51, 676.36, 1053.10) 76738 marley 1000180360 33494.37 (-298.74, 717.97, 648.50) 76738 marley 1000180400 37215.54 (-258.89, 717.87, 655.16) 76738 marley 1000180400 37215.54 (-270.75, 714.41, 653.92) 76738 marley 1000180400 37215.54 (-299.37, 705.86, 717.57) 76738 marley 1000180400 37215.54 (-301.85, 704.79, 717.82) 76738 marley 1000180400 37215.54 (-311.10, 720.42, 720.51) 76738 marley 1000180400 37215.55 (-309.50, 721.58, 718.31) 76738 marley 1000180400 37215.54 (-310.03, 720.95, 718.89) 76738 marley 1000180400 37215.54 (-306.15, 718.91, 726.52) 76738 marley 1000180400 37215.54 (-306.37, 719.17, 727.52) 76738 marley 1000180360 33494.37 (-306.62, 720.33, 727.70) 76738 marley 1000180400 37215.54 (-306.89, 720.45, 728.03) 76738 marley 1000180400 37215.54 (-311.80, 727.60, 723.38) 76738 marley 1000180360 33494.37 (-337.81, 736.23, 753.84) 76738 marley 1000080160 14895.10 (-327.06, 764.61, 762.64) 76738 marley 1000180360 33494.38 (-325.75, 739.05, 787.05) 76738 marley 1000180400 37215.54 (-338.25, 723.13, 775.25) 76738 marley 1000180400 37215.55 (-343.89, 714.65, 752.49) 76738 marley 1000180400 37215.55 (-337.75, 742.46, 776.83) 76738 marley 1000180400 37215.55 (-364.44, 657.44, 765.90) 76738 marley 1000180360 33494.38 (-367.50, 658.44, 754.14) 76738 marley 1000180400 37215.55 (-360.58, 657.48, 755.41) 76738 marley 1000180400 37215.54 (-369.41, 658.58, 771.08) 76738 marley 1000180400 37215.54 (-356.51, 658.43, 786.22) 76738 marley 1000180400 37215.56 (-340.61, 656.68, 803.15) 76738 marley 1000180400 37215.55 (-344.09, 657.08, 803.30) 76738 marley 1000180400 37215.55 (-339.78, 634.75, 790.90) 76738 marley 1000180360 33494.38 (-337.18, 636.80, 788.71) 76738 marley 1000180400 37215.54 (-346.39, 640.89, 778.65) 76738 marley 1000180360 33494.37 (-387.28, 671.39, 770.44) 76738 marley 1000180400 37215.54 (-390.23, 672.75, 768.83) 76738 marley 1000180400 37215.55 (-390.28, 672.79, 768.85) 76738 marley 1000180400 37215.57 (-382.52, 690.80, 770.60) 76738 marley 1000180400 37215.55 (-416.07, 651.66, 771.67) 76738 marley 1000180360 33494.39 (-411.52, 643.72, 800.79) 76738 marley 1000180400 37215.55 (-384.53, 605.51, 772.99) 76738 marley 1000180400 37215.54 (-376.52, 613.11, 758.46) 76738 marley 1000180400 37215.55 (-345.20, 611.38, 729.77) 76738 marley 1000180360 33494.40 (-316.80, 663.52, 725.17) 76738 marley 1000180400 37215.57 (-313.84, 645.13, 761.58) 76738 marley 1000180400 37215.54 (-313.51, 645.35, 761.23) 76738 marley 1000180360 33494.38 (-297.23, 658.44, 725.01) 76738 marley 1000180400 37215.56 (-300.99, 656.61, 719.23) 76738 marley 1000180400 37215.57 (-169.23, 652.28, 651.02) 76738 marley 1000180400 37215.56 (-174.16, 708.44, 663.33) 76738 marley 1000180400 37215.56 (-170.88, 704.79, 694.64) 76738 marley 1000180400 37215.59 (-253.21, 603.96, 709.38) 76738 marley 1000180400 37215.57 (-259.71, 651.84, 715.38) 76738 marley 1000180400 37215.59 (-254.85, 657.93, 650.27) 76738 marley 1000180400 37215.55 (-303.78, 660.03, 688.71) 76738 marley 1000180400 37215.54 (-303.77, 660.16, 689.02) 76738 marley 1000130270 25126.54 (-309.97, 673.04, 699.53) 76738 marley 1000180400 37215.58 (-320.41, 670.57, 706.17) 76738 marley 1000180400 37215.62 (-324.10, 643.70, 692.21) 76738 marley 1000180400 37215.56 (-319.09, 651.56, 699.73) 76738 marley 1000180400 37215.61 (-319.92, 644.61, 728.67) 76738 marley 1000180400 37215.60 (-323.16, 685.18, 713.14) 76738 marley 1000180400 37215.61 (-325.62, 683.16, 711.43) 76738 marley 1000180400 37215.55 (-319.80, 677.98, 713.66) 76738 marley 1000180400 37215.65 (-294.70, 642.21, 699.69) 76738 marley 1000180400 37215.55 (-301.84, 655.67, 700.38) 76738 marley 1000180400 37215.65 (-302.36, 659.77, 697.49) 76738 marley 1000180400 37215.65 (-304.51, 656.91, 698.09) 76738 marley 22 0.00 (-284.00, 661.65, 673.27) 76721 marley 22 0.66 (-281.83, 669.73, 657.34) 76721 marley 22 1.46 (-288.30, 667.05, 719.44) 76721 marley 1000180400 37215.79 (-284.00, 661.65, 673.27) 76721 marley 2112 941.04 (-119.36, 839.58, 1040.95) 76721 marley 22 2.82 (-301.02, 653.15, 682.39) 0 marley 2112 943.41 (-284.00, 661.65, 673.27) 0 marley 1000190390 36284.81 (-287.04, 661.32, 675.50) 0 marley 11 52.72 (-280.11, 657.96, 656.47) 0 Signal Track IDs: 76719; 76720; 76721; 76722; 76738; 76739; 76740; 76741; 76742; 76779; 76780; 76781; 76782; 76783; 76784; 76785; 76786; 76787; 76788; 76789; 76790; 76791; 76792; 76793; 76794; 76795; 76796; 76797; 76798; 76799; 76800; 76801; 76802; 76803; 76804; 76805; 76806; 76807; 76808; 76809; 76810; 76811; 76812; 76813; 76814; 76815; 76816; 76817; 76818; 76819; 76820; 76821; 76822; 76823; 76824; 76825; 76826; 76827; 76828; 76829; 76830; 76831; 76832; 76833; 76834; 76835; 76836; 76837; 76838; 76839; 76840; 76841; 76842; 76843; 76844; 76845; 76846; 76847; 76848; 76849; 76850; 76851; 76852; 76853; 76856; 76891; 76892; 76893; 76894; 76895; 76896; 76897; [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:57:35 UTC run: 20000047 subRun: 0 event: 10 [34m[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 11:57:35 UTC run: 20000047 subRun: 0 event: 10 [36m # OpHits (ophit10ppm) in full geometry: 25032 # OpFlashes (solarflash) in full geometry: 0 # Hits (gaushit) in each view: 3263, 3183, 4192, 0 # Cluster from the hits: 1450, 1461, 3592, 0 # Tracks (pmtracktc) in full geometry: 206[0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:14:12 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76719 - Purity 1.00 Hits 40 - #AdjCl 2 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7589.35, 657.75, 665.12) [0m %MSG %MSG-i SolarNuAna: SolarNuAna:solarnuana@BeginModule 27-May-2025 12:14:12 UTC run: 20000047 subRun: 0 event: 10 [32m*** Matched preselection cluster: - MainTrackID 76722 - Purity 1.00 Hits 3 - #AdjCl 1 ( 0 signal ) - Gen 1 -> marley - Reco Time,Y,Z (7798.03, 646.26, 686.56) [0m %MSG 27-May-2025 12:14:13 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/bd/97/fdvd_lowBg_reco2_2025-05-12T_095927Z.root" ==================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ==================================================================================================================== Full event 579.401 862.098 1136.27 895.126 211.109 10 -------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000606676 0.0144891 0.0461211 0.00905649 0.0154218 10 end_path:solarnuana:SolarNuAna 579.4 862.083 1136.27 895.117 211.112 10 ==================================================================================================================== %MSG-i NuRandomService: SolarNuAna:solarnuana@EndJob 27-May-2025 12:14:13 UTC ModuleEndJob Summary of seeds computed by the NuRandomService Random policy: 'perEvent' algorithm version: EventTimestamp_v1 %MSG ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2009.87 MB Peak resident set size usage (VmHWM): 1381.33 MB ==================================================================================================== TrigReport ---------- Event summary ------------- TrigReport Events total = 10 passed = 10 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 10 10 0 solarnuana TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 8576.176673 Real = 8652.348892 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 2009.87 VmHWM = 1381.33 Art has completed and will exit with status 0. === End last 100 lines of lar log file === Output file: fdhd_ana_2025-05-27T_094947Z.root Output hist file: fdhd_ana_2025-05-27T_094947Z_hist.root lar exit code 0