21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 226779.86@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 226779.86@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7806 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 19:15:55 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 | |
| Last heartbeat | 2025-06-20 20:02:43 | |
| From worker node | Hostname | ccwcondor0783 |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 19:30:21 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_10_20231121T152349Z_gen_g4_detsim_hitreco__20240503T054158Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 5m (321s) | |
| CPU time | 1m (67s = 20%) | |
| Max RSS bytes | 1328668672 (1267 MiB) | |
| Outputting started | 2025-06-20 19:35:43 | |
| Output files | ||
| Finished | 2025-06-20 20:02:43 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
1st record. run: 50258005 subRun: 1 event: 2131 at 20-Jun-2025 21:34:07 CEST Begin processing the 132nd record. run: 50258005 subRun: 1 event: 2132 at 20-Jun-2025 21:34:09 CEST Begin processing the 133rd record. run: 50258005 subRun: 1 event: 2133 at 20-Jun-2025 21:34:10 CEST Begin processing the 134th record. run: 50258005 subRun: 1 event: 2134 at 20-Jun-2025 21:34:13 CEST Begin processing the 135th record. run: 50258005 subRun: 1 event: 2135 at 20-Jun-2025 21:34:15 CEST Begin processing the 136th record. run: 50258005 subRun: 1 event: 2136 at 20-Jun-2025 21:34:17 CEST Begin processing the 137th record. run: 50258005 subRun: 1 event: 2137 at 20-Jun-2025 21:34:18 CEST Begin processing the 138th record. run: 50258005 subRun: 1 event: 2138 at 20-Jun-2025 21:34:19 CEST Begin processing the 139th record. run: 50258005 subRun: 1 event: 2139 at 20-Jun-2025 21:34:21 CEST Begin processing the 140th record. run: 50258005 subRun: 1 event: 2140 at 20-Jun-2025 21:34:22 CEST Begin processing the 141st record. run: 50258005 subRun: 1 event: 2141 at 20-Jun-2025 21:34:23 CEST Begin processing the 142nd record. run: 50258005 subRun: 1 event: 2142 at 20-Jun-2025 21:34:24 CEST Begin processing the 143rd record. run: 50258005 subRun: 1 event: 2143 at 20-Jun-2025 21:34:26 CEST Begin processing the 144th record. run: 50258005 subRun: 1 event: 2144 at 20-Jun-2025 21:34:26 CEST Begin processing the 145th record. run: 50258005 subRun: 1 event: 2145 at 20-Jun-2025 21:34:27 CEST Begin processing the 146th record. run: 50258005 subRun: 1 event: 2146 at 20-Jun-2025 21:34:29 CEST Begin processing the 147th record. run: 50258005 subRun: 1 event: 2147 at 20-Jun-2025 21:34:30 CEST Begin processing the 148th record. run: 50258005 subRun: 1 event: 2148 at 20-Jun-2025 21:34:32 CEST Begin processing the 149th record. run: 50258005 subRun: 1 event: 2149 at 20-Jun-2025 21:34:32 CEST Begin processing the 150th record. run: 50258005 subRun: 1 event: 2150 at 20-Jun-2025 21:34:33 CEST Begin processing the 151st record. run: 50258005 subRun: 1 event: 2151 at 20-Jun-2025 21:34:34 CEST Begin processing the 152nd record. run: 50258005 subRun: 1 event: 2152 at 20-Jun-2025 21:34:36 CEST Begin processing the 153rd record. run: 50258005 subRun: 1 event: 2153 at 20-Jun-2025 21:34:38 CEST Begin processing the 154th record. run: 50258005 subRun: 1 event: 2154 at 20-Jun-2025 21:34:39 CEST Begin processing the 155th record. run: 50258005 subRun: 1 event: 2155 at 20-Jun-2025 21:34:41 CEST Begin processing the 156th record. run: 50258005 subRun: 1 event: 2156 at 20-Jun-2025 21:34:42 CEST Begin processing the 157th record. run: 50258005 subRun: 1 event: 2157 at 20-Jun-2025 21:34:43 CEST Begin processing the 158th record. run: 50258005 subRun: 1 event: 2158 at 20-Jun-2025 21:34:46 CEST Begin processing the 159th record. run: 50258005 subRun: 1 event: 2159 at 20-Jun-2025 21:34:47 CEST Begin processing the 160th record. run: 50258005 subRun: 1 event: 2160 at 20-Jun-2025 21:34:48 CEST Begin processing the 161st record. run: 50258005 subRun: 1 event: 2161 at 20-Jun-2025 21:34:49 CEST Begin processing the 162nd record. run: 50258005 subRun: 1 event: 2162 at 20-Jun-2025 21:34:59 CEST Begin processing the 163rd record. run: 50258005 subRun: 1 event: 2163 at 20-Jun-2025 21:35:00 CEST Begin processing the 164th record. run: 50258005 subRun: 1 event: 2164 at 20-Jun-2025 21:35:02 CEST Begin processing the 165th record. run: 50258005 subRun: 1 event: 2165 at 20-Jun-2025 21:35:02 CEST Begin processing the 166th record. run: 50258005 subRun: 1 event: 2166 at 20-Jun-2025 21:35:03 CEST Begin processing the 167th record. run: 50258005 subRun: 1 event: 2167 at 20-Jun-2025 21:35:03 CEST Begin processing the 168th record. run: 50258005 subRun: 1 event: 2168 at 20-Jun-2025 21:35:04 CEST Begin processing the 169th record. run: 50258005 subRun: 1 event: 2169 at 20-Jun-2025 21:35:04 CEST Begin processing the 170th record. run: 50258005 subRun: 1 event: 2170 at 20-Jun-2025 21:35:05 CEST Begin processing the 171st record. run: 50258005 subRun: 1 event: 2171 at 20-Jun-2025 21:35:07 CEST Begin processing the 172nd record. run: 50258005 subRun: 1 event: 2172 at 20-Jun-2025 21:35:07 CEST Begin processing the 173rd record. run: 50258005 subRun: 1 event: 2173 at 20-Jun-2025 21:35:08 CEST Begin processing the 174th record. run: 50258005 subRun: 1 event: 2174 at 20-Jun-2025 21:35:12 CEST Begin processing the 175th record. run: 50258005 subRun: 1 event: 2175 at 20-Jun-2025 21:35:14 CEST Begin processing the 176th record. run: 50258005 subRun: 1 event: 2176 at 20-Jun-2025 21:35:16 CEST Begin processing the 177th record. run: 50258005 subRun: 1 event: 2177 at 20-Jun-2025 21:35:17 CEST Begin processing the 178th record. run: 50258005 subRun: 1 event: 2178 at 20-Jun-2025 21:35:17 CEST Begin processing the 179th record. run: 50258005 subRun: 1 event: 2179 at 20-Jun-2025 21:35:19 CEST Begin processing the 180th record. run: 50258005 subRun: 1 event: 2180 at 20-Jun-2025 21:35:20 CEST Begin processing the 181st record. run: 50258005 subRun: 1 event: 2181 at 20-Jun-2025 21:35:21 CEST Begin processing the 182nd record. run: 50258005 subRun: 1 event: 2182 at 20-Jun-2025 21:35:21 CEST Begin processing the 183rd record. run: 50258005 subRun: 1 event: 2183 at 20-Jun-2025 21:35:22 CEST Begin processing the 184th record. run: 50258005 subRun: 1 event: 2184 at 20-Jun-2025 21:35:25 CEST Begin processing the 185th record. run: 50258005 subRun: 1 event: 2185 at 20-Jun-2025 21:35:26 CEST Begin processing the 186th record. run: 50258005 subRun: 1 event: 2186 at 20-Jun-2025 21:35:27 CEST Begin processing the 187th record. run: 50258005 subRun: 1 event: 2187 at 20-Jun-2025 21:35:28 CEST Begin processing the 188th record. run: 50258005 subRun: 1 event: 2188 at 20-Jun-2025 21:35:29 CEST Begin processing the 189th record. run: 50258005 subRun: 1 event: 2189 at 20-Jun-2025 21:35:30 CEST Begin processing the 190th record. run: 50258005 subRun: 1 event: 2190 at 20-Jun-2025 21:35:32 CEST Begin processing the 191st record. run: 50258005 subRun: 1 event: 2191 at 20-Jun-2025 21:35:33 CEST Begin processing the 192nd record. run: 50258005 subRun: 1 event: 2192 at 20-Jun-2025 21:35:34 CEST Begin processing the 193rd record. run: 50258005 subRun: 1 event: 2193 at 20-Jun-2025 21:35:34 CEST Begin processing the 194th record. run: 50258005 subRun: 1 event: 2194 at 20-Jun-2025 21:35:36 CEST Begin processing the 195th record. run: 50258005 subRun: 1 event: 2195 at 20-Jun-2025 21:35:36 CEST Begin processing the 196th record. run: 50258005 subRun: 1 event: 2196 at 20-Jun-2025 21:35:37 CEST Begin processing the 197th record. run: 50258005 subRun: 1 event: 2197 at 20-Jun-2025 21:35:39 CEST Begin processing the 198th record. run: 50258005 subRun: 1 event: 2198 at 20-Jun-2025 21:35:39 CEST Begin processing the 199th record. run: 50258005 subRun: 1 event: 2199 at 20-Jun-2025 21:35:40 CEST Begin processing the 200th record. run: 50258005 subRun: 1 event: 2200 at 20-Jun-2025 21:35:41 CEST 20-Jun-2025 21:35:42 CEST Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/31/c7/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_10_20231121T152349Z_gen_g4_detsim_hitreco__20240503T054158Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.233832 1.012 6.06932 0.831772 0.626746 200 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0182664 0.0396507 0.0966161 0.0364748 0.0128059 200 prod:pandorapid:Chi2ParticleID 0.105549 0.185479 0.288537 0.193677 0.0350561 200 prod:energyreconue:EnergyReco 0.0809592 0.321626 0.567448 0.325807 0.0723744 200 prod:energyreconumu:EnergyReco 0.00351109 0.176649 1.50363 0.165363 0.181791 200 prod:energyreconc:EnergyReco 0.00286945 0.0399682 0.295631 0.0331616 0.0386937 200 [art]:TriggerResults:TriggerResultInserter 1.0149e-05 1.81125e-05 0.000236305 1.5394e-05 1.79961e-05 200 end_path:ana:PIDASelectionAna 0.00346754 0.247972 3.50862 0.0657722 0.402248 200 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 11121.1 MB Peak resident set size usage (VmHWM): 1328.67 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 80 -rw-r--r-- 1 dune001 lbno 32935 Jun 20 21:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_10_20231121T152349Z_gen_g4_detsim_hitreco__20240503T054158Z_reco2_pida_2025-06-20T_193027Z.root -rw-r--r-- 1 dune001 lbno 24308 Jun 20 21:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258005_10_20231121T152349Z_gen_g4_detsim_hitreco__20240503T054158Z_reco2_reco_2025-06-20T_193027Z.log -rw-r--r-- 1 dune001 lbno 12108 Jun 20 21:35 jobscript.log -rw-r--r-- 1 dune001 lbno 216 Jun 20 21:35 justin-processed-pfns.txt -rw-r--r-- 1 dune001 lbno 137 Jun 20 21:30 all-input-dids.txt -rw-r--r-- 1 dune001 lbno 0 Jun 20 21:30 debugprod.log