21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 226778.155@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 226778.155@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7805 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 19:15:49 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce04 | |
| Last heartbeat | 2025-06-20 19:55:04 | |
| From worker node | Hostname | ccwcondor0778 |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 19:29:12 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_255_20231122T061351Z_gen_g4_detsim_hitreco__20240503T060051Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 5m (351s) | |
| CPU time | 1m (69s = 19%) | |
| Max RSS bytes | 1365471232 (1302 MiB) | |
| Outputting started | 2025-06-20 19:35:04 | |
| Output files | ||
| Finished | 2025-06-20 19:55:04 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
51131 at 20-Jun-2025 21:32:53 CEST Begin processing the 132nd record. run: 50258586 subRun: 1 event: 51132 at 20-Jun-2025 21:32:54 CEST Begin processing the 133rd record. run: 50258586 subRun: 1 event: 51133 at 20-Jun-2025 21:32:56 CEST Begin processing the 134th record. run: 50258586 subRun: 1 event: 51134 at 20-Jun-2025 21:32:57 CEST Begin processing the 135th record. run: 50258586 subRun: 1 event: 51135 at 20-Jun-2025 21:32:59 CEST Begin processing the 136th record. run: 50258586 subRun: 1 event: 51136 at 20-Jun-2025 21:33:00 CEST Begin processing the 137th record. run: 50258586 subRun: 1 event: 51137 at 20-Jun-2025 21:33:01 CEST Begin processing the 138th record. run: 50258586 subRun: 1 event: 51138 at 20-Jun-2025 21:33:03 CEST Begin processing the 139th record. run: 50258586 subRun: 1 event: 51139 at 20-Jun-2025 21:33:06 CEST Begin processing the 140th record. run: 50258586 subRun: 1 event: 51140 at 20-Jun-2025 21:33:07 CEST Begin processing the 141st record. run: 50258586 subRun: 1 event: 51141 at 20-Jun-2025 21:33:09 CEST Begin processing the 142nd record. run: 50258586 subRun: 1 event: 51142 at 20-Jun-2025 21:33:11 CEST Begin processing the 143rd record. run: 50258586 subRun: 1 event: 51143 at 20-Jun-2025 21:33:12 CEST Begin processing the 144th record. run: 50258586 subRun: 1 event: 51144 at 20-Jun-2025 21:33:13 CEST Begin processing the 145th record. run: 50258586 subRun: 1 event: 51145 at 20-Jun-2025 21:33:14 CEST Begin processing the 146th record. run: 50258586 subRun: 1 event: 51146 at 20-Jun-2025 21:33:15 CEST Begin processing the 147th record. run: 50258586 subRun: 1 event: 51147 at 20-Jun-2025 21:33:16 CEST Begin processing the 148th record. run: 50258586 subRun: 1 event: 51148 at 20-Jun-2025 21:33:17 CEST Begin processing the 149th record. run: 50258586 subRun: 1 event: 51149 at 20-Jun-2025 21:33:18 CEST Begin processing the 150th record. run: 50258586 subRun: 1 event: 51150 at 20-Jun-2025 21:33:19 CEST Begin processing the 151st record. run: 50258586 subRun: 1 event: 51151 at 20-Jun-2025 21:33:19 CEST Begin processing the 152nd record. run: 50258586 subRun: 1 event: 51152 at 20-Jun-2025 21:33:20 CEST Begin processing the 153rd record. run: 50258586 subRun: 1 event: 51153 at 20-Jun-2025 21:33:21 CEST Begin processing the 154th record. run: 50258586 subRun: 1 event: 51154 at 20-Jun-2025 21:33:23 CEST Begin processing the 155th record. run: 50258586 subRun: 1 event: 51155 at 20-Jun-2025 21:33:25 CEST Begin processing the 156th record. run: 50258586 subRun: 1 event: 51156 at 20-Jun-2025 21:33:26 CEST Begin processing the 157th record. run: 50258586 subRun: 1 event: 51157 at 20-Jun-2025 21:33:28 CEST Begin processing the 158th record. run: 50258586 subRun: 1 event: 51158 at 20-Jun-2025 21:33:36 CEST Begin processing the 159th record. run: 50258586 subRun: 1 event: 51159 at 20-Jun-2025 21:33:38 CEST Begin processing the 160th record. run: 50258586 subRun: 1 event: 51160 at 20-Jun-2025 21:33:38 CEST Begin processing the 161st record. run: 50258586 subRun: 1 event: 51161 at 20-Jun-2025 21:33:39 CEST Begin processing the 162nd record. run: 50258586 subRun: 1 event: 51162 at 20-Jun-2025 21:33:40 CEST Begin processing the 163rd record. run: 50258586 subRun: 1 event: 51163 at 20-Jun-2025 21:33:42 CEST Begin processing the 164th record. run: 50258586 subRun: 1 event: 51164 at 20-Jun-2025 21:33:42 CEST Begin processing the 165th record. run: 50258586 subRun: 1 event: 51165 at 20-Jun-2025 21:33:43 CEST Begin processing the 166th record. run: 50258586 subRun: 1 event: 51166 at 20-Jun-2025 21:33:44 CEST Begin processing the 167th record. run: 50258586 subRun: 1 event: 51167 at 20-Jun-2025 21:33:45 CEST Begin processing the 168th record. run: 50258586 subRun: 1 event: 51168 at 20-Jun-2025 21:33:46 CEST Begin processing the 169th record. run: 50258586 subRun: 1 event: 51169 at 20-Jun-2025 21:33:48 CEST Begin processing the 170th record. run: 50258586 subRun: 1 event: 51170 at 20-Jun-2025 21:33:56 CEST Begin processing the 171st record. run: 50258586 subRun: 1 event: 51171 at 20-Jun-2025 21:33:57 CEST Begin processing the 172nd record. run: 50258586 subRun: 1 event: 51172 at 20-Jun-2025 21:33:58 CEST Begin processing the 173rd record. run: 50258586 subRun: 1 event: 51173 at 20-Jun-2025 21:33:59 CEST Begin processing the 174th record. run: 50258586 subRun: 1 event: 51174 at 20-Jun-2025 21:34:00 CEST Begin processing the 175th record. run: 50258586 subRun: 1 event: 51175 at 20-Jun-2025 21:34:02 CEST Begin processing the 176th record. run: 50258586 subRun: 1 event: 51176 at 20-Jun-2025 21:34:04 CEST Begin processing the 177th record. run: 50258586 subRun: 1 event: 51177 at 20-Jun-2025 21:34:06 CEST Begin processing the 178th record. run: 50258586 subRun: 1 event: 51178 at 20-Jun-2025 21:34:07 CEST Begin processing the 179th record. run: 50258586 subRun: 1 event: 51179 at 20-Jun-2025 21:34:15 CEST Begin processing the 180th record. run: 50258586 subRun: 1 event: 51180 at 20-Jun-2025 21:34:17 CEST Begin processing the 181st record. run: 50258586 subRun: 1 event: 51181 at 20-Jun-2025 21:34:19 CEST Begin processing the 182nd record. run: 50258586 subRun: 1 event: 51182 at 20-Jun-2025 21:34:22 CEST Begin processing the 183rd record. run: 50258586 subRun: 1 event: 51183 at 20-Jun-2025 21:34:23 CEST Begin processing the 184th record. run: 50258586 subRun: 1 event: 51184 at 20-Jun-2025 21:34:24 CEST Begin processing the 185th record. run: 50258586 subRun: 1 event: 51185 at 20-Jun-2025 21:34:25 CEST Begin processing the 186th record. run: 50258586 subRun: 1 event: 51186 at 20-Jun-2025 21:34:27 CEST Begin processing the 187th record. run: 50258586 subRun: 1 event: 51187 at 20-Jun-2025 21:34:28 CEST Begin processing the 188th record. run: 50258586 subRun: 1 event: 51188 at 20-Jun-2025 21:34:30 CEST Begin processing the 189th record. run: 50258586 subRun: 1 event: 51189 at 20-Jun-2025 21:34:31 CEST Begin processing the 190th record. run: 50258586 subRun: 1 event: 51190 at 20-Jun-2025 21:34:32 CEST Begin processing the 191st record. run: 50258586 subRun: 1 event: 51191 at 20-Jun-2025 21:34:33 CEST Begin processing the 192nd record. run: 50258586 subRun: 1 event: 51192 at 20-Jun-2025 21:34:34 CEST Begin processing the 193rd record. run: 50258586 subRun: 1 event: 51193 at 20-Jun-2025 21:34:41 CEST Begin processing the 194th record. run: 50258586 subRun: 1 event: 51194 at 20-Jun-2025 21:34:42 CEST Begin processing the 195th record. run: 50258586 subRun: 1 event: 51195 at 20-Jun-2025 21:34:42 CEST Begin processing the 196th record. run: 50258586 subRun: 1 event: 51196 at 20-Jun-2025 21:34:43 CEST Begin processing the 197th record. run: 50258586 subRun: 1 event: 51197 at 20-Jun-2025 21:34:47 CEST Begin processing the 198th record. run: 50258586 subRun: 1 event: 51198 at 20-Jun-2025 21:34:49 CEST Begin processing the 199th record. run: 50258586 subRun: 1 event: 51199 at 20-Jun-2025 21:35:00 CEST Begin processing the 200th record. run: 50258586 subRun: 1 event: 51200 at 20-Jun-2025 21:35:02 CEST 20-Jun-2025 21:35:04 CEST Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/6b/a6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_255_20231122T061351Z_gen_g4_detsim_hitreco__20240503T060051Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.257708 1.12609 5.02671 0.964095 0.664243 200 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0200926 0.0494844 0.505942 0.0454633 0.0366205 200 prod:pandorapid:Chi2ParticleID 0.117102 0.212795 0.539574 0.211615 0.0551819 200 prod:energyreconue:EnergyReco 0.0900548 0.383987 0.764233 0.391584 0.112239 200 prod:energyreconumu:EnergyReco 0.00373381 0.186677 1.27474 0.184227 0.186922 200 prod:energyreconc:EnergyReco 0.00322346 0.0491343 0.414499 0.0447365 0.0574646 200 [art]:TriggerResults:TriggerResultInserter 1.088e-05 1.70928e-05 9.5981e-05 1.56895e-05 8.96952e-06 200 end_path:ana:PIDASelectionAna 0.00305299 0.243418 2.3526 0.0675253 0.36243 200 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 11137.7 MB Peak resident set size usage (VmHWM): 1365.47 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 76 -rw-r--r-- 1 dune001 lbno 31269 Jun 20 21:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_255_20231122T061351Z_gen_g4_detsim_hitreco__20240503T060051Z_reco2_pida_2025-06-20T_192918Z.root -rw-r--r-- 1 dune001 lbno 24421 Jun 20 21:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_255_20231122T061351Z_gen_g4_detsim_hitreco__20240503T060051Z_reco2_reco_2025-06-20T_192918Z.log -rw-r--r-- 1 dune001 lbno 12127 Jun 20 21:35 jobscript.log -rw-r--r-- 1 dune001 lbno 187 Jun 20 21:35 justin-processed-pfns.txt -rw-r--r-- 1 dune001 lbno 138 Jun 20 21:29 all-input-dids.txt -rw-r--r-- 1 dune001 lbno 0 Jun 20 21:29 debugprod.log