21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 418682.142@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 418682.142@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7799 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 11:08:54 | |
| Site | NL_NIKHEF | |
| Entry | VIRGO_NL_NIKHEF_brug | |
| Last heartbeat | 2025-06-20 12:18:03 | |
| From worker node | Hostname | wn-sate-051.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7551P 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 11:37:28 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_491_20231120T135541Z_gen_g4_detsim_hitreco__20240507T173234Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 1m (81s) | |
| CPU time | 1m (61s = 75%) | |
| Max RSS bytes | 1430233088 (1363 MiB) | |
| Outputting started | 2025-06-20 11:38:49 | |
| Output files | ||
| Finished | 2025-06-20 12:18:03 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
egin processing the 132nd record. run: 74251126 subRun: 1 event: 98332 at 20-Jun-2025 13:38:33 CEST Begin processing the 133rd record. run: 74251126 subRun: 1 event: 98333 at 20-Jun-2025 13:38:33 CEST Begin processing the 134th record. run: 74251126 subRun: 1 event: 98334 at 20-Jun-2025 13:38:33 CEST Begin processing the 135th record. run: 74251126 subRun: 1 event: 98335 at 20-Jun-2025 13:38:33 CEST Begin processing the 136th record. run: 74251126 subRun: 1 event: 98336 at 20-Jun-2025 13:38:34 CEST Begin processing the 137th record. run: 74251126 subRun: 1 event: 98337 at 20-Jun-2025 13:38:34 CEST Begin processing the 138th record. run: 74251126 subRun: 1 event: 98338 at 20-Jun-2025 13:38:34 CEST Begin processing the 139th record. run: 74251126 subRun: 1 event: 98339 at 20-Jun-2025 13:38:34 CEST Begin processing the 140th record. run: 74251126 subRun: 1 event: 98340 at 20-Jun-2025 13:38:34 CEST Begin processing the 141st record. run: 74251126 subRun: 1 event: 98341 at 20-Jun-2025 13:38:34 CEST Begin processing the 142nd record. run: 74251126 subRun: 1 event: 98342 at 20-Jun-2025 13:38:34 CEST Begin processing the 143rd record. run: 74251126 subRun: 1 event: 98343 at 20-Jun-2025 13:38:35 CEST Begin processing the 144th record. run: 74251126 subRun: 1 event: 98344 at 20-Jun-2025 13:38:35 CEST Begin processing the 145th record. run: 74251126 subRun: 1 event: 98345 at 20-Jun-2025 13:38:35 CEST Begin processing the 146th record. run: 74251126 subRun: 1 event: 98346 at 20-Jun-2025 13:38:35 CEST Begin processing the 147th record. run: 74251126 subRun: 1 event: 98347 at 20-Jun-2025 13:38:35 CEST Begin processing the 148th record. run: 74251126 subRun: 1 event: 98348 at 20-Jun-2025 13:38:38 CEST Begin processing the 149th record. run: 74251126 subRun: 1 event: 98349 at 20-Jun-2025 13:38:38 CEST Begin processing the 150th record. run: 74251126 subRun: 1 event: 98350 at 20-Jun-2025 13:38:38 CEST Begin processing the 151st record. run: 74251126 subRun: 1 event: 98351 at 20-Jun-2025 13:38:39 CEST Begin processing the 152nd record. run: 74251126 subRun: 1 event: 98352 at 20-Jun-2025 13:38:39 CEST Begin processing the 153rd record. run: 74251126 subRun: 1 event: 98353 at 20-Jun-2025 13:38:39 CEST Begin processing the 154th record. run: 74251126 subRun: 1 event: 98354 at 20-Jun-2025 13:38:39 CEST Begin processing the 155th record. run: 74251126 subRun: 1 event: 98355 at 20-Jun-2025 13:38:39 CEST Begin processing the 156th record. run: 74251126 subRun: 1 event: 98356 at 20-Jun-2025 13:38:40 CEST Begin processing the 157th record. run: 74251126 subRun: 1 event: 98357 at 20-Jun-2025 13:38:40 CEST Begin processing the 158th record. run: 74251126 subRun: 1 event: 98358 at 20-Jun-2025 13:38:41 CEST Begin processing the 159th record. run: 74251126 subRun: 1 event: 98359 at 20-Jun-2025 13:38:41 CEST Begin processing the 160th record. run: 74251126 subRun: 1 event: 98360 at 20-Jun-2025 13:38:41 CEST Begin processing the 161st record. run: 74251126 subRun: 1 event: 98361 at 20-Jun-2025 13:38:42 CEST Begin processing the 162nd record. run: 74251126 subRun: 1 event: 98362 at 20-Jun-2025 13:38:42 CEST Begin processing the 163rd record. run: 74251126 subRun: 1 event: 98363 at 20-Jun-2025 13:38:42 CEST Begin processing the 164th record. run: 74251126 subRun: 1 event: 98364 at 20-Jun-2025 13:38:42 CEST Begin processing the 165th record. run: 74251126 subRun: 1 event: 98365 at 20-Jun-2025 13:38:42 CEST Begin processing the 166th record. run: 74251126 subRun: 1 event: 98366 at 20-Jun-2025 13:38:42 CEST Begin processing the 167th record. run: 74251126 subRun: 1 event: 98367 at 20-Jun-2025 13:38:43 CEST Begin processing the 168th record. run: 74251126 subRun: 1 event: 98368 at 20-Jun-2025 13:38:43 CEST Begin processing the 169th record. run: 74251126 subRun: 1 event: 98369 at 20-Jun-2025 13:38:43 CEST Begin processing the 170th record. run: 74251126 subRun: 1 event: 98370 at 20-Jun-2025 13:38:43 CEST Begin processing the 171st record. run: 74251126 subRun: 1 event: 98371 at 20-Jun-2025 13:38:43 CEST Begin processing the 172nd record. run: 74251126 subRun: 1 event: 98372 at 20-Jun-2025 13:38:43 CEST Begin processing the 173rd record. run: 74251126 subRun: 1 event: 98373 at 20-Jun-2025 13:38:43 CEST Begin processing the 174th record. run: 74251126 subRun: 1 event: 98374 at 20-Jun-2025 13:38:43 CEST Begin processing the 175th record. run: 74251126 subRun: 1 event: 98375 at 20-Jun-2025 13:38:43 CEST Begin processing the 176th record. run: 74251126 subRun: 1 event: 98376 at 20-Jun-2025 13:38:43 CEST Begin processing the 177th record. run: 74251126 subRun: 1 event: 98377 at 20-Jun-2025 13:38:44 CEST Begin processing the 178th record. run: 74251126 subRun: 1 event: 98378 at 20-Jun-2025 13:38:44 CEST Begin processing the 179th record. run: 74251126 subRun: 1 event: 98379 at 20-Jun-2025 13:38:45 CEST Begin processing the 180th record. run: 74251126 subRun: 1 event: 98380 at 20-Jun-2025 13:38:45 CEST Begin processing the 181st record. run: 74251126 subRun: 1 event: 98381 at 20-Jun-2025 13:38:45 CEST Begin processing the 182nd record. run: 74251126 subRun: 1 event: 98382 at 20-Jun-2025 13:38:45 CEST Begin processing the 183rd record. run: 74251126 subRun: 1 event: 98383 at 20-Jun-2025 13:38:46 CEST Begin processing the 184th record. run: 74251126 subRun: 1 event: 98384 at 20-Jun-2025 13:38:46 CEST Begin processing the 185th record. run: 74251126 subRun: 1 event: 98385 at 20-Jun-2025 13:38:46 CEST Begin processing the 186th record. run: 74251126 subRun: 1 event: 98386 at 20-Jun-2025 13:38:46 CEST Begin processing the 187th record. run: 74251126 subRun: 1 event: 98387 at 20-Jun-2025 13:38:46 CEST Begin processing the 188th record. run: 74251126 subRun: 1 event: 98388 at 20-Jun-2025 13:38:46 CEST Begin processing the 189th record. run: 74251126 subRun: 1 event: 98389 at 20-Jun-2025 13:38:46 CEST Begin processing the 190th record. run: 74251126 subRun: 1 event: 98390 at 20-Jun-2025 13:38:47 CEST Begin processing the 191st record. run: 74251126 subRun: 1 event: 98391 at 20-Jun-2025 13:38:47 CEST Begin processing the 192nd record. run: 74251126 subRun: 1 event: 98392 at 20-Jun-2025 13:38:47 CEST Begin processing the 193rd record. run: 74251126 subRun: 1 event: 98393 at 20-Jun-2025 13:38:47 CEST Begin processing the 194th record. run: 74251126 subRun: 1 event: 98394 at 20-Jun-2025 13:38:47 CEST Begin processing the 195th record. run: 74251126 subRun: 1 event: 98395 at 20-Jun-2025 13:38:47 CEST Begin processing the 196th record. run: 74251126 subRun: 1 event: 98396 at 20-Jun-2025 13:38:47 CEST Begin processing the 197th record. run: 74251126 subRun: 1 event: 98397 at 20-Jun-2025 13:38:48 CEST Begin processing the 198th record. run: 74251126 subRun: 1 event: 98398 at 20-Jun-2025 13:38:48 CEST Begin processing the 199th record. run: 74251126 subRun: 1 event: 98399 at 20-Jun-2025 13:38:48 CEST Begin processing the 200th record. run: 74251126 subRun: 1 event: 98400 at 20-Jun-2025 13:38:48 CEST 20-Jun-2025 13:38:49 CEST Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/f1/5f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_491_20231120T135541Z_gen_g4_detsim_hitreco__20240507T173234Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.02906 0.177627 2.38429 0.106986 0.274899 200 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.000692599 0.0113761 0.0389601 0.0134996 0.00785356 200 prod:pandorapid:Chi2ParticleID 0.00125411 0.0225479 0.0803597 0.0231001 0.0160534 200 prod:energyreconue:EnergyReco 0.00578126 0.0296953 0.296326 0.0185669 0.0371016 200 prod:energyreconumu:EnergyReco 0.00149344 0.0475678 2.01324 0.0107187 0.166344 200 prod:energyreconc:EnergyReco 0.0039695 0.0176221 0.200448 0.012631 0.0216531 200 [art]:TriggerResults:TriggerResultInserter 1.2674e-05 1.57445e-05 9.2854e-05 1.4201e-05 8.48821e-06 200 end_path:ana:PIDASelectionAna 0.00356178 0.0483378 1.17055 0.0192813 0.120873 200 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 6894.96 MB Peak resident set size usage (VmHWM): 1430.23 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 84 -rw-r--r--. 1 dune012 dune 34559 Jun 20 13:38 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_491_20231120T135541Z_gen_g4_detsim_hitreco__20240507T173234Z_reco2_pida_2025-06-20T_113732Z.root -rw-r--r--. 1 dune012 dune 24511 Jun 20 13:38 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_491_20231120T135541Z_gen_g4_detsim_hitreco__20240507T173234Z_reco2_reco_2025-06-20T_113732Z.log -rw-r--r--. 1 dune012 dune 12187 Jun 20 13:38 jobscript.log -rw-r--r--. 1 dune012 dune 217 Jun 20 13:38 justin-processed-pfns.txt -rw-r--r--. 1 dune012 dune 138 Jun 20 13:37 all-input-dids.txt -rw-r--r--. 1 dune012 dune 0 Jun 20 13:37 debugprod.log