21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 421772.8@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 421772.8@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7928 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-25 15:54:45 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2025-06-25 16:33:44 | |
| From worker node | Hostname | wn1206241.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-25 16:03:06 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_132_20231118T173336Z_gen_g4_detsim_hitreco__20240503T051652Z_reco2.root | |
| Outputting started | 2025-06-25 16:11:07 | |
| Output files | ||
| Finished | 2025-06-25 17:13:54 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
in processing the 131st record. run: 50231162 subRun: 1 event: 26531 at 25-Jun-2025 17:08:38 BST Begin processing the 132nd record. run: 50231162 subRun: 1 event: 26532 at 25-Jun-2025 17:08:39 BST Begin processing the 133rd record. run: 50231162 subRun: 1 event: 26533 at 25-Jun-2025 17:08:40 BST Begin processing the 134th record. run: 50231162 subRun: 1 event: 26534 at 25-Jun-2025 17:08:41 BST Begin processing the 135th record. run: 50231162 subRun: 1 event: 26535 at 25-Jun-2025 17:08:42 BST Begin processing the 136th record. run: 50231162 subRun: 1 event: 26536 at 25-Jun-2025 17:08:48 BST Begin processing the 137th record. run: 50231162 subRun: 1 event: 26537 at 25-Jun-2025 17:08:49 BST Begin processing the 138th record. run: 50231162 subRun: 1 event: 26538 at 25-Jun-2025 17:08:50 BST Begin processing the 139th record. run: 50231162 subRun: 1 event: 26539 at 25-Jun-2025 17:08:50 BST Begin processing the 140th record. run: 50231162 subRun: 1 event: 26540 at 25-Jun-2025 17:08:51 BST Begin processing the 141st record. run: 50231162 subRun: 1 event: 26541 at 25-Jun-2025 17:08:52 BST Begin processing the 142nd record. run: 50231162 subRun: 1 event: 26542 at 25-Jun-2025 17:08:55 BST Begin processing the 143rd record. run: 50231162 subRun: 1 event: 26543 at 25-Jun-2025 17:08:56 BST Begin processing the 144th record. run: 50231162 subRun: 1 event: 26544 at 25-Jun-2025 17:08:57 BST Begin processing the 145th record. run: 50231162 subRun: 1 event: 26545 at 25-Jun-2025 17:09:01 BST Begin processing the 146th record. run: 50231162 subRun: 1 event: 26546 at 25-Jun-2025 17:09:02 BST Begin processing the 147th record. run: 50231162 subRun: 1 event: 26547 at 25-Jun-2025 17:09:03 BST Begin processing the 148th record. run: 50231162 subRun: 1 event: 26548 at 25-Jun-2025 17:09:04 BST Begin processing the 149th record. run: 50231162 subRun: 1 event: 26549 at 25-Jun-2025 17:09:08 BST Begin processing the 150th record. run: 50231162 subRun: 1 event: 26550 at 25-Jun-2025 17:09:09 BST Begin processing the 151st record. run: 50231162 subRun: 1 event: 26551 at 25-Jun-2025 17:09:10 BST Begin processing the 152nd record. run: 50231162 subRun: 1 event: 26552 at 25-Jun-2025 17:09:13 BST Begin processing the 153rd record. run: 50231162 subRun: 1 event: 26553 at 25-Jun-2025 17:09:14 BST Begin processing the 154th record. run: 50231162 subRun: 1 event: 26554 at 25-Jun-2025 17:09:15 BST Begin processing the 155th record. run: 50231162 subRun: 1 event: 26555 at 25-Jun-2025 17:09:17 BST Begin processing the 156th record. run: 50231162 subRun: 1 event: 26556 at 25-Jun-2025 17:09:17 BST Begin processing the 157th record. run: 50231162 subRun: 1 event: 26557 at 25-Jun-2025 17:09:18 BST Begin processing the 158th record. run: 50231162 subRun: 1 event: 26558 at 25-Jun-2025 17:09:21 BST Begin processing the 159th record. run: 50231162 subRun: 1 event: 26559 at 25-Jun-2025 17:09:22 BST Begin processing the 160th record. run: 50231162 subRun: 1 event: 26560 at 25-Jun-2025 17:09:23 BST Begin processing the 161st record. run: 50231162 subRun: 1 event: 26561 at 25-Jun-2025 17:09:25 BST Begin processing the 162nd record. run: 50231162 subRun: 1 event: 26562 at 25-Jun-2025 17:09:26 BST Begin processing the 163rd record. run: 50231162 subRun: 1 event: 26563 at 25-Jun-2025 17:09:27 BST Begin processing the 164th record. run: 50231162 subRun: 1 event: 26564 at 25-Jun-2025 17:09:28 BST Begin processing the 165th record. run: 50231162 subRun: 1 event: 26565 at 25-Jun-2025 17:09:29 BST Begin processing the 166th record. run: 50231162 subRun: 1 event: 26566 at 25-Jun-2025 17:09:30 BST Begin processing the 167th record. run: 50231162 subRun: 1 event: 26567 at 25-Jun-2025 17:09:32 BST Begin processing the 168th record. run: 50231162 subRun: 1 event: 26568 at 25-Jun-2025 17:09:33 BST Begin processing the 169th record. run: 50231162 subRun: 1 event: 26569 at 25-Jun-2025 17:09:34 BST Begin processing the 170th record. run: 50231162 subRun: 1 event: 26570 at 25-Jun-2025 17:09:34 BST Begin processing the 171st record. run: 50231162 subRun: 1 event: 26571 at 25-Jun-2025 17:09:35 BST Begin processing the 172nd record. run: 50231162 subRun: 1 event: 26572 at 25-Jun-2025 17:09:36 BST Begin processing the 173rd record. run: 50231162 subRun: 1 event: 26573 at 25-Jun-2025 17:09:37 BST Begin processing the 174th record. run: 50231162 subRun: 1 event: 26574 at 25-Jun-2025 17:09:39 BST Begin processing the 175th record. run: 50231162 subRun: 1 event: 26575 at 25-Jun-2025 17:09:40 BST Begin processing the 176th record. run: 50231162 subRun: 1 event: 26576 at 25-Jun-2025 17:09:41 BST Begin processing the 177th record. run: 50231162 subRun: 1 event: 26577 at 25-Jun-2025 17:09:42 BST Begin processing the 178th record. run: 50231162 subRun: 1 event: 26578 at 25-Jun-2025 17:09:43 BST Begin processing the 179th record. run: 50231162 subRun: 1 event: 26579 at 25-Jun-2025 17:09:44 BST Begin processing the 180th record. run: 50231162 subRun: 1 event: 26580 at 25-Jun-2025 17:09:45 BST Begin processing the 181st record. run: 50231162 subRun: 1 event: 26581 at 25-Jun-2025 17:09:46 BST Begin processing the 182nd record. run: 50231162 subRun: 1 event: 26582 at 25-Jun-2025 17:09:47 BST Begin processing the 183rd record. run: 50231162 subRun: 1 event: 26583 at 25-Jun-2025 17:09:49 BST Begin processing the 184th record. run: 50231162 subRun: 1 event: 26584 at 25-Jun-2025 17:09:55 BST Begin processing the 185th record. run: 50231162 subRun: 1 event: 26585 at 25-Jun-2025 17:09:55 BST Begin processing the 186th record. run: 50231162 subRun: 1 event: 26586 at 25-Jun-2025 17:09:57 BST Begin processing the 187th record. run: 50231162 subRun: 1 event: 26587 at 25-Jun-2025 17:09:58 BST Begin processing the 188th record. run: 50231162 subRun: 1 event: 26588 at 25-Jun-2025 17:10:01 BST Begin processing the 189th record. run: 50231162 subRun: 1 event: 26589 at 25-Jun-2025 17:10:02 BST Begin processing the 190th record. run: 50231162 subRun: 1 event: 26590 at 25-Jun-2025 17:10:03 BST Begin processing the 191st record. run: 50231162 subRun: 1 event: 26591 at 25-Jun-2025 17:10:05 BST Begin processing the 192nd record. run: 50231162 subRun: 1 event: 26592 at 25-Jun-2025 17:10:10 BST Begin processing the 193rd record. run: 50231162 subRun: 1 event: 26593 at 25-Jun-2025 17:10:13 BST Begin processing the 194th record. run: 50231162 subRun: 1 event: 26594 at 25-Jun-2025 17:10:15 BST Begin processing the 195th record. run: 50231162 subRun: 1 event: 26595 at 25-Jun-2025 17:10:15 BST Begin processing the 196th record. run: 50231162 subRun: 1 event: 26596 at 25-Jun-2025 17:10:17 BST Begin processing the 197th record. run: 50231162 subRun: 1 event: 26597 at 25-Jun-2025 17:10:17 BST Begin processing the 198th record. run: 50231162 subRun: 1 event: 26598 at 25-Jun-2025 17:10:19 BST Begin processing the 199th record. run: 50231162 subRun: 1 event: 26599 at 25-Jun-2025 17:10:20 BST Begin processing the 200th record. run: 50231162 subRun: 1 event: 26600 at 25-Jun-2025 17:10:20 BST 25-Jun-2025 17:10:22 BST Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/8b/43/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_132_20231118T173336Z_gen_g4_detsim_hitreco__20240503T051652Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.281966 1.19263 8.72963 0.964985 0.991323 200 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0116455 0.0270588 0.0780972 0.0258049 0.0122159 200 prod:pandorapid:Chi2ParticleID 0.0603734 0.125525 0.270412 0.107364 0.0442535 200 prod:energyreconue:EnergyReco 0.156843 0.337114 1.33493 0.30757 0.141654 200 prod:energyreconumu:EnergyReco 0.00249836 0.160225 6.47719 0.0779751 0.488056 200 prod:energyreconc:EnergyReco 0.00613727 0.0703533 0.870509 0.0524553 0.0922683 200 [art]:TriggerResults:TriggerResultInserter 2.5028e-05 7.11192e-05 0.00061567 5.19275e-05 5.23127e-05 200 end_path:ana:PIDASelectionAna 0.0184001 0.470102 5.56088 0.357299 0.509842 200 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 19622.1 MB Peak resident set size usage (VmHWM): 1222.48 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 76 -rw-r--r-- 1 dune01 dune01 28303 Jun 25 17:10 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_132_20231118T173336Z_gen_g4_detsim_hitreco__20240503T051652Z_reco2_pida_2025-06-25T_160331Z.root -rw-r--r-- 1 dune01 dune01 24224 Jun 25 17:10 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50231162_132_20231118T173336Z_gen_g4_detsim_hitreco__20240503T051652Z_reco2_reco_2025-06-25T_160331Z.log -rw-r--r-- 1 dune01 dune01 12053 Jun 25 17:10 jobscript.log -rw-r--r-- 1 dune01 dune01 189 Jun 25 17:10 justin-processed-pfns.txt -rw-r--r-- 1 dune01 dune01 138 Jun 25 17:03 all-input-dids.txt -rw-r--r-- 1 dune01 dune01 0 Jun 25 17:03 debugprod.log