21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 226390.37@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 226390.37@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7800 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 11:49:35 | |
| Site | CH_UNIBE-LHEP | |
| Entry | OSG_CH_UNIBE_LHEP_ce02 | |
| Last heartbeat | 2025-06-20 12:55:40 | |
| From worker node | Hostname | wn-1-38.local |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 12:21:26 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_466_20231028T044238Z_gen_g4_detsim_hitreco__20240503T043805Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 16m (960s) | |
| CPU time | 1m (94s = 9%) | |
| Max RSS bytes | 1243877376 (1186 MiB) | |
| Outputting started | 2025-06-20 12:37:26 | |
| Output files | ||
| Finished | 2025-06-20 12:55:40 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
28 at 20-Jun-2025 14:33:03 CEST Begin processing the 129th record. run: 1794 subRun: 1 event: 93329 at 20-Jun-2025 14:33:04 CEST Begin processing the 130th record. run: 1794 subRun: 1 event: 93330 at 20-Jun-2025 14:33:06 CEST Begin processing the 131st record. run: 1794 subRun: 1 event: 93331 at 20-Jun-2025 14:33:08 CEST Begin processing the 132nd record. run: 1794 subRun: 1 event: 93332 at 20-Jun-2025 14:33:13 CEST Begin processing the 133rd record. run: 1794 subRun: 1 event: 93333 at 20-Jun-2025 14:33:15 CEST Begin processing the 134th record. run: 1794 subRun: 1 event: 93334 at 20-Jun-2025 14:33:22 CEST Begin processing the 135th record. run: 1794 subRun: 1 event: 93335 at 20-Jun-2025 14:33:24 CEST Begin processing the 136th record. run: 1794 subRun: 1 event: 93336 at 20-Jun-2025 14:33:30 CEST Begin processing the 137th record. run: 1794 subRun: 1 event: 93337 at 20-Jun-2025 14:33:38 CEST Begin processing the 138th record. run: 1794 subRun: 1 event: 93338 at 20-Jun-2025 14:33:41 CEST Begin processing the 139th record. run: 1794 subRun: 1 event: 93339 at 20-Jun-2025 14:34:00 CEST Begin processing the 140th record. run: 1794 subRun: 1 event: 93340 at 20-Jun-2025 14:34:01 CEST Begin processing the 141st record. run: 1794 subRun: 1 event: 93341 at 20-Jun-2025 14:34:03 CEST Begin processing the 142nd record. run: 1794 subRun: 1 event: 93342 at 20-Jun-2025 14:34:06 CEST Begin processing the 143rd record. run: 1794 subRun: 1 event: 93343 at 20-Jun-2025 14:34:32 CEST Begin processing the 144th record. run: 1794 subRun: 1 event: 93344 at 20-Jun-2025 14:34:34 CEST Begin processing the 145th record. run: 1794 subRun: 1 event: 93345 at 20-Jun-2025 14:34:36 CEST Begin processing the 146th record. run: 1794 subRun: 1 event: 93346 at 20-Jun-2025 14:34:40 CEST Begin processing the 147th record. run: 1794 subRun: 1 event: 93347 at 20-Jun-2025 14:34:41 CEST Begin processing the 148th record. run: 1794 subRun: 1 event: 93348 at 20-Jun-2025 14:34:43 CEST Begin processing the 149th record. run: 1794 subRun: 1 event: 93349 at 20-Jun-2025 14:34:50 CEST Begin processing the 150th record. run: 1794 subRun: 1 event: 93350 at 20-Jun-2025 14:34:52 CEST Begin processing the 151st record. run: 1794 subRun: 1 event: 93351 at 20-Jun-2025 14:34:54 CEST Begin processing the 152nd record. run: 1794 subRun: 1 event: 93352 at 20-Jun-2025 14:34:56 CEST Begin processing the 153rd record. run: 1794 subRun: 1 event: 93353 at 20-Jun-2025 14:34:57 CEST Begin processing the 154th record. run: 1794 subRun: 1 event: 93354 at 20-Jun-2025 14:34:59 CEST Begin processing the 155th record. run: 1794 subRun: 1 event: 93355 at 20-Jun-2025 14:35:00 CEST Begin processing the 156th record. run: 1794 subRun: 1 event: 93356 at 20-Jun-2025 14:35:01 CEST Begin processing the 157th record. run: 1794 subRun: 1 event: 93357 at 20-Jun-2025 14:35:02 CEST Begin processing the 158th record. run: 1794 subRun: 1 event: 93358 at 20-Jun-2025 14:35:10 CEST Begin processing the 159th record. run: 1794 subRun: 1 event: 93359 at 20-Jun-2025 14:35:11 CEST Begin processing the 160th record. run: 1794 subRun: 1 event: 93360 at 20-Jun-2025 14:35:12 CEST Begin processing the 161st record. run: 1794 subRun: 1 event: 93361 at 20-Jun-2025 14:35:13 CEST Begin processing the 162nd record. run: 1794 subRun: 1 event: 93362 at 20-Jun-2025 14:35:15 CEST Begin processing the 163rd record. run: 1794 subRun: 1 event: 93363 at 20-Jun-2025 14:35:15 CEST Begin processing the 164th record. run: 1794 subRun: 1 event: 93364 at 20-Jun-2025 14:35:17 CEST Begin processing the 165th record. run: 1794 subRun: 1 event: 93365 at 20-Jun-2025 14:35:20 CEST Begin processing the 166th record. run: 1794 subRun: 1 event: 93366 at 20-Jun-2025 14:35:21 CEST Begin processing the 167th record. run: 1794 subRun: 1 event: 93367 at 20-Jun-2025 14:35:22 CEST Begin processing the 168th record. run: 1794 subRun: 1 event: 93368 at 20-Jun-2025 14:35:45 CEST Begin processing the 169th record. run: 1794 subRun: 1 event: 93369 at 20-Jun-2025 14:35:46 CEST Begin processing the 170th record. run: 1794 subRun: 1 event: 93370 at 20-Jun-2025 14:35:47 CEST Begin processing the 171st record. run: 1794 subRun: 1 event: 93371 at 20-Jun-2025 14:35:48 CEST Begin processing the 172nd record. run: 1794 subRun: 1 event: 93372 at 20-Jun-2025 14:35:53 CEST Begin processing the 173rd record. run: 1794 subRun: 1 event: 93373 at 20-Jun-2025 14:35:55 CEST Begin processing the 174th record. run: 1794 subRun: 1 event: 93374 at 20-Jun-2025 14:35:59 CEST Begin processing the 175th record. run: 1794 subRun: 1 event: 93375 at 20-Jun-2025 14:36:20 CEST Begin processing the 176th record. run: 1794 subRun: 1 event: 93376 at 20-Jun-2025 14:36:22 CEST Begin processing the 177th record. run: 1794 subRun: 1 event: 93377 at 20-Jun-2025 14:36:22 CEST Begin processing the 178th record. run: 1794 subRun: 1 event: 93378 at 20-Jun-2025 14:36:24 CEST Begin processing the 179th record. run: 1794 subRun: 1 event: 93379 at 20-Jun-2025 14:36:27 CEST Begin processing the 180th record. run: 1794 subRun: 1 event: 93380 at 20-Jun-2025 14:36:28 CEST Begin processing the 181st record. run: 1794 subRun: 1 event: 93381 at 20-Jun-2025 14:36:29 CEST Begin processing the 182nd record. run: 1794 subRun: 1 event: 93382 at 20-Jun-2025 14:36:30 CEST Begin processing the 183rd record. run: 1794 subRun: 1 event: 93383 at 20-Jun-2025 14:36:31 CEST Begin processing the 184th record. run: 1794 subRun: 1 event: 93384 at 20-Jun-2025 14:36:33 CEST Begin processing the 185th record. run: 1794 subRun: 1 event: 93385 at 20-Jun-2025 14:36:34 CEST Begin processing the 186th record. run: 1794 subRun: 1 event: 93386 at 20-Jun-2025 14:36:42 CEST Begin processing the 187th record. run: 1794 subRun: 1 event: 93387 at 20-Jun-2025 14:36:44 CEST Begin processing the 188th record. run: 1794 subRun: 1 event: 93388 at 20-Jun-2025 14:36:46 CEST Begin processing the 189th record. run: 1794 subRun: 1 event: 93389 at 20-Jun-2025 14:36:47 CEST Begin processing the 190th record. run: 1794 subRun: 1 event: 93390 at 20-Jun-2025 14:36:49 CEST Begin processing the 191st record. run: 1794 subRun: 1 event: 93391 at 20-Jun-2025 14:36:52 CEST Begin processing the 192nd record. run: 1794 subRun: 1 event: 93392 at 20-Jun-2025 14:36:56 CEST Begin processing the 193rd record. run: 1794 subRun: 1 event: 93393 at 20-Jun-2025 14:36:57 CEST Begin processing the 194th record. run: 1794 subRun: 1 event: 93394 at 20-Jun-2025 14:36:59 CEST Begin processing the 195th record. run: 1794 subRun: 1 event: 93395 at 20-Jun-2025 14:37:02 CEST Begin processing the 196th record. run: 1794 subRun: 1 event: 93396 at 20-Jun-2025 14:37:03 CEST Begin processing the 197th record. run: 1794 subRun: 1 event: 93397 at 20-Jun-2025 14:37:15 CEST Begin processing the 198th record. run: 1794 subRun: 1 event: 93398 at 20-Jun-2025 14:37:16 CEST Begin processing the 199th record. run: 1794 subRun: 1 event: 93399 at 20-Jun-2025 14:37:17 CEST Begin processing the 200th record. run: 1794 subRun: 1 event: 93400 at 20-Jun-2025 14:37:20 CEST 20-Jun-2025 14:37:25 CEST Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/65/fd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_466_20231028T044238Z_gen_g4_detsim_hitreco__20240503T043805Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.392303 2.48303 29.2092 1.26045 3.97289 200 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0184847 0.0454167 0.273525 0.044286 0.0298195 200 prod:pandorapid:Chi2ParticleID 0.108639 0.235104 0.941968 0.193897 0.120815 200 prod:energyreconue:EnergyReco 0.223319 0.574649 1.65801 0.514087 0.254466 200 prod:energyreconumu:EnergyReco 0.00258456 0.159393 2.57994 0.114455 0.251962 200 prod:energyreconc:EnergyReco 0.00375526 0.160317 2.35568 0.0942276 0.258829 200 [art]:TriggerResults:TriggerResultInserter 1.1433e-05 2.07716e-05 8.078e-05 2.0105e-05 6.87809e-06 200 end_path:ana:PIDASelectionAna 0.0228339 1.30761 26.8396 0.257207 3.41936 200 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 7991.41 MB Peak resident set size usage (VmHWM): 1243.88 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 69 -rw-r--r-- 1 dune002 dune 32107 Jun 20 14:37 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_466_20231028T044238Z_gen_g4_detsim_hitreco__20240503T043805Z_reco2_pida_2025-06-20T_122131Z.root -rw-r--r-- 1 dune002 dune 23609 Jun 20 14:37 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_466_20231028T044238Z_gen_g4_detsim_hitreco__20240503T043805Z_reco2_reco_2025-06-20T_122131Z.log -rw-r--r-- 1 dune002 dune 11811 Jun 20 14:37 jobscript.log -rw-r--r-- 1 dune002 dune 183 Jun 20 14:37 justin-processed-pfns.txt -rw-r--r-- 1 dune002 dune 134 Jun 20 14:21 all-input-dids.txt -rw-r--r-- 1 dune002 dune 0 Jun 20 14:21 debugprod.log