21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 226779.97@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 226779.97@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7806 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 19:15:55 | |
| Site | UK_Sheffield | |
| Entry | DUNE_UK_Sheffield_lcgce2 | |
| Last heartbeat | 2025-06-20 20:05:02 | |
| From worker node | Hostname | wn026.hep |
| cpuinfo | Intel(R) Xeon(R) Gold 5215 CPU @ 2.50GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 19:30:53 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_612_20231204T004059Z_gen_g4_detsim_hitreco__20240509T210239Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 4m (249s) | |
| CPU time | 0m (43s = 17%) | |
| Max RSS bytes | 1097486336 (1046 MiB) | |
| Outputting started | 2025-06-20 19:35:03 | |
| Output files | ||
| Finished | 2025-06-20 20:05:02 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
1 event: 61229 at 20-Jun-2025 20:32:14 BST Begin processing the 30th record. run: 6419587 subRun: 1 event: 61230 at 20-Jun-2025 20:32:16 BST Begin processing the 31st record. run: 6419587 subRun: 1 event: 61231 at 20-Jun-2025 20:32:17 BST Begin processing the 32nd record. run: 6419587 subRun: 1 event: 61232 at 20-Jun-2025 20:32:26 BST Begin processing the 33rd record. run: 6419587 subRun: 1 event: 61233 at 20-Jun-2025 20:32:33 BST Begin processing the 34th record. run: 6419587 subRun: 1 event: 61234 at 20-Jun-2025 20:32:35 BST Begin processing the 35th record. run: 6419587 subRun: 1 event: 61235 at 20-Jun-2025 20:32:37 BST Begin processing the 36th record. run: 6419587 subRun: 1 event: 61236 at 20-Jun-2025 20:32:38 BST Begin processing the 37th record. run: 6419587 subRun: 1 event: 61237 at 20-Jun-2025 20:32:40 BST Begin processing the 38th record. run: 6419587 subRun: 1 event: 61238 at 20-Jun-2025 20:32:42 BST Begin processing the 39th record. run: 6419587 subRun: 1 event: 61239 at 20-Jun-2025 20:32:43 BST Begin processing the 40th record. run: 6419587 subRun: 1 event: 61240 at 20-Jun-2025 20:32:46 BST Begin processing the 41st record. run: 6419587 subRun: 1 event: 61241 at 20-Jun-2025 20:32:48 BST Begin processing the 42nd record. run: 6419587 subRun: 1 event: 61242 at 20-Jun-2025 20:32:48 BST Begin processing the 43rd record. run: 6419587 subRun: 1 event: 61243 at 20-Jun-2025 20:32:51 BST Begin processing the 44th record. run: 6419587 subRun: 1 event: 61244 at 20-Jun-2025 20:32:52 BST Begin processing the 45th record. run: 6419587 subRun: 1 event: 61245 at 20-Jun-2025 20:32:59 BST Begin processing the 46th record. run: 6419587 subRun: 1 event: 61246 at 20-Jun-2025 20:33:01 BST Begin processing the 47th record. run: 6419587 subRun: 1 event: 61247 at 20-Jun-2025 20:33:04 BST Begin processing the 48th record. run: 6419587 subRun: 1 event: 61248 at 20-Jun-2025 20:33:06 BST Begin processing the 49th record. run: 6419587 subRun: 1 event: 61249 at 20-Jun-2025 20:33:08 BST Begin processing the 50th record. run: 6419587 subRun: 1 event: 61250 at 20-Jun-2025 20:33:09 BST Begin processing the 51st record. run: 6419587 subRun: 1 event: 61251 at 20-Jun-2025 20:33:12 BST Begin processing the 52nd record. run: 6419587 subRun: 1 event: 61252 at 20-Jun-2025 20:33:14 BST Begin processing the 53rd record. run: 6419587 subRun: 1 event: 61253 at 20-Jun-2025 20:33:16 BST Begin processing the 54th record. run: 6419587 subRun: 1 event: 61254 at 20-Jun-2025 20:33:18 BST Begin processing the 55th record. run: 6419587 subRun: 1 event: 61255 at 20-Jun-2025 20:33:20 BST Begin processing the 56th record. run: 6419587 subRun: 1 event: 61256 at 20-Jun-2025 20:33:21 BST Begin processing the 57th record. run: 6419587 subRun: 1 event: 61257 at 20-Jun-2025 20:33:24 BST Begin processing the 58th record. run: 6419587 subRun: 1 event: 61258 at 20-Jun-2025 20:33:26 BST Begin processing the 59th record. run: 6419587 subRun: 1 event: 61259 at 20-Jun-2025 20:33:27 BST Begin processing the 60th record. run: 6419587 subRun: 1 event: 61260 at 20-Jun-2025 20:33:30 BST Begin processing the 61st record. run: 6419587 subRun: 1 event: 61261 at 20-Jun-2025 20:33:32 BST Begin processing the 62nd record. run: 6419587 subRun: 1 event: 61262 at 20-Jun-2025 20:33:32 BST Begin processing the 63rd record. run: 6419587 subRun: 1 event: 61263 at 20-Jun-2025 20:33:34 BST Begin processing the 64th record. run: 6419587 subRun: 1 event: 61264 at 20-Jun-2025 20:33:36 BST Begin processing the 65th record. run: 6419587 subRun: 1 event: 61265 at 20-Jun-2025 20:33:37 BST Begin processing the 66th record. run: 6419587 subRun: 1 event: 61266 at 20-Jun-2025 20:33:44 BST Begin processing the 67th record. run: 6419587 subRun: 1 event: 61267 at 20-Jun-2025 20:33:47 BST Begin processing the 68th record. run: 6419587 subRun: 1 event: 61268 at 20-Jun-2025 20:33:49 BST Begin processing the 69th record. run: 6419587 subRun: 1 event: 61269 at 20-Jun-2025 20:33:53 BST Begin processing the 70th record. run: 6419587 subRun: 1 event: 61270 at 20-Jun-2025 20:33:54 BST Begin processing the 71st record. run: 6419587 subRun: 1 event: 61271 at 20-Jun-2025 20:33:55 BST Begin processing the 72nd record. run: 6419587 subRun: 1 event: 61272 at 20-Jun-2025 20:33:57 BST Begin processing the 73rd record. run: 6419587 subRun: 1 event: 61273 at 20-Jun-2025 20:33:59 BST Begin processing the 74th record. run: 6419587 subRun: 1 event: 61274 at 20-Jun-2025 20:34:01 BST Begin processing the 75th record. run: 6419587 subRun: 1 event: 61275 at 20-Jun-2025 20:34:05 BST Begin processing the 76th record. run: 6419587 subRun: 1 event: 61276 at 20-Jun-2025 20:34:06 BST Begin processing the 77th record. run: 6419587 subRun: 1 event: 61277 at 20-Jun-2025 20:34:09 BST Begin processing the 78th record. run: 6419587 subRun: 1 event: 61278 at 20-Jun-2025 20:34:17 BST Begin processing the 79th record. run: 6419587 subRun: 1 event: 61279 at 20-Jun-2025 20:34:23 BST Begin processing the 80th record. run: 6419587 subRun: 1 event: 61280 at 20-Jun-2025 20:34:24 BST Begin processing the 81st record. run: 6419587 subRun: 1 event: 61281 at 20-Jun-2025 20:34:26 BST Begin processing the 82nd record. run: 6419587 subRun: 1 event: 61282 at 20-Jun-2025 20:34:27 BST Begin processing the 83rd record. run: 6419587 subRun: 1 event: 61283 at 20-Jun-2025 20:34:29 BST Begin processing the 84th record. run: 6419587 subRun: 1 event: 61284 at 20-Jun-2025 20:34:31 BST Begin processing the 85th record. run: 6419587 subRun: 1 event: 61285 at 20-Jun-2025 20:34:33 BST Begin processing the 86th record. run: 6419587 subRun: 1 event: 61286 at 20-Jun-2025 20:34:34 BST Begin processing the 87th record. run: 6419587 subRun: 1 event: 61287 at 20-Jun-2025 20:34:37 BST Begin processing the 88th record. run: 6419587 subRun: 1 event: 61288 at 20-Jun-2025 20:34:38 BST Begin processing the 89th record. run: 6419587 subRun: 1 event: 61289 at 20-Jun-2025 20:34:40 BST Begin processing the 90th record. run: 6419587 subRun: 1 event: 61290 at 20-Jun-2025 20:34:43 BST Begin processing the 91st record. run: 6419587 subRun: 1 event: 61291 at 20-Jun-2025 20:34:44 BST Begin processing the 92nd record. run: 6419587 subRun: 1 event: 61292 at 20-Jun-2025 20:34:45 BST Begin processing the 93rd record. run: 6419587 subRun: 1 event: 61293 at 20-Jun-2025 20:34:47 BST Begin processing the 94th record. run: 6419587 subRun: 1 event: 61294 at 20-Jun-2025 20:34:48 BST Begin processing the 95th record. run: 6419587 subRun: 1 event: 61295 at 20-Jun-2025 20:34:49 BST Begin processing the 96th record. run: 6419587 subRun: 1 event: 61296 at 20-Jun-2025 20:34:51 BST Begin processing the 97th record. run: 6419587 subRun: 1 event: 61297 at 20-Jun-2025 20:34:54 BST Begin processing the 98th record. run: 6419587 subRun: 1 event: 61298 at 20-Jun-2025 20:34:56 BST Begin processing the 99th record. run: 6419587 subRun: 1 event: 61299 at 20-Jun-2025 20:34:59 BST Begin processing the 100th record. run: 6419587 subRun: 1 event: 61300 at 20-Jun-2025 20:35:00 BST 20-Jun-2025 20:35:02 BST Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/cf/a8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_612_20231204T004059Z_gen_g4_detsim_hitreco__20240509T210239Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.370349 1.5907 4.48464 1.32525 0.826186 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0301551 0.0570993 0.101864 0.0595859 0.0163958 100 prod:pandorapid:Chi2ParticleID 0.176196 0.277964 0.410645 0.289568 0.0497052 100 prod:energyreconue:EnergyReco 0.132884 0.524789 0.891874 0.550143 0.145336 100 prod:energyreconumu:EnergyReco 0.00302552 0.253587 1.22707 0.278878 0.182752 100 prod:energyreconc:EnergyReco 0.0028099 0.063676 0.393559 0.0558403 0.0669724 100 [art]:TriggerResults:TriggerResultInserter 1.1045e-05 1.57104e-05 7.2139e-05 1.5206e-05 6.03594e-06 100 end_path:ana:PIDASelectionAna 0.0042117 0.413061 2.47913 0.0924828 0.523377 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 7637.56 MB Peak resident set size usage (VmHWM): 1097.49 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 64 -rw-r--r--. 1 dune001 dune 25605 Jun 20 20:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_612_20231204T004059Z_gen_g4_detsim_hitreco__20240509T210239Z_reco2_pida_2025-06-20T_193057Z.root -rw-r--r--. 1 dune001 dune 14115 Jun 20 20:35 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_612_20231204T004059Z_gen_g4_detsim_hitreco__20240509T210239Z_reco2_reco_2025-06-20T_193057Z.log -rw-r--r--. 1 dune001 dune 11894 Jun 20 20:35 jobscript.log -rw-r--r--. 1 dune001 dune 186 Jun 20 20:35 justin-processed-pfns.txt -rw-r--r--. 1 dune001 dune 137 Jun 20 20:30 all-input-dids.txt -rw-r--r--. 1 dune001 dune 0 Jun 20 20:31 debugprod.log