21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 423673.98@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 423673.98@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7981 | |
| Stage ID | 1 | |
| User name | imawby@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 43200 (12 hours) | |
| Submitted time | 2025-06-27 12:45:59 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly | |
| Last heartbeat | 2025-06-27 14:00:49 | |
| From worker node | Hostname | dunegli-5941540-0-fnpc23046.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-27 13:36:52 | |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1413_564_20230826T183338Z_gen_g4_detsim_hitreco__20240223T003538Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 23m (1420s) | |
| CPU time | 23m (1386s = 97%) | |
| Max RSS bytes | 1659965440 (1583 MiB) | |
| Outputting started | 2025-06-27 14:00:33 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_0/07981/1/001/HierarchyRecoPerformance_nu_dune10kt_1x2x6_1413_564_20230826T183338Z_gen_g4_detsim_hitreco__20240223T003538Z_reco2.root | |
| Finished | 2025-06-27 14:00:49 | |
| Saved logs | justin-logs:423673.98-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
Justin processors: 1 Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/ MRB_PROJECT=larsoft MRB_PROJECT_VERSION=v10_08_00 MRB_QUALS=e26:prof MRB_TOP=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19 MRB_SOURCE=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/srcs MRB_BUILDDIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/build_slf7.x86_64 MRB_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/localProducts_larsoft_v10_08_00_e26_prof PRODUCTS=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/localProducts_larsoft_v10_08_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/ CETPKG_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/localProducts_larsoft_v10_08_00_e26_prof local product directory is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ba960f2d78c1c5ee2ebb9823e8434f1c8c704e19/localProducts_larsoft_v10_08_00_e26_prof ----------- this block should be empty ------------------ --------------------------------------------------------- Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ea/6d/nu_dune10kt_1x2x6_1413_564_20230826T183338Z_gen_g4_detsim_hitreco__20240223T003538Z_reco2.root lar exit code 0 === Start last 100 lines of lar log file === Begin processing the 54th record. run: 1413 subRun: 1 event: 56454 at 27-Jun-2025 13:40:19 UTC Begin processing the 55th record. run: 1413 subRun: 1 event: 56455 at 27-Jun-2025 13:40:21 UTC YES RECO: 11 GEN: 3 Begin processing the 56th record. run: 1413 subRun: 1 event: 56456 at 27-Jun-2025 13:40:24 UTC Begin processing the 57th record. run: 1413 subRun: 1 event: 56457 at 27-Jun-2025 13:40:25 UTC Begin processing the 58th record. run: 1413 subRun: 1 event: 56458 at 27-Jun-2025 13:40:27 UTC Begin processing the 59th record. run: 1413 subRun: 1 event: 56459 at 27-Jun-2025 13:40:29 UTC Begin processing the 60th record. run: 1413 subRun: 1 event: 56460 at 27-Jun-2025 13:40:30 UTC Begin processing the 61st record. run: 1413 subRun: 1 event: 56461 at 27-Jun-2025 13:40:32 UTC YES RECO: -11 GEN: 3 Begin processing the 62nd record. run: 1413 subRun: 1 event: 56462 at 27-Jun-2025 13:40:34 UTC Begin processing the 63rd record. run: 1413 subRun: 1 event: 56463 at 27-Jun-2025 13:40:36 UTC YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 4 YES RECO: 2212 GEN: 3 YES RECO: 22 GEN: 3 YES RECO: 22 GEN: 3 Begin processing the 64th record. run: 1413 subRun: 1 event: 56464 at 27-Jun-2025 13:40:37 UTC Begin processing the 65th record. run: 1413 subRun: 1 event: 56465 at 27-Jun-2025 13:40:39 UTC Begin processing the 66th record. run: 1413 subRun: 1 event: 56466 at 27-Jun-2025 13:59:25 UTC Begin processing the 67th record. run: 1413 subRun: 1 event: 56467 at 27-Jun-2025 13:59:27 UTC Begin processing the 68th record. run: 1413 subRun: 1 event: 56468 at 27-Jun-2025 13:59:29 UTC Begin processing the 69th record. run: 1413 subRun: 1 event: 56469 at 27-Jun-2025 13:59:30 UTC Begin processing the 70th record. run: 1413 subRun: 1 event: 56470 at 27-Jun-2025 13:59:32 UTC YES RECO: 11 GEN: 3 Begin processing the 71st record. run: 1413 subRun: 1 event: 56471 at 27-Jun-2025 13:59:34 UTC Begin processing the 72nd record. run: 1413 subRun: 1 event: 56472 at 27-Jun-2025 13:59:36 UTC YES RECO: 2212 GEN: 3 Begin processing the 73rd record. run: 1413 subRun: 1 event: 56473 at 27-Jun-2025 13:59:39 UTC Begin processing the 74th record. run: 1413 subRun: 1 event: 56474 at 27-Jun-2025 13:59:41 UTC YES RECO: 1000010020 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: 22 GEN: 3 YES RECO: 22 GEN: 3 Begin processing the 75th record. run: 1413 subRun: 1 event: 56475 at 27-Jun-2025 13:59:43 UTC YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 Begin processing the 76th record. run: 1413 subRun: 1 event: 56476 at 27-Jun-2025 13:59:45 UTC YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: -211 GEN: 3 Begin processing the 77th record. run: 1413 subRun: 1 event: 56477 at 27-Jun-2025 13:59:47 UTC Begin processing the 78th record. run: 1413 subRun: 1 event: 56478 at 27-Jun-2025 13:59:48 UTC Begin processing the 79th record. run: 1413 subRun: 1 event: 56479 at 27-Jun-2025 13:59:50 UTC Begin processing the 80th record. run: 1413 subRun: 1 event: 56480 at 27-Jun-2025 13:59:52 UTC Begin processing the 81st record. run: 1413 subRun: 1 event: 56481 at 27-Jun-2025 13:59:53 UTC YES RECO: 2212 GEN: 3 Begin processing the 82nd record. run: 1413 subRun: 1 event: 56482 at 27-Jun-2025 13:59:56 UTC YES RECO: -211 GEN: 3 Begin processing the 83rd record. run: 1413 subRun: 1 event: 56483 at 27-Jun-2025 13:59:58 UTC Begin processing the 84th record. run: 1413 subRun: 1 event: 56484 at 27-Jun-2025 14:00:00 UTC Begin processing the 85th record. run: 1413 subRun: 1 event: 56485 at 27-Jun-2025 14:00:01 UTC Begin processing the 86th record. run: 1413 subRun: 1 event: 56486 at 27-Jun-2025 14:00:04 UTC Begin processing the 87th record. run: 1413 subRun: 1 event: 56487 at 27-Jun-2025 14:00:06 UTC YES RECO: 22 GEN: 3 Begin processing the 88th record. run: 1413 subRun: 1 event: 56488 at 27-Jun-2025 14:00:08 UTC Begin processing the 89th record. run: 1413 subRun: 1 event: 56489 at 27-Jun-2025 14:00:10 UTC Begin processing the 90th record. run: 1413 subRun: 1 event: 56490 at 27-Jun-2025 14:00:12 UTC Begin processing the 91st record. run: 1413 subRun: 1 event: 56491 at 27-Jun-2025 14:00:13 UTC YES RECO: 211 GEN: 3 YES RECO: -11 GEN: 4 YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: 2212 GEN: 3 YES RECO: 22 GEN: 3 YES RECO: 22 GEN: 3 Begin processing the 92nd record. run: 1413 subRun: 1 event: 56492 at 27-Jun-2025 14:00:15 UTC Begin processing the 93rd record. run: 1413 subRun: 1 event: 56493 at 27-Jun-2025 14:00:17 UTC Begin processing the 94th record. run: 1413 subRun: 1 event: 56494 at 27-Jun-2025 14:00:18 UTC YES RECO: 211 GEN: 3 Begin processing the 95th record. run: 1413 subRun: 1 event: 56495 at 27-Jun-2025 14:00:20 UTC Begin processing the 96th record. run: 1413 subRun: 1 event: 56496 at 27-Jun-2025 14:00:21 UTC Begin processing the 97th record. run: 1413 subRun: 1 event: 56497 at 27-Jun-2025 14:00:24 UTC Begin processing the 98th record. run: 1413 subRun: 1 event: 56498 at 27-Jun-2025 14:00:25 UTC Begin processing the 99th record. run: 1413 subRun: 1 event: 56499 at 27-Jun-2025 14:00:27 UTC Begin processing the 100th record. run: 1413 subRun: 1 event: 56500 at 27-Jun-2025 14:00:29 UTC 27-Jun-2025 14:00:32 UTC Closed output file "nu_dune10kt_1x2x6_1413_564_20230826T183338Z_gen_g4_detsim_hitreco__20240223T003538Z_reco2_reco2.root" 27-Jun-2025 14:00:32 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ea/6d/nu_dune10kt_1x2x6_1413_564_20230826T183338Z_gen_g4_detsim_hitreco__20240223T003538Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.0516939 13.5675 1124.09 2.08802 111.625 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00111006 0.0327832 0.27796 0.0252203 0.0376621 100 reco:pandora:StandardPandora 0.010467 13.5235 1124 2.03392 111.621 100 [art]:TriggerResults:TriggerResultInserter 1.023e-05 2.79217e-05 0.000358047 2.10855e-05 3.85928e-05 100 end_path:out1:RootOutput 2.636e-06 5.01195e-06 2.5669e-05 4.489e-06 2.7583e-06 100 end_path:out1:RootOutput(write) 0.000852385 0.0109219 0.0793096 0.00720695 0.0127074 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2650.93 MB Peak resident set size usage (VmHWM): 1659.97 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file ===