21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 418728.132@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 418728.132@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7799 | |
| Stage ID | 1 | |
| User name | hsouza@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 11:48:05 | |
| Site | NL_NIKHEF | |
| Entry | VIRGO_NL_NIKHEF_brug | |
| Last heartbeat | 2025-06-20 12:34:47 | |
| From worker node | Hostname | wn-choc-034.farm.nikhef.nl |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 3145728000 (3000 MiB) | |
| Wall seconds limit | 129600 (36 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 12:13:22 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1110_20231204T011133Z_gen_g4_detsim_hitreco__20240509T202508Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 0m (45s) | |
| CPU time | 0m (34s = 75%) | |
| Max RSS bytes | 865042432 (824 MiB) | |
| Outputting started | 2025-06-20 12:14:08 | |
| Output files | ||
| Finished | 2025-06-20 12:34:47 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
run: 6419587 subRun: 1 event: 111031 at 20-Jun-2025 14:13:52 CEST Begin processing the 32nd record. run: 6419587 subRun: 1 event: 111032 at 20-Jun-2025 14:13:52 CEST Begin processing the 33rd record. run: 6419587 subRun: 1 event: 111033 at 20-Jun-2025 14:13:53 CEST Begin processing the 34th record. run: 6419587 subRun: 1 event: 111034 at 20-Jun-2025 14:13:53 CEST Begin processing the 35th record. run: 6419587 subRun: 1 event: 111035 at 20-Jun-2025 14:13:53 CEST Begin processing the 36th record. run: 6419587 subRun: 1 event: 111036 at 20-Jun-2025 14:13:53 CEST Begin processing the 37th record. run: 6419587 subRun: 1 event: 111037 at 20-Jun-2025 14:13:53 CEST Begin processing the 38th record. run: 6419587 subRun: 1 event: 111038 at 20-Jun-2025 14:13:53 CEST Begin processing the 39th record. run: 6419587 subRun: 1 event: 111039 at 20-Jun-2025 14:13:53 CEST Begin processing the 40th record. run: 6419587 subRun: 1 event: 111040 at 20-Jun-2025 14:13:53 CEST Begin processing the 41st record. run: 6419587 subRun: 1 event: 111041 at 20-Jun-2025 14:13:53 CEST Begin processing the 42nd record. run: 6419587 subRun: 1 event: 111042 at 20-Jun-2025 14:13:54 CEST Begin processing the 43rd record. run: 6419587 subRun: 1 event: 111043 at 20-Jun-2025 14:13:54 CEST Begin processing the 44th record. run: 6419587 subRun: 1 event: 111044 at 20-Jun-2025 14:13:54 CEST Begin processing the 45th record. run: 6419587 subRun: 1 event: 111045 at 20-Jun-2025 14:13:55 CEST Begin processing the 46th record. run: 6419587 subRun: 1 event: 111046 at 20-Jun-2025 14:13:55 CEST Begin processing the 47th record. run: 6419587 subRun: 1 event: 111047 at 20-Jun-2025 14:13:55 CEST Begin processing the 48th record. run: 6419587 subRun: 1 event: 111048 at 20-Jun-2025 14:13:55 CEST Begin processing the 49th record. run: 6419587 subRun: 1 event: 111049 at 20-Jun-2025 14:13:56 CEST Begin processing the 50th record. run: 6419587 subRun: 1 event: 111050 at 20-Jun-2025 14:13:56 CEST Begin processing the 51st record. run: 6419587 subRun: 1 event: 111051 at 20-Jun-2025 14:13:56 CEST Begin processing the 52nd record. run: 6419587 subRun: 1 event: 111052 at 20-Jun-2025 14:13:56 CEST Begin processing the 53rd record. run: 6419587 subRun: 1 event: 111053 at 20-Jun-2025 14:13:56 CEST Begin processing the 54th record. run: 6419587 subRun: 1 event: 111054 at 20-Jun-2025 14:13:56 CEST Begin processing the 55th record. run: 6419587 subRun: 1 event: 111055 at 20-Jun-2025 14:13:56 CEST Begin processing the 56th record. run: 6419587 subRun: 1 event: 111056 at 20-Jun-2025 14:13:57 CEST Begin processing the 57th record. run: 6419587 subRun: 1 event: 111057 at 20-Jun-2025 14:13:57 CEST Begin processing the 58th record. run: 6419587 subRun: 1 event: 111058 at 20-Jun-2025 14:13:57 CEST Begin processing the 59th record. run: 6419587 subRun: 1 event: 111059 at 20-Jun-2025 14:13:58 CEST Begin processing the 60th record. run: 6419587 subRun: 1 event: 111060 at 20-Jun-2025 14:13:58 CEST Begin processing the 61st record. run: 6419587 subRun: 1 event: 111061 at 20-Jun-2025 14:13:58 CEST Begin processing the 62nd record. run: 6419587 subRun: 1 event: 111062 at 20-Jun-2025 14:13:58 CEST Begin processing the 63rd record. run: 6419587 subRun: 1 event: 111063 at 20-Jun-2025 14:13:58 CEST Begin processing the 64th record. run: 6419587 subRun: 1 event: 111064 at 20-Jun-2025 14:13:59 CEST Begin processing the 65th record. run: 6419587 subRun: 1 event: 111065 at 20-Jun-2025 14:14:00 CEST Begin processing the 66th record. run: 6419587 subRun: 1 event: 111066 at 20-Jun-2025 14:14:00 CEST Begin processing the 67th record. run: 6419587 subRun: 1 event: 111067 at 20-Jun-2025 14:14:00 CEST Begin processing the 68th record. run: 6419587 subRun: 1 event: 111068 at 20-Jun-2025 14:14:00 CEST Begin processing the 69th record. run: 6419587 subRun: 1 event: 111069 at 20-Jun-2025 14:14:01 CEST Begin processing the 70th record. run: 6419587 subRun: 1 event: 111070 at 20-Jun-2025 14:14:01 CEST Begin processing the 71st record. run: 6419587 subRun: 1 event: 111071 at 20-Jun-2025 14:14:01 CEST Begin processing the 72nd record. run: 6419587 subRun: 1 event: 111072 at 20-Jun-2025 14:14:01 CEST Begin processing the 73rd record. run: 6419587 subRun: 1 event: 111073 at 20-Jun-2025 14:14:02 CEST Begin processing the 74th record. run: 6419587 subRun: 1 event: 111074 at 20-Jun-2025 14:14:02 CEST Begin processing the 75th record. run: 6419587 subRun: 1 event: 111075 at 20-Jun-2025 14:14:02 CEST Begin processing the 76th record. run: 6419587 subRun: 1 event: 111076 at 20-Jun-2025 14:14:02 CEST Begin processing the 77th record. run: 6419587 subRun: 1 event: 111077 at 20-Jun-2025 14:14:02 CEST Begin processing the 78th record. run: 6419587 subRun: 1 event: 111078 at 20-Jun-2025 14:14:02 CEST Begin processing the 79th record. run: 6419587 subRun: 1 event: 111079 at 20-Jun-2025 14:14:02 CEST Begin processing the 80th record. run: 6419587 subRun: 1 event: 111080 at 20-Jun-2025 14:14:02 CEST Begin processing the 81st record. run: 6419587 subRun: 1 event: 111081 at 20-Jun-2025 14:14:03 CEST Begin processing the 82nd record. run: 6419587 subRun: 1 event: 111082 at 20-Jun-2025 14:14:03 CEST Begin processing the 83rd record. run: 6419587 subRun: 1 event: 111083 at 20-Jun-2025 14:14:03 CEST Begin processing the 84th record. run: 6419587 subRun: 1 event: 111084 at 20-Jun-2025 14:14:03 CEST Begin processing the 85th record. run: 6419587 subRun: 1 event: 111085 at 20-Jun-2025 14:14:04 CEST Begin processing the 86th record. run: 6419587 subRun: 1 event: 111086 at 20-Jun-2025 14:14:04 CEST Begin processing the 87th record. run: 6419587 subRun: 1 event: 111087 at 20-Jun-2025 14:14:05 CEST Begin processing the 88th record. run: 6419587 subRun: 1 event: 111088 at 20-Jun-2025 14:14:05 CEST Begin processing the 89th record. run: 6419587 subRun: 1 event: 111089 at 20-Jun-2025 14:14:05 CEST Begin processing the 90th record. run: 6419587 subRun: 1 event: 111090 at 20-Jun-2025 14:14:05 CEST Begin processing the 91st record. run: 6419587 subRun: 1 event: 111091 at 20-Jun-2025 14:14:05 CEST Begin processing the 92nd record. run: 6419587 subRun: 1 event: 111092 at 20-Jun-2025 14:14:05 CEST Begin processing the 93rd record. run: 6419587 subRun: 1 event: 111093 at 20-Jun-2025 14:14:05 CEST Begin processing the 94th record. run: 6419587 subRun: 1 event: 111094 at 20-Jun-2025 14:14:05 CEST Begin processing the 95th record. run: 6419587 subRun: 1 event: 111095 at 20-Jun-2025 14:14:06 CEST Begin processing the 96th record. run: 6419587 subRun: 1 event: 111096 at 20-Jun-2025 14:14:06 CEST Begin processing the 97th record. run: 6419587 subRun: 1 event: 111097 at 20-Jun-2025 14:14:06 CEST Begin processing the 98th record. run: 6419587 subRun: 1 event: 111098 at 20-Jun-2025 14:14:06 CEST Begin processing the 99th record. run: 6419587 subRun: 1 event: 111099 at 20-Jun-2025 14:14:07 CEST Begin processing the 100th record. run: 6419587 subRun: 1 event: 111100 at 20-Jun-2025 14:14:07 CEST 20-Jun-2025 14:14:07 CEST Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/7a/4a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1110_20231204T011133Z_gen_g4_detsim_hitreco__20240509T202508Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.0254804 0.151164 1.33128 0.0885916 0.188357 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00053864 0.00744365 0.0241297 0.00193202 0.00770747 100 prod:pandorapid:Chi2ParticleID 0.00106274 0.0146069 0.051479 0.00528582 0.0149678 100 prod:energyreconue:EnergyReco 0.00513441 0.024166 0.147943 0.0182349 0.0224938 100 prod:energyreconumu:EnergyReco 0.0015589 0.0509205 1.06675 0.00859945 0.133698 100 prod:energyreconc:EnergyReco 0.00343111 0.0204981 0.103362 0.0134317 0.0180766 100 [art]:TriggerResults:TriggerResultInserter 1.2573e-05 1.46605e-05 7.0693e-05 1.37975e-05 5.80519e-06 100 end_path:ana:PIDASelectionAna 0.00398062 0.0332196 0.259794 0.0178863 0.0454772 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 5251.95 MB Peak resident set size usage (VmHWM): 860.324 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === .: total 64 -rw-r--r--. 1 dune012 dune 26080 Jun 20 14:14 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1110_20231204T011133Z_gen_g4_detsim_hitreco__20240509T202508Z_reco2_pida_2025-06-20T_121326Z.root -rw-r--r--. 1 dune012 dune 14411 Jun 20 14:14 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_1110_20231204T011133Z_gen_g4_detsim_hitreco__20240509T202508Z_reco2_reco_2025-06-20T_121326Z.log -rw-r--r--. 1 dune012 dune 12111 Jun 20 14:14 jobscript.log -rw-r--r--. 1 dune012 dune 217 Jun 20 14:14 justin-processed-pfns.txt -rw-r--r--. 1 dune012 dune 138 Jun 20 14:13 all-input-dids.txt -rw-r--r--. 1 dune012 dune 0 Jun 20 14:13 debugprod.log