justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226650.6@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226650.6@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7801
Stage ID1
User namehsouza@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes3145728000 (3000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 17:07:09
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2025-06-20 17:41:04
From worker nodeHostnamedune001-6374295.0-lcg2707.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes3145728000 (3000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 17:21:44
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50264716_28_20231122T124700Z_gen_g4_detsim_hitreco__20240507T180918Z_reco2.root
JobscriptExit code0
Real time3m (202s)
CPU time0m (44s = 21%)
Max RSS bytes1405587456 (1340 MiB)
Outputting started2025-06-20 17:25:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/hsouza/07801/1/010/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50264716_28_20231122T124700Z_gen_g4_detsim_hitreco__20240507T180918Z_reco2_pida_2025-06-20T_172149Z.root
Finished2025-06-20 17:41:04
Saved logsjustin-logs:226650.6-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-2025 17:23:00 UTC
Begin processing the 30th record. run: 50264716 subRun: 1 event: 2830 at 20-Jun-2025 17:23:03 UTC
Begin processing the 31st record. run: 50264716 subRun: 1 event: 2831 at 20-Jun-2025 17:23:06 UTC
Begin processing the 32nd record. run: 50264716 subRun: 1 event: 2832 at 20-Jun-2025 17:23:08 UTC
Begin processing the 33rd record. run: 50264716 subRun: 1 event: 2833 at 20-Jun-2025 17:23:10 UTC
Begin processing the 34th record. run: 50264716 subRun: 1 event: 2834 at 20-Jun-2025 17:23:12 UTC
Begin processing the 35th record. run: 50264716 subRun: 1 event: 2835 at 20-Jun-2025 17:23:14 UTC
Begin processing the 36th record. run: 50264716 subRun: 1 event: 2836 at 20-Jun-2025 17:23:16 UTC
Begin processing the 37th record. run: 50264716 subRun: 1 event: 2837 at 20-Jun-2025 17:23:17 UTC
Begin processing the 38th record. run: 50264716 subRun: 1 event: 2838 at 20-Jun-2025 17:23:19 UTC
Begin processing the 39th record. run: 50264716 subRun: 1 event: 2839 at 20-Jun-2025 17:23:20 UTC
Begin processing the 40th record. run: 50264716 subRun: 1 event: 2840 at 20-Jun-2025 17:23:22 UTC
Begin processing the 41st record. run: 50264716 subRun: 1 event: 2841 at 20-Jun-2025 17:23:23 UTC
Begin processing the 42nd record. run: 50264716 subRun: 1 event: 2842 at 20-Jun-2025 17:23:26 UTC
Begin processing the 43rd record. run: 50264716 subRun: 1 event: 2843 at 20-Jun-2025 17:23:31 UTC
Begin processing the 44th record. run: 50264716 subRun: 1 event: 2844 at 20-Jun-2025 17:23:33 UTC
Begin processing the 45th record. run: 50264716 subRun: 1 event: 2845 at 20-Jun-2025 17:23:34 UTC
Begin processing the 46th record. run: 50264716 subRun: 1 event: 2846 at 20-Jun-2025 17:23:35 UTC
Begin processing the 47th record. run: 50264716 subRun: 1 event: 2847 at 20-Jun-2025 17:23:37 UTC
Begin processing the 48th record. run: 50264716 subRun: 1 event: 2848 at 20-Jun-2025 17:23:38 UTC
Begin processing the 49th record. run: 50264716 subRun: 1 event: 2849 at 20-Jun-2025 17:23:40 UTC
Begin processing the 50th record. run: 50264716 subRun: 1 event: 2850 at 20-Jun-2025 17:23:41 UTC
Begin processing the 51st record. run: 50264716 subRun: 1 event: 2851 at 20-Jun-2025 17:23:43 UTC
Begin processing the 52nd record. run: 50264716 subRun: 1 event: 2852 at 20-Jun-2025 17:23:47 UTC
Begin processing the 53rd record. run: 50264716 subRun: 1 event: 2853 at 20-Jun-2025 17:23:49 UTC
Begin processing the 54th record. run: 50264716 subRun: 1 event: 2854 at 20-Jun-2025 17:23:51 UTC
Begin processing the 55th record. run: 50264716 subRun: 1 event: 2855 at 20-Jun-2025 17:23:52 UTC
Begin processing the 56th record. run: 50264716 subRun: 1 event: 2856 at 20-Jun-2025 17:23:53 UTC
Begin processing the 57th record. run: 50264716 subRun: 1 event: 2857 at 20-Jun-2025 17:23:55 UTC
Begin processing the 58th record. run: 50264716 subRun: 1 event: 2858 at 20-Jun-2025 17:23:56 UTC
Begin processing the 59th record. run: 50264716 subRun: 1 event: 2859 at 20-Jun-2025 17:23:57 UTC
Begin processing the 60th record. run: 50264716 subRun: 1 event: 2860 at 20-Jun-2025 17:23:57 UTC
Begin processing the 61st record. run: 50264716 subRun: 1 event: 2861 at 20-Jun-2025 17:23:59 UTC
Begin processing the 62nd record. run: 50264716 subRun: 1 event: 2862 at 20-Jun-2025 17:24:00 UTC
Begin processing the 63rd record. run: 50264716 subRun: 1 event: 2863 at 20-Jun-2025 17:24:02 UTC
Begin processing the 64th record. run: 50264716 subRun: 1 event: 2864 at 20-Jun-2025 17:24:03 UTC
Begin processing the 65th record. run: 50264716 subRun: 1 event: 2865 at 20-Jun-2025 17:24:04 UTC
Begin processing the 66th record. run: 50264716 subRun: 1 event: 2866 at 20-Jun-2025 17:24:05 UTC
Begin processing the 67th record. run: 50264716 subRun: 1 event: 2867 at 20-Jun-2025 17:24:07 UTC
Begin processing the 68th record. run: 50264716 subRun: 1 event: 2868 at 20-Jun-2025 17:24:10 UTC
Begin processing the 69th record. run: 50264716 subRun: 1 event: 2869 at 20-Jun-2025 17:24:11 UTC
Begin processing the 70th record. run: 50264716 subRun: 1 event: 2870 at 20-Jun-2025 17:24:12 UTC
Begin processing the 71st record. run: 50264716 subRun: 1 event: 2871 at 20-Jun-2025 17:24:18 UTC
Begin processing the 72nd record. run: 50264716 subRun: 1 event: 2872 at 20-Jun-2025 17:24:20 UTC
Begin processing the 73rd record. run: 50264716 subRun: 1 event: 2873 at 20-Jun-2025 17:24:21 UTC
Begin processing the 74th record. run: 50264716 subRun: 1 event: 2874 at 20-Jun-2025 17:24:22 UTC
Begin processing the 75th record. run: 50264716 subRun: 1 event: 2875 at 20-Jun-2025 17:24:23 UTC
Begin processing the 76th record. run: 50264716 subRun: 1 event: 2876 at 20-Jun-2025 17:24:25 UTC
Begin processing the 77th record. run: 50264716 subRun: 1 event: 2877 at 20-Jun-2025 17:24:27 UTC
Begin processing the 78th record. run: 50264716 subRun: 1 event: 2878 at 20-Jun-2025 17:24:28 UTC
Begin processing the 79th record. run: 50264716 subRun: 1 event: 2879 at 20-Jun-2025 17:24:29 UTC
Begin processing the 80th record. run: 50264716 subRun: 1 event: 2880 at 20-Jun-2025 17:24:31 UTC
Begin processing the 81st record. run: 50264716 subRun: 1 event: 2881 at 20-Jun-2025 17:24:32 UTC
Begin processing the 82nd record. run: 50264716 subRun: 1 event: 2882 at 20-Jun-2025 17:24:34 UTC
Begin processing the 83rd record. run: 50264716 subRun: 1 event: 2883 at 20-Jun-2025 17:24:35 UTC
Begin processing the 84th record. run: 50264716 subRun: 1 event: 2884 at 20-Jun-2025 17:24:37 UTC
Begin processing the 85th record. run: 50264716 subRun: 1 event: 2885 at 20-Jun-2025 17:24:39 UTC
Begin processing the 86th record. run: 50264716 subRun: 1 event: 2886 at 20-Jun-2025 17:24:41 UTC
Begin processing the 87th record. run: 50264716 subRun: 1 event: 2887 at 20-Jun-2025 17:24:44 UTC
Begin processing the 88th record. run: 50264716 subRun: 1 event: 2888 at 20-Jun-2025 17:24:46 UTC
Begin processing the 89th record. run: 50264716 subRun: 1 event: 2889 at 20-Jun-2025 17:24:48 UTC
Begin processing the 90th record. run: 50264716 subRun: 1 event: 2890 at 20-Jun-2025 17:24:49 UTC
Begin processing the 91st record. run: 50264716 subRun: 1 event: 2891 at 20-Jun-2025 17:24:51 UTC
Begin processing the 92nd record. run: 50264716 subRun: 1 event: 2892 at 20-Jun-2025 17:24:52 UTC
Begin processing the 93rd record. run: 50264716 subRun: 1 event: 2893 at 20-Jun-2025 17:24:54 UTC
Begin processing the 94th record. run: 50264716 subRun: 1 event: 2894 at 20-Jun-2025 17:24:55 UTC
Begin processing the 95th record. run: 50264716 subRun: 1 event: 2895 at 20-Jun-2025 17:24:56 UTC
Begin processing the 96th record. run: 50264716 subRun: 1 event: 2896 at 20-Jun-2025 17:24:57 UTC
Begin processing the 97th record. run: 50264716 subRun: 1 event: 2897 at 20-Jun-2025 17:24:59 UTC
Begin processing the 98th record. run: 50264716 subRun: 1 event: 2898 at 20-Jun-2025 17:25:01 UTC
Begin processing the 99th record. run: 50264716 subRun: 1 event: 2899 at 20-Jun-2025 17:25:03 UTC
Begin processing the 100th record. run: 50264716 subRun: 1 event: 2900 at 20-Jun-2025 17:25:05 UTC
20-Jun-2025 17:25:06 UTC  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/35/4b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50264716_28_20231122T124700Z_gen_g4_detsim_hitreco__20240507T180918Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.493538       1.36051       4.22012       1.17855      0.543496        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.026954      0.0505558     0.0775914     0.0474638     0.0166689       100    
prod:pandorapid:Chi2ParticleID                  0.15898       0.24314      0.307442      0.253219      0.0353998       100    
prod:energyreconue:EnergyReco                  0.273407      0.616855       1.01007       0.58637       0.13136        100    
prod:energyreconumu:EnergyReco                0.00143632      0.13045      0.757761      0.0901762     0.131346        100    
prod:energyreconc:EnergyReco                  0.00201515     0.0383641      0.33017      0.0382432     0.0474036       100    
[art]:TriggerResults:TriggerResultInserter    1.1637e-05    1.78389e-05   9.1278e-05    1.6435e-05    8.47551e-06      100    
end_path:ana:PIDASelectionAna                 0.00182043     0.280553       1.99919      0.0688717     0.344085        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 37083.9 MB
  Peak resident set size usage (VmHWM): 1405.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
.:
total 64
-rw-r--r-- 1 dune001 dune 26400 Jun 20 17:25 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50264716_28_20231122T124700Z_gen_g4_detsim_hitreco__20240507T180918Z_reco2_pida_2025-06-20T_172149Z.root
-rw-r--r-- 1 dune001 dune 14205 Jun 20 17:25 atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50264716_28_20231122T124700Z_gen_g4_detsim_hitreco__20240507T180918Z_reco2_reco_2025-06-20T_172149Z.log
-rw-r--r-- 1 dune001 dune 11954 Jun 20 17:25 jobscript.log
-rw-r--r-- 1 dune001 dune   216 Jun 20 17:25 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune   137 Jun 20 17:21 all-input-dids.txt
-rw-r--r-- 1 dune001 dune     0 Jun 20 17:21 debugprod.log
justIN time: 2025-08-14 21:51:36 UTC       justIN version: 01.03.02