21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 420720.133@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 420720.133@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7875 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-24 10:33:53 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2025-06-24 19:24:27 | |
| From worker node | Hostname | wn5917301.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-24 10:46:34 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_203_20231201T212738Z_gen_g4_detsim_hitreco.root | |
| Outputting started | 2025-06-24 11:03:21 | |
| Output files | ||
| Finished | 2025-06-24 20:26:26 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
soft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory Justin processors: 1 /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c4/d6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_203_20231201T212738Z_gen_g4_detsim_hitreco.root /cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so === Start last 100 lines of lar log file === minwire 1: 948 minwire 2: 0 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.075977, 0.00594408, 0.918079, Output 1: 0.112141, 0.562498, 0.297566, 0.0277962, Output 2: 0.659184, 0.303318, 0.0359274, 0.00157035, 466 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1400! Begin processing the 99th record. run: 74496296 subRun: 1 event: 20399 at 24-Jun-2025 12:03:03 BST Boundary wire vector sizes: 163, 305, 181 minwire 0: 1583 minwire 1: 630 minwire 2: 1637 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00492645, 0.172359, 0.822714, Output 1: 0.981764, 0.0170665, 0.000832342, 0.00033723, Output 2: 0.993226, 0.00659582, 0.000140082, 3.83689e-05, %MSG-e DUNEAna: EnergyReco:energyrecnumurange@BeginModule 24-Jun-2025 12:03:07 BST run: 74496296 subRun: 1 event: 20399 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 12:03:07 BST run: 74496296 subRun: 1 event: 20399 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 641 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 2404! Begin processing the 100th record. run: 74496296 subRun: 1 event: 20400 at 24-Jun-2025 12:03:12 BST Boundary wire vector sizes: 63, 76, 56 minwire 0: 407 minwire 1: 2115 minwire 2: 17 Used alternate method to get min and max wires due to vertex determination failure: 5, 304 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 89, 388 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.913407, 0.000654996, 0.0859377, Output 1: 0.98757, 0.0118237, 0.000467066, 0.000138841, Output 2: 0.930172, 0.0679115, 0.00169163, 0.000224629, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 12:03:15 BST run: 74496296 subRun: 1 event: 20400 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 402 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1352! 24-Jun-2025 12:03:20 BST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_203_20231201T212738Z_gen_g4_detsim_hitreco_reco2.root" 24-Jun-2025 12:03:20 BST Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c4/d6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_203_20231201T212738Z_gen_g4_detsim_hitreco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 3.18647 7.13582 19.9927 6.62296 2.79552 100 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0228628 0.0280274 0.0575897 0.0238274 0.00892335 100 reco:pandora:StandardPandora 1.58778 2.33096 12.1629 1.95877 1.42285 100 reco:pandoraTrack:LArPandoraTrackCreation 0.000129405 0.00520304 0.0450204 0.00180754 0.00805524 100 reco:pandoraShower:LArPandoraModularShowerCreation 0.000185339 0.0199091 0.372425 0.00369754 0.0488671 100 reco:pandoracalo:Calorimetry 0.000102313 0.0128981 0.203328 0.00166842 0.0349044 100 reco:pandorapid:Chi2ParticleID 3.8503e-05 0.000189201 0.00168775 0.000149162 0.000181446 100 reco:cvnmap:CVNMapper 2.7532e-05 0.010191 0.0220402 0.012031 0.00574449 100 reco:cvneva:CVNEvaluator 1.7483e-05 0.482182 3.57093 0.576253 0.393477 100 reco:energyrecnumu:EnergyReco 0.0680805 0.166646 2.18035 0.117927 0.230578 100 reco:energyrecnue:EnergyReco 0.00025438 0.0127364 0.070946 0.00120853 0.0244505 100 reco:energyrecnc:EnergyReco 0.00377554 0.107325 0.209582 0.128135 0.0544709 100 reco:energyrecnumurange:EnergyReco 0.00024924 0.0500714 1.69054 0.0017952 0.185958 100 reco:energyrecnumumcs:EnergyReco 0.000151356 0.0453397 1.23772 0.00180496 0.14738 100 reco:opdec:Deconvolution 0.123752 0.327676 0.502284 0.322407 0.0883862 100 reco:ophitspe:OpHitFinderDeco 0.853442 3.17955 5.43501 3.07225 1.12265 100 reco:opflash:OpFlashFinder 0.000416747 0.00173541 0.00566273 0.00162343 0.000761784 100 reco:rns:RandomNumberSaver 1.9046e-05 3.07651e-05 0.000403742 2.57335e-05 3.81042e-05 100 reco:anglereconue:NuAngularReco 0.000150805 0.00102909 0.0110755 0.000384415 0.00171549 100 reco:anglereconumu:NuAngularReco 7.4811e-05 0.000895767 0.0111108 0.000270992 0.0016869 100 reco:anglereconuepfps:NuAngularReco 0.000116059 0.00105554 0.0111315 0.000391934 0.00175693 100 reco:anglereconumupfps:NuAngularReco 0.000105389 0.000992161 0.0112867 0.000371331 0.00174806 100 [art]:TriggerResults:TriggerResultInserter 1.097e-05 1.57676e-05 0.000122722 1.4578e-05 1.0949e-05 100 end_path:out1:RootOutput 3.156e-06 4.21676e-06 2.659e-05 3.983e-06 2.28227e-06 100 end_path:out1:RootOutput(write) 0.0305481 0.349853 0.602521 0.405364 0.163231 100 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3582.61 MB Peak resident set size usage (VmHWM): 1808.13 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === lar exit code 0