justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301489.184@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301489.184@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:05:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:04:45
From worker nodeHostnamedune001-2993375.0-lcg2721.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:10
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2.root
JobscriptExit code0
Real time35m (2128s)
CPU time35m (2140s = 100%)
Outputting started2024-11-22 23:58:39
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2.root
Finished2024-11-23 00:04:45
Saved logsjustin-logs:301489.184-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:35 UTC run: 74581430 subRun: 1 event: 48700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 299, 352, 327
minwire 0: 534
minwire 1: 2003
minwire 2: 365
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.154556, 0.812784, 0.0326604, 
Output 1: 0.0175869, 0.464426, 0.505609, 0.0123778, 
Output 2: 0.902401, 0.0975993, 

474
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1453!
22-Nov-2024 23:58:38 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2_reco_data_2024-11-22T_232314Z.root"
22-Nov-2024 23:58:38 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/d4/05/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.589472       20.0915       386.592       7.93215       46.5374        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0175561     0.0874463     0.294482      0.0688125     0.0574951       100    
reco:linecluster:LineCluster                           0.036485      0.482181       17.5134      0.232297       1.75894        100    
reco:trajcluster:TrajCluster                          0.00103624     0.654067       32.1554      0.0872451      3.44728        100    
reco:pandora:StandardPandora                           0.0582964      1.83745       25.1035       1.33291       2.79983        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00013234    0.00493646     0.0951369    0.00130618     0.0116614       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000171409    0.0101749     0.115875     0.00211962     0.020779        100    
reco:pandoracalo:Calorimetry                          9.3601e-05     0.0155994     0.658062     0.000777823    0.0752323       100    
reco:pandorapid:Chi2ParticleID                        3.5925e-05    0.00016989    0.00217806    0.000129896   0.000224623      100    
reco:trkshowersplit:TrackShowerHits                   6.6169e-05     0.0217265       1.008      0.000540875    0.113153        100    
reco:pmtrack:PMAlgTrackMaker                          0.000983553     1.64851       53.9888      0.141181       6.1436         100    
reco:pmtrackcalo:Calorimetry                          5.4121e-05    0.00495211     0.127465     0.000847527    0.0154334       100    
reco:pmtrackpid:Chi2ParticleID                        2.0221e-05    0.000237615   0.00203062    0.000160026   0.000280704      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000174844     1.78539       40.3484      0.197756       5.74966        100    
reco:pmtrajfitcalo:Calorimetry                        5.2259e-05     0.0161242     0.680705     0.00134485     0.0770818       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.1242e-05    0.000187121    0.0012785    0.000150057   0.000161041      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00106314      2.11903       78.5542      0.147592       8.95033        100    
reco:pmtracktccalo:Calorimetry                        6.8904e-05    0.00426101     0.0957908    0.000898324    0.0127949       100    
reco:pmtracktcpid:Chi2ParticleID                      2.3025e-05    0.000231132   0.00188626    0.000174944   0.000275632      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000147703     1.1304        27.2235      0.213946       3.44636        100    
reco:pmtrajfittccalo:Calorimetry                      4.5979e-05    0.00808136     0.264948     0.000989687    0.0314448       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5028e-05    0.000290302   0.00305055    0.000157387   0.000403638      100    
reco:blurredcluster:BlurredClustering                 0.00023902     0.821256       5.98433       0.43042       1.06508        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000121994     6.70692       94.7228       2.15008       13.4658        100    
reco:emshower:EMShower                                0.000174302    0.0231142     0.260417     0.00743624     0.0394718       100    
reco:cvnmap:CVNMapper                                 1.8889e-05    0.00914686     0.0467206    0.00527871     0.0101067       100    
reco:cvneva:CVNEvaluator                              1.6314e-05     0.529551      0.990423      0.646234      0.362273        100    
reco:energyrecnumu:EnergyReco                         0.000400764    0.0324012      1.4603      0.00691818      0.1477         100    
reco:energyrecnue:EnergyReco                          0.000130798    0.0014465     0.0292927    0.000430984   0.00361406       100    
reco:energyrecnc:EnergyReco                           0.00138205    0.00337667     0.0326447    0.00249429    0.00386148       100    
reco:energyrecnumurange:EnergyReco                    0.00019892     0.030395       1.65176     0.00232537     0.166536        100    
reco:energyrecnumumcs:EnergyReco                      0.000839586    0.0316697      1.63182     0.00271978      0.16466        100    
reco:opdec:Deconvolution                               0.0600375     0.302216      0.629803      0.280465      0.122991        100    
reco:ophitspe:OpHitFinderDeco                          0.037197       1.54488       3.19157       1.44658      0.753127        100    
reco:opflash:OpFlashFinder                            0.000138349   0.00146963    0.00579304     0.0012781    0.000946562      100    
reco:rns:RandomNumberSaver                            1.8207e-05    3.77307e-05   0.00033174    3.07365e-05   3.33888e-05      100    
reco:anglereconue:NuAngularReco                       0.000151488   0.00120479     0.0226137     0.000391     0.00283118       100    
reco:anglereconumu:NuAngularReco                      5.9269e-05    0.000929603    0.0214219    0.000207057    0.0027164       100    
reco:anglereconuepfps:NuAngularReco                   0.00010626    0.00110488     0.0230361    0.000333032   0.00284511       100    
reco:anglereconumupfps:NuAngularReco                  7.7396e-05    0.000987726    0.022282     0.00026505    0.00278938       100    
[art]:TriggerResults:TriggerResultInserter             7.902e-06    1.59023e-05   0.000106841   1.3716e-05    1.09568e-05      100    
end_path:out1:RootOutput                               3.275e-06    5.03397e-06   2.5539e-05    4.4215e-06    2.4301e-06       100    
end_path:out1:RootOutput(write)                        0.0143615     0.215719      0.985984      0.225963      0.154372        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40176.7 MB
  Peak resident set size usage (VmHWM): 2410.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2_reco_2024-11-22T_232314Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74581430_486_20231208T080708Z_gen_g4_detsim_hitreco__20240510T062256Z_reco2_reco_data_2024-11-22T_232314Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:58:39 UTC       justIN version: 01.01.09