justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 61260.35@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID61260.35@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 21:40:14
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-08-24 01:29:46
From worker nodeHostnamewn1206091.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 21:42:28
Input filesfardet-hd:nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2.root
JobscriptExit code0
Real time3h (13570s)
CPU time3h (12978s = 95%)
Outputting started2024-08-24 01:28:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2.root
Finished2024-08-24 01:29:46
Saved logsjustin-logs:61260.35-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

eco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2_reco_data_2024-08-23T_214256Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  24-Aug-2024 02:28:19 BST run: 1063 subRun: 1 event: 62600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Aug-2024 02:28:20 BST run: 1063 subRun: 1 event: 62600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Aug-2024 02:28:20 BST run: 1063 subRun: 1 event: 62600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  24-Aug-2024 02:28:20 BST run: 1063 subRun: 1 event: 62600
1st wire C:0 T:8 P:2 W:1016 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  24-Aug-2024 02:28:20 BST run: 1063 subRun: 1 event: 62600
Comparing two wires in the same plane: return failure
%MSG

  Shower cones:

Event 62600 track shower separation:
Shower initial tracks are:
Track tracks are:
  0
  1
  2
Boundary wire vector sizes: 258, 289, 319
minwire 0: 1446
minwire 1: 1988
minwire 2: 977
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0092759, 
Output 1: 0.0029152, 0.000747268, 0.00392868, 0.992409, 
Output 2: 0.0407705, 0.648128, 0.00229482, 0.308807, 
Output 3: 0.00670555, 0.2622, 0.711981, 0.0191132, 
Output 4: 0.0267874, 0.94845, 0.0247225, 4.03106e-05, 
Output 5: 0.997942, 0.00189939, 0.000125617, 3.32723e-05, 
Output 6: 0.807854, 0.155741, 0.0255904, 0.0108144, 

655
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2505!
24-Aug-2024 02:28:37 BST  Closed output file "nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2_reco_data_2024-08-23T_214256Z.root"
24-Aug-2024 02:28:37 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/6d/cf/nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.6667        133.001       1531.78       45.0614       263.648        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0403108     0.104488      0.454996      0.0800595     0.0682841       100    
reco:linecluster:LineCluster                           0.130317       2.09285       80.601       0.246055       9.0316         100    
reco:trajcluster:TrajCluster                           0.0325127      11.7153       334.039      0.327722       45.1636        100    
reco:pandora:StandardPandora                            1.68699       9.00964       158.807        2.384        22.9995        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000230285    0.0301316     0.425342      0.0121396     0.0612886       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000622785    0.030521      0.200637      0.0146592     0.0409507       100    
reco:pandoracalo:Calorimetry                          0.000151406    0.117775       2.15959      0.0149833     0.338367        100    
reco:pandorapid:Chi2ParticleID                        5.9372e-05    0.000389603    0.0033006    0.000299391   0.000388262      100    
reco:trkshowersplit:TrackShowerHits                   0.000162787     0.12769       2.48863      0.0145751     0.381942        100    
reco:pmtrack:PMAlgTrackMaker                          0.00163781      15.9676       235.141       3.64949       37.334         100    
reco:pmtrackcalo:Calorimetry                           8.96e-05      0.0863892      1.86343      0.011667      0.254579        100    
reco:pmtrackpid:Chi2ParticleID                        3.7971e-05    0.00127353    0.00937921    0.000736289   0.00160168       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00249144      10.6644       212.777       3.08445       28.0737        100    
reco:pmtrajfitcalo:Calorimetry                        0.000207752    0.118833       2.32567      0.0165094     0.344126        100    
reco:pmtrajfitpid:Chi2ParticleID                      6.4893e-05    0.000484986   0.00179905    0.00041811    0.000335404      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00159449      20.4979       269.325       3.73091       46.4736        100    
reco:pmtracktccalo:Calorimetry                        8.9178e-05     0.0455125     0.486161     0.00956393     0.0954074       100    
reco:pmtracktcpid:Chi2ParticleID                      3.6098e-05    0.00103574    0.00512489    0.000662716   0.00106767       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000276782      8.698        102.679       2.77287       16.5304        100    
reco:pmtrajfittccalo:Calorimetry                      8.1394e-05     0.0950174      1.63106      0.0144221     0.246239        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4505e-05    0.00137955    0.00834588    0.000790583   0.00163894       100    
reco:blurredcluster:BlurredClustering                  0.116168       3.00358       17.2103       1.87792       3.26256        100    
reco:emtrkmichelid:EmTrackMichelId                     0.282913       43.4964       348.74        21.2234       63.3388        100    
reco:emshower:EMShower                                0.000408111    0.105929      0.877264      0.0711453     0.130082        100    
reco:cvnmap:CVNMapper                                 2.8754e-05     0.0259692     0.0823094     0.0226826     0.0145866       100    
reco:cvneva:CVNEvaluator                              2.1381e-05      1.53486       4.30968       1.64244      0.494232        100    
reco:energyrecnumu:EnergyReco                         0.000413441    0.244097       4.36599      0.031799       0.63566        100    
reco:energyrecnue:EnergyReco                          0.000175581   0.00953833     0.124491     0.00290141     0.0208776       100    
reco:energyrecnc:EnergyReco                           0.00268817     0.013721      0.134993     0.00665388     0.0218563       100    
reco:energyrecnumurange:EnergyReco                    0.000214385    0.247946       4.3314       0.0242182     0.671786        100    
reco:energyrecnumumcs:EnergyReco                       0.001596      0.243119       4.36564      0.0264758     0.648843        100    
reco:opdec:Deconvolution                               0.164671      0.445829       1.54879       0.42452      0.154135        100    
reco:ophitspe:OpHitFinderDeco                          0.788836       3.2871        5.85489       3.30506      0.949528        100    
reco:opflash:OpFlashFinder                            0.000747672   0.00252886    0.00814655     0.0024221    0.000958042      100    
reco:rns:RandomNumberSaver                            2.1621e-05    3.43366e-05   0.000477752   2.97915e-05   4.48846e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2183e-05    1.77214e-05    6.388e-05    1.6977e-05    6.21449e-06      100    
end_path:out1:RootOutput                               3.286e-06    4.69144e-06   3.1149e-05     4.228e-06    3.42723e-06      100    
end_path:out1:RootOutput(write)                        0.053877      0.931373       2.56644      0.846502      0.457915        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21735.7 MB
  Peak resident set size usage (VmHWM): 2879.09 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2_reco_2024-08-23T_214256Z.log
nue_dune10kt_1x2x6_1063_625_20230823T132012Z_gen_g4_detsim_hitreco__20240221T051808Z_reco2_reco_data_2024-08-23T_214256Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:46:55 UTC       justIN version: 01.01.09