justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108593.124@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108593.124@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:25:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:14:38
From worker nodeHostnamedune001-3355045.0-lcg2606.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:36:44
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2.root
JobscriptExit code0
Real time32m (1920s)
CPU time46m (2771s = 144%)
Outputting started2024-11-23 00:08:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2.root
Finished2024-11-23 00:14:38
Saved logsjustin-logs:108593.124-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

run: 50546594 subRun: 1 event: 45700
1st wire C:0 T:22 P:2 W:1001 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:08:27 UTC run: 50546594 subRun: 1 event: 45700
1st wire C:0 T:23 P:2 W:872 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:08:27 UTC run: 50546594 subRun: 1 event: 45700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:08:27 UTC run: 50546594 subRun: 1 event: 45700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:08:27 UTC run: 50546594 subRun: 1 event: 45700
1st wire C:0 T:23 P:2 W:974 does not exist (max wire number: 480)
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:08:27 UTC run: 50546594 subRun: 1 event: 45700
Flip, endpoint closer to vStart.
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:08:38 UTC run: 50546594 subRun: 1 event: 45700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 434, 341, 316
minwire 0: 2557
minwire 1: 867
minwire 2: 2346
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000386606, 0.999511, 0.000102607, 
Output 1: 0.60967, 0.359342, 0.0304007, 0.000587085, 
Output 2: 0.9739, 0.0261, 

559
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1959!
23-Nov-2024 00:08:43 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2_reco_data_2024-11-22T_233649Z.root"
23-Nov-2024 00:08:43 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/e9/19/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.881797       17.6859       110.86        11.2029       19.4378        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00174237     0.0956315     0.294276      0.0841843     0.0575012       100    
reco:linecluster:LineCluster                           0.0677313      0.25971       1.22515      0.235559      0.163111        100    
reco:trajcluster:TrajCluster                          0.00794675     0.209124       4.60464      0.0832906     0.531766        100    
reco:pandora:StandardPandora                           0.0772098      1.77948       7.2607        1.59722       0.79713        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000147293    0.0039072     0.0325522    0.00139424    0.00601292       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000214334    0.0108667     0.151637     0.00336257     0.0230873       100    
reco:pandoracalo:Calorimetry                          0.000124612   0.00693085     0.192734     0.000996252    0.0212082       100    
reco:pandorapid:Chi2ParticleID                        4.5851e-05    0.000207355   0.00280366    0.000156037   0.000299987      100    
reco:trkshowersplit:TrackShowerHits                   0.000142712   0.00718293     0.183381     0.000757998    0.0217513       100    
reco:pmtrack:PMAlgTrackMaker                          0.00121505     0.983097       14.3062      0.130829       2.17915        100    
reco:pmtrackcalo:Calorimetry                          7.8911e-05    0.00370631     0.0504058     0.0010214    0.00779768       100    
reco:pmtrackpid:Chi2ParticleID                         3.195e-05    0.000249638   0.00169366    0.000178618   0.000251723      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000206413    0.900806        8.234       0.336196       1.47244        100    
reco:pmtrajfitcalo:Calorimetry                        6.8722e-05    0.00667255     0.151177     0.00160544     0.0171551       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.9641e-05    0.000204399   0.000649191   0.000182758   0.000117768      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000996098     1.16789       20.0178      0.213134       2.86146        100    
reco:pmtracktccalo:Calorimetry                        6.7061e-05    0.00388755     0.0513501    0.00104593     0.0083069       100    
reco:pmtracktcpid:Chi2ParticleID                       2.764e-05    0.000250066   0.00146586    0.000187993   0.000231913      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000170323    0.878321       9.60635      0.365656       1.47329        100    
reco:pmtrajfittccalo:Calorimetry                      8.3082e-05     0.0051574     0.100554      0.0012714     0.0122654       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.7701e-05    0.000290621    0.0017311    0.000200239   0.000289769      100    
reco:blurredcluster:BlurredClustering                 0.000214623    0.986064       6.93656      0.532935       1.14605        100    
reco:emtrkmichelid:EmTrackMichelId                     0.034323       6.57446       50.219        3.09477       9.21978        100    
reco:emshower:EMShower                                0.000347146    0.0228478      0.28999     0.00246377     0.039827        100    
reco:cvnmap:CVNMapper                                 2.4331e-05    0.00823697     0.040256     0.00636187    0.00909743       100    
reco:cvneva:CVNEvaluator                               1.758e-05     0.851623       1.44656       1.11769      0.567682        100    
reco:energyrecnumu:EnergyReco                         0.000416697    0.0133766     0.260836     0.00480284     0.0300331       100    
reco:energyrecnue:EnergyReco                          0.000149933   0.00119766    0.00881628    0.000524109   0.00148695       100    
reco:energyrecnc:EnergyReco                           0.00187159    0.00390985     0.0118952    0.00350241    0.00162314       100    
reco:energyrecnumurange:EnergyReco                    0.000212523    0.011362      0.259718     0.00344144     0.0301318       100    
reco:energyrecnumumcs:EnergyReco                      0.00188319     0.0128411     0.260506     0.00391473     0.0297083       100    
reco:opdec:Deconvolution                               0.058526      0.328173      0.789876      0.329199      0.126143        100    
reco:ophitspe:OpHitFinderDeco                           0.39535       2.29126       4.58637       2.29527      0.951249        100    
reco:opflash:OpFlashFinder                            0.000449238   0.00154778    0.00678456    0.00157644    0.000784975      100    
reco:rns:RandomNumberSaver                             2.183e-05     3.891e-05    0.000409517   3.3046e-05    3.83602e-05      100    
reco:anglereconue:NuAngularReco                       0.000213974   0.000877319   0.00739286    0.000483669   0.00118977       100    
reco:anglereconumu:NuAngularReco                      0.000112882   0.000687869   0.00696052    0.00026654    0.00112814       100    
reco:anglereconuepfps:NuAngularReco                   0.000173603   0.000827378   0.00724893    0.000407221   0.00119575       100    
reco:anglereconumupfps:NuAngularReco                  0.000145952   0.000758875   0.00716019    0.000325375   0.00114567       100    
[art]:TriggerResults:TriggerResultInserter             9.291e-06    1.49885e-05   5.6291e-05    1.38805e-05   5.0247e-06       100    
end_path:out1:RootOutput                               3.04e-06     4.86934e-06    3.949e-05     3.85e-06     4.33646e-06      100    
end_path:out1:RootOutput(write)                        0.0299035     0.249931      0.583297      0.290816      0.137017        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39259.1 MB
  Peak resident set size usage (VmHWM): 1982.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2_reco_2024-11-22T_233649Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50546594_456_20231202T072955Z_gen_g4_detsim_hitreco__20240507T194928Z_reco2_reco_data_2024-11-22T_233649Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 16:04:39 UTC       justIN version: 01.01.09