justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108542.23@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108542.23@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:55:24
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-23 00:08:04
From worker nodeHostnamen258.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:06:46
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2.root
JobscriptExit code0
Real time52m (3172s)
CPU time44m (2677s = 84%)
Outputting started2024-11-22 23:59:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2.root
Finished2024-11-23 00:08:04
Saved logsjustin-logs:108542.23-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

:pmtrajfittc@BeginModule  22-Nov-2024 23:58:38 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:38 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:38 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:38 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:30 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:30 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:30 GMT run: 6432575 subRun: 1 event: 47700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 3127, 2555, 1659
minwire 0: 721
minwire 1: 1249
minwire 2: 674
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0379094, 0.949184, 0.012907, 
Output 1: 0.199459, 0.397525, 0.249505, 0.153511, 
Output 2: 0.75877, 0.24123, 

883
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3366!
22-Nov-2024 23:59:37 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2_reco_data_2024-11-22T_230650Z.root"
22-Nov-2024 23:59:37 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/9b/8e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.895863       27.3469       275.281       10.3195       51.0256        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0167102     0.168783       1.18154       0.10812      0.189695        100    
reco:linecluster:LineCluster                           0.0962883     0.620662       4.58535      0.209781      0.918347        100    
reco:trajcluster:TrajCluster                           0.0483614       0.707        15.9407      0.0591204      2.54773        100    
reco:pandora:StandardPandora                           0.0627639      1.81183       13.9119       1.28601       2.05613        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000146997   0.00541585     0.0788087    0.00143453     0.0119597       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000209175    0.0123313     0.283144     0.00269107     0.0314468       100    
reco:pandoracalo:Calorimetry                          0.000109507    0.0147998     0.291156     0.00102388     0.0464616       100    
reco:pandorapid:Chi2ParticleID                        4.5025e-05    0.000182175   0.00192926    0.000142438   0.000204841      100    
reco:trkshowersplit:TrackShowerHits                    6.916e-05     0.0246579     0.560823     0.000726735    0.0855142       100    
reco:pmtrack:PMAlgTrackMaker                          0.00124899      2.03115       33.306       0.175822       5.76489        100    
reco:pmtrackcalo:Calorimetry                          7.4982e-05    0.00922334     0.193936     0.000861213    0.0288804       100    
reco:pmtrackpid:Chi2ParticleID                        2.9916e-05    0.000308294   0.00241638    0.000164204   0.000444134      100    
reco:pmtrajfit:PMAlgTrajFitter                         0.0001855      2.28452       38.391       0.351937       5.96366        100    
reco:pmtrajfitcalo:Calorimetry                        7.0553e-05     0.0157741     0.298702     0.00155788     0.0485421       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.9295e-05    0.000210392   0.000892332   0.000166294   0.000169247      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00108092      2.97965       60.8132      0.248978       9.33034        100    
reco:pmtracktccalo:Calorimetry                        7.6784e-05     0.0061277     0.100679     0.000934452    0.0146386       100    
reco:pmtracktcpid:Chi2ParticleID                      3.0868e-05    0.000295949   0.00180529     0.0001646    0.000364113      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000188686     1.55688       20.3767      0.310599       3.50219        100    
reco:pmtrajfittccalo:Calorimetry                      7.3629e-05     0.0132594     0.229276     0.00130949     0.0387472       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.7632e-05    0.00039158    0.00307403    0.000179568   0.000582609      100    
reco:blurredcluster:BlurredClustering                 7.5482e-05     0.891093       6.36946      0.461689       1.25341        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000126589     10.5741        103.2        3.21296       19.7114        100    
reco:emshower:EMShower                                0.000186481    0.036223      0.499577     0.00613137     0.0692561       100    
reco:cvnmap:CVNMapper                                 2.0208e-05    0.00775386     0.042099      0.0065272    0.00832237       100    
reco:cvneva:CVNEvaluator                              1.8004e-05     0.618995       1.21536      0.851028      0.420152        100    
reco:energyrecnumu:EnergyReco                         0.00037667     0.0624967      2.52278      0.0039242     0.267831        100    
reco:energyrecnue:EnergyReco                          0.000193585   0.00201125     0.0250025    0.000611628   0.00398791       100    
reco:energyrecnc:EnergyReco                           0.00237007    0.00442298     0.028473     0.00306012    0.00426163       100    
reco:energyrecnumurange:EnergyReco                    0.000200808    0.0603127      2.52326     0.00279318     0.267572        100    
reco:energyrecnumumcs:EnergyReco                      0.00240033     0.0618265      2.49534     0.00363529     0.264928        100    
reco:opdec:Deconvolution                               0.0523364     0.434815       2.08833      0.277986      0.436813        100    
reco:ophitspe:OpHitFinderDeco                          0.145821       2.08479       4.04967       2.0303       0.951974        100    
reco:opflash:OpFlashFinder                            0.00012703    0.00155448     0.014185     0.00134032    0.00146257       100    
reco:rns:RandomNumberSaver                            1.9868e-05    3.94906e-05   0.000329852   3.3914e-05    3.15173e-05      100    
reco:anglereconue:NuAngularReco                       0.000167295   0.00142911     0.0210571    0.000382988   0.00331698       100    
reco:anglereconumu:NuAngularReco                       8.51e-05     0.00124791     0.0207284    0.000264093   0.00318897       100    
reco:anglereconuepfps:NuAngularReco                   0.000140004   0.00138122     0.0205545    0.000379284   0.00322202       100    
reco:anglereconumupfps:NuAngularReco                  0.000128432   0.00132146     0.0207751    0.000327582   0.00323541       100    
[art]:TriggerResults:TriggerResultInserter             9.447e-06    1.46962e-05   5.5294e-05    1.33905e-05   5.35287e-06      100    
end_path:out1:RootOutput                               2.816e-06    5.89334e-06   2.2683e-05    5.0545e-06    3.27039e-06      100    
end_path:out1:RootOutput(write)                        0.010062      0.235521      0.839764      0.238207      0.170764        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38268.6 MB
  Peak resident set size usage (VmHWM): 2206.75 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2_reco_2024-11-22T_230650Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_476_20231207T031654Z_gen_g4_detsim_hitreco__20240510T043718Z_reco2_reco_data_2024-11-22T_230650Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:43:03 UTC       justIN version: 01.01.09