justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108513.46@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108513.46@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:15:41
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-11-22 23:47:53
From worker nodeHostnamen259.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:35:48
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2.root
JobscriptExit code0
Real time1h (3970s)
CPU time58m (3519s = 88%)
Outputting started2024-11-22 23:41:58
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2.root
Finished2024-11-22 23:47:53
Saved logsjustin-logs:108513.46-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Maker:pmtrack@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:41:51 GMT run: 6472771 subRun: 1 event: 51200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 40, 55, 13
minwire 0: 1425
minwire 1: 1220
minwire 2: 1561
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.14744, 0.0343241, 0.818236, 
Output 1: 0.774396, 0.221459, 0.0039182, 0.000226922, 
Output 2: 0.897749, 0.102251, 

285
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 607!
22-Nov-2024 23:41:57 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2_reco_data_2024-11-22T_223552Z.root"
22-Nov-2024 23:41:57 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/0e/58/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.571775       35.2767       428.328       13.5037       69.3762        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0172042     0.077334      0.600125      0.0427072     0.0972377       100    
reco:linecluster:LineCluster                           0.0989369     0.514374       6.87796       0.24186      0.806563        100    
reco:trajcluster:TrajCluster                           0.0488645     0.614911       11.3539      0.0690078      1.83744        100    
reco:pandora:StandardPandora                           0.0591789      2.45893       23.3992       1.58916       3.48929        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000139915   0.00912914     0.207864     0.00209231     0.0247341       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000181083    0.0160441      0.22408      0.0045792     0.0371768       100    
reco:pandoracalo:Calorimetry                          0.000108646    0.0183815     0.357837     0.00164236     0.0530506       100    
reco:pandorapid:Chi2ParticleID                        4.1187e-05    0.000233801   0.00128378    0.000171941   0.000210908      100    
reco:trkshowersplit:TrackShowerHits                    9.017e-05     0.0262984     0.521443     0.00114137     0.0834218       100    
reco:pmtrack:PMAlgTrackMaker                          0.00120221      3.08939       57.4814      0.348054       9.71607        100    
reco:pmtrackcalo:Calorimetry                          7.5943e-05     0.0137406     0.343162     0.00124798     0.047578        100    
reco:pmtrackpid:Chi2ParticleID                        2.9856e-05    0.000415637   0.00370342    0.000190742   0.000630971      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000202945     2.49458       42.7679      0.362379       6.34801        100    
reco:pmtrajfitcalo:Calorimetry                        6.4703e-05     0.0197704      0.38634     0.00206316     0.0558031       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7382e-05    0.000280695   0.00193123    0.000216861   0.000280915      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00133507      3.50593       76.458       0.326289       10.6707        100    
reco:pmtracktccalo:Calorimetry                        8.7817e-05     0.0117078     0.246425     0.00122106     0.0376159       100    
reco:pmtracktcpid:Chi2ParticleID                       3.723e-05    0.000383363   0.00319129    0.000201412   0.000530726      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000241508     2.03034       32.1497      0.284505       4.85572        100    
reco:pmtrajfittccalo:Calorimetry                      8.8588e-05     0.0195427     0.432592     0.00150533     0.062111        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4576e-05    0.000519335   0.00439726    0.000208165   0.000775764      100    
reco:blurredcluster:BlurredClustering                  8.479e-05      1.29641       10.2016      0.428521       2.10803        100    
reco:emtrkmichelid:EmTrackMichelId                    0.00013651      14.6034       166.452       4.33425       29.4195        100    
reco:emshower:EMShower                                0.000232882    0.0384081     0.548855     0.00210392     0.0800785       100    
reco:cvnmap:CVNMapper                                 2.8124e-05     0.0108693     0.060696     0.00866408     0.0114338       100    
reco:cvneva:CVNEvaluator                              2.0548e-05     0.713763       1.51605      0.965065      0.498605        100    
reco:energyrecnumu:EnergyReco                         0.00048008     0.0962576      2.80164     0.00693362     0.424558        100    
reco:energyrecnue:EnergyReco                          0.000208535   0.00310258     0.069122     0.000827068   0.00805354       100    
reco:energyrecnc:EnergyReco                           0.00179851    0.00620277     0.0734424    0.00376574    0.00855974       100    
reco:energyrecnumurange:EnergyReco                    0.000252559    0.0935845      2.82177     0.00352229     0.423964        100    
reco:energyrecnumumcs:EnergyReco                      0.00116727     0.0952482      2.82268     0.00467336     0.422622        100    
reco:opdec:Deconvolution                               0.0667379     0.408858       1.61666      0.363233      0.251107        100    
reco:ophitspe:OpHitFinderDeco                          0.155742       2.67186       5.36977       2.60246       1.2105         100    
reco:opflash:OpFlashFinder                            0.000214707    0.0018457    0.00509346     0.0018188    0.000910217      100    
reco:rns:RandomNumberSaver                            2.2793e-05    4.55627e-05   0.000386402   3.9029e-05    3.70048e-05      100    
reco:anglereconue:NuAngularReco                       0.000177697   0.00237469     0.0631838    0.000488306   0.00713129       100    
reco:anglereconumu:NuAngularReco                      9.1514e-05    0.00216098     0.0611508    0.000312473   0.00700349       100    
reco:anglereconuepfps:NuAngularReco                   0.000135517   0.00234699     0.0625846    0.000459752   0.00709483       100    
reco:anglereconumupfps:NuAngularReco                  0.000115879   0.00226014     0.0621302    0.000405163   0.00710681       100    
[art]:TriggerResults:TriggerResultInserter            1.1101e-05    2.00307e-05   6.3139e-05    1.7563e-05    7.90022e-06      100    
end_path:out1:RootOutput                               3.526e-06    7.70054e-06   3.2952e-05     6.773e-06    4.23797e-06      100    
end_path:out1:RootOutput(write)                        0.0126181     0.302684       1.26747      0.312619      0.232711        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38501.2 MB
  Peak resident set size usage (VmHWM): 2431.68 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2_reco_2024-11-22T_223552Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472771_511_20231208T090344Z_gen_g4_detsim_hitreco__20240510T062457Z_reco2_reco_data_2024-11-22T_223552Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:59:02 UTC       justIN version: 01.01.09