justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301494.187@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301494.187@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:14:09
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:09:38
From worker nodeHostnamedune001-3353720.0-lcg2720.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:45
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2.root
JobscriptExit code0
Real time25m (1528s)
CPU time28m (1681s = 110%)
Outputting started2024-11-22 23:59:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2.root
Finished2024-11-23 00:09:38
Saved logsjustin-logs:301494.187-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e  22-Nov-2024 23:59:08 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:59:08 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:59:08 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:59:08 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:11 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:11 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:59:11 UTC run: 6456061 subRun: 1 event: 19200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 183, 221, 172
minwire 0: 870
minwire 1: 2707
minwire 2: 299
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00017534, 0.999737, 8.75553e-05, 
Output 1: 0.00117236, 0.998339, 0.000486692, 2.19134e-06, 
Output 2: 0.997765, 0.00223544, 

451
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1472!
22-Nov-2024 23:59:14 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2_reco_data_2024-11-22T_233349Z.root"
22-Nov-2024 23:59:14 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/33/7f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.04569       14.1766       153.154       7.34028       20.343         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000986227    0.114547      0.412118      0.0909853     0.0715188       100    
reco:linecluster:LineCluster                           0.0519252     0.287559       2.0446       0.220937      0.253117        100    
reco:trajcluster:TrajCluster                           0.0079065      0.26286       3.8819       0.0882652     0.521299        100    
reco:pandora:StandardPandora                           0.907006       1.38306       6.09512       1.22234      0.661282        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000107772   0.00303281     0.0550231     0.0012629    0.00609636       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00014638    0.00790608     0.174079     0.00221125     0.0216138       100    
reco:pandoracalo:Calorimetry                          7.9359e-05    0.00558724     0.0636254    0.000707396    0.0122305       100    
reco:pandorapid:Chi2ParticleID                        3.1348e-05    0.000119908   0.00154561    9.1002e-05    0.00015573       100    
reco:trkshowersplit:TrackShowerHits                   7.8939e-05    0.00768755     0.148589     0.000530405    0.0228928       100    
reco:pmtrack:PMAlgTrackMaker                          0.000806957     1.04975       24.0965      0.143596       2.89958        100    
reco:pmtrackcalo:Calorimetry                          5.0506e-05    0.00390413     0.0792396    0.000726214    0.0113059       100    
reco:pmtrackpid:Chi2ParticleID                        1.8658e-05    0.000177166   0.00103279    0.000117918   0.000187964      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000132229     0.91877       7.86271      0.169057       1.76009        100    
reco:pmtrajfitcalo:Calorimetry                        4.0911e-05    0.00589769     0.066816     0.000970974    0.0129161       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.7937e-05    0.000131771   0.000546854   0.000107998   8.46244e-05      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000758233     1.13584       21.1245      0.165477       2.76837        100    
reco:pmtracktccalo:Calorimetry                          4.6e-05     0.00286548     0.0540951    0.000855365   0.00755117       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8738e-05    0.000162291   0.000866676   0.000125214   0.000139895      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000123246    0.699678       8.4919       0.222737       1.33172        100    
reco:pmtrajfittccalo:Calorimetry                       3.968e-05    0.00477568     0.0872859    0.00100368     0.0118587       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7697e-05    0.000211887   0.00122683    0.000128584   0.000244201      100    
reco:blurredcluster:BlurredClustering                 0.00335235      0.67942       5.49975       0.41047      0.820067        100    
reco:emtrkmichelid:EmTrackMichelId                     0.155121       5.26923       68.0741       1.92907       9.30189        100    
reco:emshower:EMShower                                0.000225951    0.0182951     0.117427     0.00694114     0.0248065       100    
reco:cvnmap:CVNMapper                                 1.6725e-05    0.00524298     0.0367935    0.00379881    0.00636855       100    
reco:cvneva:CVNEvaluator                              1.5473e-05     0.464725      0.888949      0.560725      0.295873        100    
reco:energyrecnumu:EnergyReco                         0.000290047    0.0244229      1.13503     0.00553723      0.11724        100    
reco:energyrecnue:EnergyReco                          9.2189e-05     0.0010442     0.0248709    0.000400704   0.00262034       100    
reco:energyrecnc:EnergyReco                           0.00122789    0.00262474     0.0259719     0.0020663    0.00274849       100    
reco:energyrecnumurange:EnergyReco                    0.000142495    0.0193419     0.970003     0.00165049     0.101956        100    
reco:energyrecnumumcs:EnergyReco                      0.000504371    0.0201942     0.955216     0.00250381     0.0999878       100    
reco:opdec:Deconvolution                               0.0993501     0.299095      0.813952      0.248523      0.150391        100    
reco:ophitspe:OpHitFinderDeco                          0.249563       1.31184       3.26733       1.27224      0.554036        100    
reco:opflash:OpFlashFinder                            0.000217137   0.00105497    0.00282129    0.00104908    0.000420714      100    
reco:rns:RandomNumberSaver                            1.6715e-05    2.51706e-05   0.000196927   2.1162e-05    1.83566e-05      100    
reco:anglereconue:NuAngularReco                       0.000135745   0.000753928    0.0212654    0.000308465   0.00214977       100    
reco:anglereconumu:NuAngularReco                      5.3721e-05    0.000574996    0.0202824    0.000161829   0.00205646       100    
reco:anglereconuepfps:NuAngularReco                   9.8138e-05    0.000682689    0.0207149    0.00026929    0.00209213       100    
reco:anglereconumupfps:NuAngularReco                   6.682e-05     0.0006188     0.0211054    0.000194714   0.00213233       100    
[art]:TriggerResults:TriggerResultInserter             8.153e-06    1.08677e-05   3.7026e-05     1.026e-05    3.58098e-06      100    
end_path:out1:RootOutput                               2.734e-06    3.98271e-06   2.5559e-05     3.375e-06    2.55122e-06      100    
end_path:out1:RootOutput(write)                        0.0180373     0.161246      0.491546      0.160562      0.0902217       100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40073.9 MB
  Peak resident set size usage (VmHWM): 2240.16 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2_reco_2024-11-22T_233349Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6456061_191_20231207T122336Z_gen_g4_detsim_hitreco__20240510T054518Z_reco2_reco_data_2024-11-22T_233349Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:29:55 UTC       justIN version: 01.01.09