justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108513.165@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108513.165@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:15:41
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-11-22 23:41:23
From worker nodeHostnamen260.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:37:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2.root
JobscriptExit code0
Real time58m (3486s)
CPU time51m (3106s = 89%)
Outputting started2024-11-22 23:35:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2.root
Finished2024-11-22 23:41:23
Saved logsjustin-logs:108513.165-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:35:28 GMT run: 6413332 subRun: 1 event: 14100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:35:28 GMT run: 6413332 subRun: 1 event: 14100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:35:28 GMT run: 6413332 subRun: 1 event: 14100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:35:28 GMT run: 6413332 subRun: 1 event: 14100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:35:31 GMT run: 6413332 subRun: 1 event: 14100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 50, 47, 42
minwire 0: 1320
minwire 1: 1515
minwire 2: 971
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 409, 608
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.657109, 0.230216, 0.112675, 
Output 1: 0.977835, 0.0210439, 0.000965895, 0.000155543, 
Output 2: 0.974318, 0.0256817, 

562
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1985!
22-Nov-2024 23:35:35 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2_reco_data_2024-11-22T_223735Z.root"
22-Nov-2024 23:35:35 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/4f/23/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.594583       31.0016       1064.68       9.29909       110.389        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0179015     0.0402702     0.0712499     0.0376361     0.0134096       100    
reco:linecluster:LineCluster                           0.102073      0.618238       36.2637      0.192702       3.59222        100    
reco:trajcluster:TrajCluster                           0.0511191      1.30404       90.9232      0.0609358      9.10755        100    
reco:pandora:StandardPandora                           0.0694822      4.42431       281.991       1.21198       27.9477        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000155973   0.00628014     0.195728     0.00155394     0.0213968       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000211067    0.0128389     0.358602     0.00253845     0.0390287       100    
reco:pandoracalo:Calorimetry                          0.000122881    0.0213794      1.01145     0.000987529     0.10615        100    
reco:pandorapid:Chi2ParticleID                         4.771e-05    0.00020866    0.00490594    0.000137493   0.000484005      100    
reco:trkshowersplit:TrackShowerHits                   0.000109856    0.0287136      1.3531      0.000600289    0.143641        100    
reco:pmtrack:PMAlgTrackMaker                          0.00138067      2.88698       136.081      0.205521       14.0974        100    
reco:pmtrackcalo:Calorimetry                          8.8907e-05     0.0114822     0.496252     0.00104076     0.0524021       100    
reco:pmtrackpid:Chi2ParticleID                        3.2181e-05    0.000301422   0.00418254    0.000155037   0.000539068      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000198173     2.17482       89.7027      0.258707       9.29928        100    
reco:pmtrajfitcalo:Calorimetry                        7.5953e-05     0.0220757      1.02154     0.00157622     0.107242        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.1068e-05    0.000212831   0.00129582    0.000169073   0.000181213      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00110663      3.67768       183.755      0.209278       18.8684        100    
reco:pmtracktccalo:Calorimetry                        7.3478e-05    0.00731131     0.166839     0.00100341     0.0226018       100    
reco:pmtracktcpid:Chi2ParticleID                      3.0698e-05    0.000293317   0.00271617    0.000161539   0.000425013      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000200718     1.73914       53.3047      0.301495       5.95813        100    
reco:pmtrajfittccalo:Calorimetry                      8.0952e-05     0.0166388     0.705662     0.00131309     0.0755592       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.9516e-05    0.000385092   0.00456627    0.000191355   0.000651643      100    
reco:blurredcluster:BlurredClustering                 9.6301e-05     0.907121       7.32971      0.360131       1.44881        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000153649     9.69482        170.6        2.43793       23.1561        100    
reco:emshower:EMShower                                0.000215256    0.0269176     0.445136     0.00479684     0.0563788       100    
reco:cvnmap:CVNMapper                                 2.9275e-05    0.00955178     0.0470488    0.00698288    0.00955409       100    
reco:cvneva:CVNEvaluator                              1.9998e-05     0.607506       1.2034       0.866456      0.440433        100    
reco:energyrecnumu:EnergyReco                         0.000427283    0.0287024      0.89783     0.00396316     0.107673        100    
reco:energyrecnue:EnergyReco                          0.000193554   0.00201706     0.0508004    0.000510941   0.00578782       100    
reco:energyrecnc:EnergyReco                           0.00239425     0.0044818     0.0552514    0.00301731    0.00605585       100    
reco:energyrecnumurange:EnergyReco                    0.000203142    0.0266042     0.876766     0.00279138      0.1057         100    
reco:energyrecnumumcs:EnergyReco                      0.00189518     0.0282787     0.914167     0.00321153      0.10832        100    
reco:opdec:Deconvolution                               0.0865856     0.295158      0.560725      0.283692       0.10004        100    
reco:ophitspe:OpHitFinderDeco                           0.15551       2.12578       4.08204       2.07456      0.869338        100    
reco:opflash:OpFlashFinder                            0.000200016   0.00161423    0.00719732    0.00151171    0.000809901      100    
reco:rns:RandomNumberSaver                            2.1079e-05    4.37884e-05   0.000449155   3.93995e-05   4.21744e-05      100    
reco:anglereconue:NuAngularReco                       0.000210026   0.00162752     0.0486608    0.000447382   0.00534288       100    
reco:anglereconumu:NuAngularReco                      9.9307e-05    0.00138967     0.0468236    0.000262805   0.00517807       100    
reco:anglereconuepfps:NuAngularReco                   0.000153429    0.0015476     0.0503139    0.000410292    0.005488        100    
reco:anglereconumupfps:NuAngularReco                  0.000147277   0.00143828     0.0455324    0.000307052   0.00506796       100    
[art]:TriggerResults:TriggerResultInserter             1.06e-05     1.61868e-05   0.000102613   1.4998e-05    9.02015e-06      100    
end_path:out1:RootOutput                               2.735e-06    5.8996e-06    2.7762e-05     5.726e-06    3.74242e-06      100    
end_path:out1:RootOutput(write)                        0.0124613     0.241158       1.31301      0.243485      0.193147        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38379 MB
  Peak resident set size usage (VmHWM): 2320.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2_reco_2024-11-22T_223735Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413332_140_20231203T041044Z_gen_g4_detsim_hitreco__20240508T063114Z_reco2_reco_data_2024-11-22T_223735Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:19:42 UTC       justIN version: 01.01.09