justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.151@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.151@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:07:53
From worker nodeHostnamedune001-3354169.0-lcg2709.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:28:40
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2.root
JobscriptExit code0
Real time29m (1787s)
CPU time31m (1860s = 104%)
Outputting started2024-11-22 23:58:28
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2.root
Finished2024-11-23 00:07:53
Saved logsjustin-logs:301492.151-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
1st wire C:0 T:22 P:2 W:781 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:17 UTC run: 50574832 subRun: 1 event: 3800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 774, 290, 503
minwire 0: 2031
minwire 1: 625
minwire 2: 2238
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00220262, 0.000171002, 0.997626, 
Output 1: 0.349989, 0.491768, 0.10687, 0.0513734, 
Output 2: 0.933314, 0.0666865, 

509
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1621!
22-Nov-2024 23:58:27 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2_reco_data_2024-11-22T_232912Z.root"
22-Nov-2024 23:58:27 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/1b/b8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.740275       16.2398       278.46        7.15774       36.9852        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0246126     0.100369      0.564878      0.0922694     0.0684438       100    
reco:linecluster:LineCluster                          0.00518888     0.384933       8.74201      0.240344      0.880084        100    
reco:trajcluster:TrajCluster                          0.000728279     0.40367       14.6672      0.107251       1.69477        100    
reco:pandora:StandardPandora                           0.116861       1.96164       50.6875       1.15808       5.33113        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000116957   0.00413632     0.081084     0.000932347    0.0117809       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000154994   0.00630639     0.0634228    0.00165142     0.0119544       100    
reco:pandoracalo:Calorimetry                          8.9345e-05     0.0112764     0.521133     0.000510445    0.0565941       100    
reco:pandorapid:Chi2ParticleID                        3.3801e-05    0.00012706    0.00160273    9.32905e-05   0.000167238      100    
reco:trkshowersplit:TrackShowerHits                   5.4953e-05     0.0102797     0.348802     0.000394791    0.0441644       100    
reco:pmtrack:PMAlgTrackMaker                          0.00108296      1.27277       43.7311      0.108231       4.91814        100    
reco:pmtrackcalo:Calorimetry                          5.1558e-05    0.00595934      0.17156     0.000595694    0.0236311       100    
reco:pmtrackpid:Chi2ParticleID                         1.995e-05    0.000177026    0.0016823    0.000113582   0.00025799       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000134533    0.915952       17.1269      0.115162       2.45811        100    
reco:pmtrajfitcalo:Calorimetry                        4.2595e-05     0.0114452     0.527871     0.000876658    0.056988        100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8338e-05    0.000132656   0.000601257   0.000111253   9.71088e-05      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000865767     1.56891       54.6409      0.0894028      6.23622        100    
reco:pmtracktccalo:Calorimetry                        4.6831e-05    0.00521383     0.112828     0.000630157    0.0177639       100    
reco:pmtracktcpid:Chi2ParticleID                      1.9029e-05    0.000198826   0.00203297    0.000115143   0.000299884      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000112149    0.932077       22.7772      0.143613       2.90698        100    
reco:pmtrajfittccalo:Calorimetry                      4.0802e-05    0.00844778     0.328199     0.00082126     0.037687        100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7947e-05    0.00022254    0.00239299    0.000131704   0.000337428      100    
reco:blurredcluster:BlurredClustering                 0.000226131    0.790795       5.64254      0.421361       1.14167        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000112129     5.56437       84.0285       1.62849       12.7363        100    
reco:emshower:EMShower                                0.000162686    0.0196703     0.294624     0.00205736     0.0422354       100    
reco:cvnmap:CVNMapper                                 1.6294e-05    0.00400257     0.0338824    0.00355392     0.0052684       100    
reco:cvneva:CVNEvaluator                              1.4061e-05     0.438996      0.932213      0.545831      0.296763        100    
reco:energyrecnumu:EnergyReco                         0.000300523    0.0268603     0.736589     0.00558495     0.101711        100    
reco:energyrecnue:EnergyReco                           9.32e-05     0.00149467     0.040442     0.000312061   0.00481819       100    
reco:energyrecnc:EnergyReco                            0.0012591    0.00304777     0.0428964     0.0022138    0.00490208       100    
reco:energyrecnumurange:EnergyReco                    0.00013294     0.0236708     0.721077     0.00138115     0.101228        100    
reco:energyrecnumumcs:EnergyReco                      0.000535018    0.0247988     0.733451     0.00248625     0.102387        100    
reco:opdec:Deconvolution                               0.0365473     0.309379      0.884029      0.292413      0.146953        100    
reco:ophitspe:OpHitFinderDeco                          0.0400372      1.25744       3.97826       1.21248      0.658054        100    
reco:opflash:OpFlashFinder                            0.000108684    0.0010723     0.0041985    0.00105552    0.000525975      100    
reco:rns:RandomNumberSaver                            1.8838e-05    2.87792e-05   0.000254053   2.4397e-05    2.51128e-05      100    
reco:anglereconue:NuAngularReco                       0.000147512   0.00110915     0.0250203    0.000277944   0.00340678       100    
reco:anglereconumu:NuAngularReco                      5.0887e-05    0.00090166     0.0241376    0.000128969   0.00331085       100    
reco:anglereconuepfps:NuAngularReco                   9.8038e-05    0.00102374     0.0245898    0.000236863   0.00337156       100    
reco:anglereconumupfps:NuAngularReco                  6.8663e-05    0.000949024    0.0248494    0.000173092   0.00337312       100    
[art]:TriggerResults:TriggerResultInserter             8.303e-06    1.18134e-05   4.7001e-05    1.1252e-05    4.71189e-06      100    
end_path:out1:RootOutput                               3.235e-06     4.479e-06    2.1763e-05     3.981e-06    2.20804e-06      100    
end_path:out1:RootOutput(write)                        0.0143495     0.164187      0.638366      0.161297      0.115393        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40333.4 MB
  Peak resident set size usage (VmHWM): 2488.65 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2_reco_2024-11-22T_232912Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_37_20231203T121855Z_gen_g4_detsim_hitreco__20240508T050554Z_reco2_reco_data_2024-11-22T_232912Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 16:04:29 UTC       justIN version: 01.01.09