justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.45@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.45@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:25
From worker nodeHostnamedune001-2992745.0-lcg2641.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:26:42
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2.root
JobscriptExit code0
Real time54m (3266s)
CPU time1h (3932s = 120%)
Outputting started2024-11-23 00:21:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2.root
Finished2024-11-23 00:26:25
Saved logsjustin-logs:301492.45-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:05 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:21:06 UTC run: 50568178 subRun: 1 event: 95500
Comparing two wires in the same plane: return failure
%MSG
102
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 165!
23-Nov-2024 00:21:07 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2_reco_data_2024-11-22T_232656Z.root"
23-Nov-2024 00:21:07 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/2c/18/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.486296       30.9918       548.291       13.2477       60.6279        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0272427     0.129484       1.12609      0.0928042     0.152158        100    
reco:linecluster:LineCluster                           0.0188313     0.453779       14.8184      0.250747       1.46173        100    
reco:trajcluster:TrajCluster                          0.00123741      1.13233       71.8462      0.106768       7.1962         100    
reco:pandora:StandardPandora                           0.0431831      2.36279       47.6308       1.57967       4.70136        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000170203   0.00719943     0.110922     0.00193139     0.0138986       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000253235    0.0199391     0.197186     0.00441645     0.034984        100    
reco:pandoracalo:Calorimetry                          0.000128812    0.0157871     0.403752     0.00140641     0.0451555       100    
reco:pandorapid:Chi2ParticleID                        4.5551e-05    0.000223066   0.00268191    0.000169103   0.000281361      100    
reco:trkshowersplit:TrackShowerHits                   9.9062e-05     0.0219539     0.766031     0.000968621    0.0820067       100    
reco:pmtrack:PMAlgTrackMaker                          0.00153704      2.76856       74.979        0.25981       8.35559        100    
reco:pmtrackcalo:Calorimetry                          7.6802e-05     0.0120298     0.469104     0.00127279     0.0487189       100    
reco:pmtrackpid:Chi2ParticleID                        2.8261e-05    0.000347199   0.00338084    0.000177039   0.000513377      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000236835     2.19199       39.8581      0.410622       4.89981        100    
reco:pmtrajfitcalo:Calorimetry                        8.7932e-05     0.0187469     0.649379     0.00193826     0.0676287       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.6231e-05    0.000251167   0.00135994    0.000177829   0.000214798      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00134976      3.33938       95.9161      0.348796       10.6248        100    
reco:pmtracktccalo:Calorimetry                        8.8102e-05    0.00760226     0.166219     0.00130236     0.0191808       100    
reco:pmtracktcpid:Chi2ParticleID                      3.7091e-05    0.00030064    0.00218491    0.00019147    0.000323406      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000215885     1.67322       30.7214      0.368697       3.58557        100    
reco:pmtrajfittccalo:Calorimetry                      8.4232e-05     0.0153185     0.585219     0.00152093     0.0602631       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.5171e-05    0.000410536   0.00487152    0.000205814   0.000613315      100    
reco:blurredcluster:BlurredClustering                 0.000183174     1.16598       9.6766        0.83067       1.44679        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000144974     11.3656       150.021       3.41867       19.4509        100    
reco:emshower:EMShower                                0.000221275    0.0360915     0.598913     0.00447256     0.0760196       100    
reco:cvnmap:CVNMapper                                 3.0221e-05    0.00951516     0.0407584    0.00657002     0.0088451       100    
reco:cvneva:CVNEvaluator                              2.0011e-05     0.937736       1.59463       1.24135      0.572356        100    
reco:energyrecnumu:EnergyReco                         0.000319027    0.0358364     0.609326     0.00571939     0.0973765       100    
reco:energyrecnue:EnergyReco                          0.000138923   0.00249711     0.0527927    0.000867004   0.00583112       100    
reco:energyrecnc:EnergyReco                           0.00189736    0.00537359     0.0579238     0.0037127    0.00613157       100    
reco:energyrecnumurange:EnergyReco                    0.000144674    0.0334111     0.605665     0.00355503     0.0972075       100    
reco:energyrecnumumcs:EnergyReco                      0.00131482     0.0353103     0.608834     0.00461188     0.0966076       100    
reco:opdec:Deconvolution                               0.0628908     0.374354       1.64289      0.341905      0.223702        100    
reco:ophitspe:OpHitFinderDeco                          0.209719       2.50973       4.79612       2.58716       1.12905        100    
reco:opflash:OpFlashFinder                            0.000354237   0.00168815    0.00790978    0.00152777    0.000958132      100    
reco:rns:RandomNumberSaver                            2.2581e-05    3.95986e-05   0.000472281   3.34155e-05   4.42281e-05      100    
reco:anglereconue:NuAngularReco                       0.000194554   0.00190719     0.0468042    0.000498721   0.00504638       100    
reco:anglereconumu:NuAngularReco                      9.1852e-05    0.00166478     0.045584     0.000292936   0.00492291       100    
reco:anglereconuepfps:NuAngularReco                   0.000154484   0.00183973     0.0462814    0.000442155   0.00499676       100    
reco:anglereconumupfps:NuAngularReco                  0.000128933   0.00176433     0.0464267    0.000394119   0.00501304       100    
[art]:TriggerResults:TriggerResultInserter             1.005e-05    1.63236e-05   7.0872e-05    1.53905e-05   6.6667e-06       100    
end_path:out1:RootOutput                               3.551e-06    5.26357e-06   2.7961e-05      4.6e-06     2.66935e-06      100    
end_path:out1:RootOutput(write)                        0.0249302     0.297446       1.34231      0.299086      0.196437        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39415.2 MB
  Peak resident set size usage (VmHWM): 2245.78 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2_reco_2024-11-22T_232656Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50568178_954_20231202T173146Z_gen_g4_detsim_hitreco__20240507T210659Z_reco2_reco_data_2024-11-22T_232656Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:25:52 UTC       justIN version: 01.01.09