justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.5@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.5@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:11
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-11-23 00:18:42
From worker nodeHostnamen235.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7352 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:08:53
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2.root
JobscriptExit code0
Real time1h (3680s)
CPU time55m (3315s = 90%)
Outputting started2024-11-23 00:10:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2.root
Finished2024-11-23 00:18:42
Saved logsjustin-logs:301452.5-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

T:9 P:2 W:493 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:02 GMT run: 6432497 subRun: 1 event: 33900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:03 GMT run: 6432497 subRun: 1 event: 33900
1st wire C:0 T:9 P:2 W:509 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:03 GMT run: 6432497 subRun: 1 event: 33900
1st wire C:0 T:9 P:2 W:514 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:03 GMT run: 6432497 subRun: 1 event: 33900
1st wire C:0 T:9 P:2 W:520 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:03 GMT run: 6432497 subRun: 1 event: 33900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:03 GMT run: 6432497 subRun: 1 event: 33900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 145, 173, 122
minwire 0: 1274
minwire 1: 903
minwire 2: 1136
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000283429, 0.999473, 0.000243593, 
Output 1: 0.968522, 0.0313984, 7.80466e-05, 1.69926e-06, 
Output 2: 0.999308, 0.00069251, 

546
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1801!
23-Nov-2024 00:10:12 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2_reco_data_2024-11-22T_230858Z.root"
23-Nov-2024 00:10:12 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/4d/36/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.92747       33.0542       785.936       12.4144       85.3272        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0174568     0.0454039     0.122968      0.0410395     0.0198344       100    
reco:linecluster:LineCluster                           0.172786      0.326615       4.34865       0.1991       0.551467        100    
reco:trajcluster:TrajCluster                           0.0505379     0.921477       43.2896      0.0645045      4.66559        100    
reco:pandora:StandardPandora                            1.06386       2.72597       79.1263       1.67158       7.78357        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000146214   0.00810075     0.291284     0.00185123     0.0296604       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00020766     0.0167236     0.361872     0.00380497     0.0509331       100    
reco:pandoracalo:Calorimetry                          0.00010637     0.0220246      1.12471     0.00140309     0.114499        100    
reco:pandorapid:Chi2ParticleID                        3.9003e-05    0.000211589   0.00126935    0.000152295   0.000199433      100    
reco:trkshowersplit:TrackShowerHits                   0.000141265    0.0241992      1.02823     0.00109954     0.111815        100    
reco:pmtrack:PMAlgTrackMaker                          0.00125158      2.55163       82.6592      0.260915       9.23722        100    
reco:pmtrackcalo:Calorimetry                          6.2968e-05     0.016488      0.995555      0.0011885     0.0997117       100    
reco:pmtrackpid:Chi2ParticleID                        2.5238e-05    0.00036845    0.00538198    0.000180864   0.000645306      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000182082     2.77135       118.82       0.419769       12.1224        100    
reco:pmtrajfitcalo:Calorimetry                        5.4572e-05     0.0227071      1.12697     0.00160432     0.114916        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.5157e-05    0.000230732   0.00125038    0.000182332   0.000182568      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00136768      3.42769       102.392       0.31281       12.4108        100    
reco:pmtracktccalo:Calorimetry                        8.8927e-05    0.00937185     0.472413     0.00105377     0.0472878       100    
reco:pmtracktcpid:Chi2ParticleID                      3.6729e-05    0.00032149    0.00396366    0.000162384   0.000475168      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000252313     1.91253       64.5128      0.414224       6.74833        100    
reco:pmtrajfittccalo:Calorimetry                      8.8566e-05     0.0185466     0.924789      0.0014036     0.094338        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.6158e-05    0.000442936   0.00653517     0.0001787    0.000794323      100    
reco:blurredcluster:BlurredClustering                 0.00630882      1.06435       10.1414      0.549306       1.49002        100    
reco:emtrkmichelid:EmTrackMichelId                     0.330963       13.6574       265.386       3.96552       30.7917        100    
reco:emshower:EMShower                                0.000267051    0.0351187     0.380268     0.00654288     0.0700107       100    
reco:cvnmap:CVNMapper                                 2.3474e-05     0.0152171     0.0439096     0.0176247     0.0111902       100    
reco:cvneva:CVNEvaluator                              1.7242e-05     0.755433       1.38177       1.0411       0.475362        100    
reco:energyrecnumu:EnergyReco                         0.000291346    0.0284117     0.453558      0.0056078     0.0692856       100    
reco:energyrecnue:EnergyReco                          0.000137307   0.00245862     0.0897814    0.000643717   0.00909185       100    
reco:energyrecnc:EnergyReco                            0.0019332    0.00512371     0.089227     0.00328413    0.00895774       100    
reco:energyrecnumurange:EnergyReco                    0.000145233    0.0264073      0.45241     0.00319261     0.0692462       100    
reco:energyrecnumumcs:EnergyReco                      0.00192602     0.0283678     0.466123     0.00378477     0.0701402       100    
reco:opdec:Deconvolution                               0.133407      0.316304      0.636383      0.298472      0.105188        100    
reco:ophitspe:OpHitFinderDeco                          0.603998       2.00435       3.92192       1.87571      0.853021        100    
reco:opflash:OpFlashFinder                            0.000492974   0.00172145     0.0041928    0.00155975    0.000741113      100    
reco:rns:RandomNumberSaver                            1.8285e-05    4.93299e-05   0.000348965   4.27605e-05   3.53924e-05      100    
reco:anglereconue:NuAngularReco                       0.000167734   0.00188889     0.0750184    0.000467127   0.00755144       100    
reco:anglereconumu:NuAngularReco                      6.4922e-05    0.00165558     0.0778654    0.000242385   0.00784342       100    
reco:anglereconuepfps:NuAngularReco                   0.00012286    0.00183624     0.0768752    0.000406086    0.0077418       100    
reco:anglereconumupfps:NuAngularReco                  9.2644e-05    0.00172978     0.0750859    0.000295359   0.00760458       100    
[art]:TriggerResults:TriggerResultInserter             8.936e-06    1.53587e-05   5.0464e-05    1.4547e-05    5.09653e-06      100    
end_path:out1:RootOutput                               3.427e-06    9.12547e-06   3.4936e-05     8.636e-06    4.34112e-06      100    
end_path:out1:RootOutput(write)                        0.0358386     0.281349       1.69929      0.287813      0.214598        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 17000.3 MB
  Peak resident set size usage (VmHWM): 2410.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2_reco_2024-11-22T_230858Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432497_338_20231206T032949Z_gen_g4_detsim_hitreco__20240510T034610Z_reco2_reco_data_2024-11-22T_230858Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:29:22 UTC       justIN version: 01.01.09