justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301494.143@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301494.143@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:14:09
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-23 00:17:00
From worker nodeHostnamen252.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:49
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2.root
JobscriptExit code0
Real time32m (1957s)
CPU time27m (1661s = 84%)
Outputting started2024-11-23 00:06:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2.root
Finished2024-11-23 00:17:00
Saved logsjustin-logs:301494.143-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e  23-Nov-2024 00:06:18 GMT run: 6370890 subRun: 1 event: 35900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:18 GMT run: 6370890 subRun: 1 event: 35900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:18 GMT run: 6370890 subRun: 1 event: 35900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:18 GMT run: 6370890 subRun: 1 event: 35900
1st wire C:0 T:4 P:2 W:526 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:21 GMT run: 6370890 subRun: 1 event: 35900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:21 GMT run: 6370890 subRun: 1 event: 35900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 100, 88, 76
minwire 0: 726
minwire 1: 1621
minwire 2: 731
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 99, 298
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.993226, 0.0004809, 0.00629355, 
Output 1: 0.0625811, 0.257572, 0.519456, 0.160391, 
Output 2: 0.963687, 0.0363127, 

473
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1513!
23-Nov-2024 00:06:25 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2_reco_data_2024-11-22T_233354Z.root"
23-Nov-2024 00:06:25 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/5f/cd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.635587       16.4371       158.854       8.72866       24.7489        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0180028     0.0375842     0.0659435     0.0357794     0.0119037       100    
reco:linecluster:LineCluster                           0.100421      0.233778       1.25452      0.186756      0.183115        100    
reco:trajcluster:TrajCluster                           0.0505924     0.234273       5.36474      0.059162      0.784751        100    
reco:pandora:StandardPandora                           0.0611634      1.29748       4.87332       1.1751       0.623482        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000143081   0.00326033     0.0346864    0.00121267    0.00568153       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000193245    0.0108492     0.209354     0.00300903     0.0253889       100    
reco:pandoracalo:Calorimetry                          0.000118183   0.00657757     0.0953621    0.000975093    0.0180253       100    
reco:pandorapid:Chi2ParticleID                        4.2179e-05    0.000161923   0.00178376    0.000117657   0.000186595      100    
reco:trkshowersplit:TrackShowerHits                   0.00011112    0.00805443      0.18972     0.000624345    0.0295325       100    
reco:pmtrack:PMAlgTrackMaker                          0.00128584      1.22427       24.2639      0.208957       3.42678        100    
reco:pmtrackcalo:Calorimetry                          7.6985e-05    0.00369603     0.0535679    0.000953142   0.00902772       100    
reco:pmtrackpid:Chi2ParticleID                        3.2171e-05    0.000212047   0.00169834    0.000153586   0.000255558      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000203846    0.920081       20.9075      0.254968       2.33728        100    
reco:pmtrajfitcalo:Calorimetry                        7.1866e-05    0.00703002     0.100505     0.00128993     0.0184569       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.8063e-05    0.00017546    0.000748735   0.000150454   0.000118395      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00104938      1.47357       33.3917       0.17123       4.3498         100    
reco:pmtracktccalo:Calorimetry                        7.1645e-05    0.00332693     0.0557644    0.000902857   0.00846344       100    
reco:pmtracktcpid:Chi2ParticleID                      2.8013e-05    0.000204222   0.00117921    0.000149282   0.000194934      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000180651    0.816975       10.0374      0.237793       1.69974        100    
reco:pmtrajfittccalo:Calorimetry                      7.0514e-05    0.00475533     0.0806474    0.00107979     0.0128136       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.8704e-05    0.000239121    0.001739     0.000160429   0.000274847      100    
reco:blurredcluster:BlurredClustering                 7.0894e-05     0.801771       5.3984       0.380489       1.06534        100    
reco:emtrkmichelid:EmTrackMichelId                    0.00012172      6.2825        56.6939       2.57686       10.5558        100    
reco:emshower:EMShower                                0.000172246    0.0227266     0.372095     0.00593996     0.0462294       100    
reco:cvnmap:CVNMapper                                 2.0038e-05    0.00826891     0.0380003    0.00600133    0.00835762       100    
reco:cvneva:CVNEvaluator                              1.6872e-05      0.60298       1.04338      0.802453      0.380812        100    
reco:energyrecnumu:EnergyReco                         0.000372675    0.0134673     0.582612     0.00389532     0.0583113       100    
reco:energyrecnue:EnergyReco                          0.000130307   0.00119318     0.0106198    0.000522268   0.00179422       100    
reco:energyrecnc:EnergyReco                           0.00151739    0.00358597     0.0137288    0.00307119    0.00194654       100    
reco:energyrecnumurange:EnergyReco                    0.000198775    0.0114764     0.566676     0.00262981     0.0568612       100    
reco:energyrecnumumcs:EnergyReco                      0.000876297    0.0132684     0.565075     0.00349371     0.0565295       100    
reco:opdec:Deconvolution                               0.0666881     0.274426       0.48119      0.276677      0.0884801       100    
reco:ophitspe:OpHitFinderDeco                          0.160275       1.89277       3.54479       1.83534      0.767032        100    
reco:opflash:OpFlashFinder                            0.00015857    0.00131108    0.00647325     0.0013121    0.000729283      100    
reco:rns:RandomNumberSaver                            1.9637e-05    3.44188e-05   0.000472383   2.82885e-05   4.4595e-05       100    
reco:anglereconue:NuAngularReco                       0.00016956    0.00081239    0.00887766    0.000360977   0.00137712       100    
reco:anglereconumu:NuAngularReco                      8.6594e-05    0.00061841    0.00808922    0.000209722   0.00127019       100    
reco:anglereconuepfps:NuAngularReco                   0.000133963   0.000778911   0.00817341    0.000361017   0.00132042       100    
reco:anglereconumupfps:NuAngularReco                  0.000118834   0.000692386   0.00814705    0.000290775   0.00128065       100    
[art]:TriggerResults:TriggerResultInserter             9.147e-06    1.3968e-05      5.8e-05     1.3175e-05    4.87441e-06      100    
end_path:out1:RootOutput                               2.846e-06    5.02743e-06   2.0038e-05     4.002e-06    2.21952e-06      100    
end_path:out1:RootOutput(write)                        0.0103285     0.215861      0.549824      0.239179      0.126069        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38150.6 MB
  Peak resident set size usage (VmHWM): 2084.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2_reco_2024-11-22T_233354Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6370890_358_20231201T082235Z_gen_g4_detsim_hitreco__20240507T201945Z_reco2_reco_data_2024-11-22T_233354Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:02:26 UTC       justIN version: 01.01.09