justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108551.62@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108551.62@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:16:35
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:26:24
From worker nodeHostnamedune001-3355060.0-lcg2719.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:34:02
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2.root
JobscriptExit code0
Real time42m (2529s)
CPU time42m (2565s = 101%)
Outputting started2024-11-23 00:16:11
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2.root
Finished2024-11-23 00:26:24
Saved logsjustin-logs:108551.62-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

un: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:15:53 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:15:53 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:54 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:55 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:55 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:15:55 UTC run: 50579427 subRun: 1 event: 86000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 631, 269, 290
minwire 0: 1928
minwire 1: 345
minwire 2: 2003
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00783687, 0.000194994, 0.991968, 
Output 1: 0.783596, 0.170605, 0.03253, 0.0132685, 
Output 2: 0.927493, 0.072507, 

613
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2111!
23-Nov-2024 00:16:10 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2_reco_data_2024-11-22T_233405Z.root"
23-Nov-2024 00:16:10 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/4e/bb/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.67196       23.8481       639.155       7.33856       66.6808        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00148447     0.154786       1.98862      0.115963       0.20716        100    
reco:linecluster:LineCluster                           0.0615714     0.605841       27.5232      0.331483       2.71429        100    
reco:trajcluster:TrajCluster                          0.00674002     0.759355       40.3071      0.138801       4.05566        100    
reco:pandora:StandardPandora                           0.265076       2.91892       131.232       1.36994       12.9329        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000123506   0.00624736     0.200751     0.00114967     0.0207084       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000156226    0.0143878     0.289979     0.00198731     0.0412171       100    
reco:pandoracalo:Calorimetry                          8.9975e-05     0.0219347      1.29682     0.000611802     0.12983        100    
reco:pandorapid:Chi2ParticleID                        3.6315e-05    0.00015046    0.000835528   0.000109576   0.000120244      100    
reco:trkshowersplit:TrackShowerHits                   9.8969e-05     0.019864      0.950566     0.000429538    0.0980613       100    
reco:pmtrack:PMAlgTrackMaker                          0.00103683      2.24542       90.6584      0.102602       9.4395         100    
reco:pmtrackcalo:Calorimetry                          7.0055e-05     0.0106402     0.522993     0.000651051    0.0530367       100    
reco:pmtrackpid:Chi2ParticleID                        2.2554e-05    0.000266271   0.00281514    0.000135459   0.000394081      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000161473     1.99447       58.6189      0.167607       6.84924        100    
reco:pmtrajfitcalo:Calorimetry                        4.1633e-05     0.0216321      1.32406     0.000907588    0.132614        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.1111e-05    0.000168547   0.000791493   0.000134057   0.000119858      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00118234      2.38213       90.9069      0.105737       9.67661        100    
reco:pmtracktccalo:Calorimetry                        7.7256e-05     0.0063474      0.18506     0.000713114    0.0206232       100    
reco:pmtracktcpid:Chi2ParticleID                      2.5759e-05    0.000227097   0.00226833    0.000131413   0.000300168      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000171348     1.33823       40.5193      0.176984       4.34816        100    
reco:pmtrajfittccalo:Calorimetry                       4.656e-05     0.0131079     0.719208     0.000815374    0.0724851       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.2394e-05    0.000279684   0.00343938    0.000151779   0.000422655      100    
reco:blurredcluster:BlurredClustering                 0.00829281     0.919761       7.40629      0.461033       1.18099        100    
reco:emtrkmichelid:EmTrackMichelId                     0.166266       7.7345        137.023       1.50798       16.3987        100    
reco:emshower:EMShower                                0.000270848    0.0217271     0.315048     0.00444561     0.0404964       100    
reco:cvnmap:CVNMapper                                 1.9971e-05     0.0082306     0.0332578     0.0047351     0.0090681       100    
reco:cvneva:CVNEvaluator                              1.4823e-05     0.459441      0.939515      0.588111      0.327487        100    
reco:energyrecnumu:EnergyReco                         0.000295505    0.0465339      1.65764     0.00569531     0.185519        100    
reco:energyrecnue:EnergyReco                          9.8288e-05    0.00179197     0.057642     0.000450815   0.00586919       100    
reco:energyrecnc:EnergyReco                           0.00132224    0.00347723     0.0590806    0.00243491    0.00591733       100    
reco:energyrecnumurange:EnergyReco                    0.000129716    0.0433608      1.69074     0.00219028      0.18811        100    
reco:energyrecnumumcs:EnergyReco                      0.00129576     0.0467861      1.77551     0.00263098     0.198241        100    
reco:opdec:Deconvolution                               0.0627521     0.347233       1.24412       0.31995      0.192513        100    
reco:ophitspe:OpHitFinderDeco                          0.145999       1.49738       3.52649       1.40318      0.734161        100    
reco:opflash:OpFlashFinder                            0.000177187   0.00124168    0.00376119    0.00114281    0.000607228      100    
reco:rns:RandomNumberSaver                            1.8297e-05    3.47351e-05   0.00035178    2.7797e-05    3.38614e-05      100    
reco:anglereconue:NuAngularReco                       0.000140983   0.00147758     0.0534928    0.000362812   0.00541951       100    
reco:anglereconumu:NuAngularReco                      5.1317e-05    0.00125143     0.0537507    0.00016277    0.00545379       100    
reco:anglereconuepfps:NuAngularReco                   9.8138e-05    0.00137424     0.0527726    0.000276482   0.00534757       100    
reco:anglereconumupfps:NuAngularReco                  7.0216e-05    0.00129656     0.0537334    0.000212806   0.00545157       100    
[art]:TriggerResults:TriggerResultInserter             9.034e-06    1.42998e-05   8.2534e-05    1.2289e-05    8.74723e-06      100    
end_path:out1:RootOutput                               3.325e-06    4.73073e-06   2.7551e-05     4.137e-06    2.92946e-06      100    
end_path:out1:RootOutput(write)                        0.0137527     0.194755      0.976519      0.182109      0.152957        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40476.7 MB
  Peak resident set size usage (VmHWM): 2663.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2_reco_2024-11-22T_233405Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_859_20231204T045739Z_gen_g4_detsim_hitreco__20240509T211334Z_reco2_reco_data_2024-11-22T_233405Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:32:14 UTC       justIN version: 01.01.09