justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301494.166@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301494.166@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:14:09
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:18:47
From worker nodeHostnamedune001-3355236.0-lcg2710.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:19
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2.root
JobscriptExit code0
Real time38m (2336s)
CPU time40m (2447s = 104%)
Outputting started2024-11-23 00:12:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2.root
Finished2024-11-23 00:18:47
Saved logsjustin-logs:301494.166-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

n: 1 event: 71700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:09 UTC run: 6492179 subRun: 1 event: 71700
1st wire C:0 T:7 P:2 W:535 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:09 UTC run: 6492179 subRun: 1 event: 71700
1st wire C:0 T:7 P:2 W:537 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:09 UTC run: 6492179 subRun: 1 event: 71700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:09 UTC run: 6492179 subRun: 1 event: 71700
1st wire C:0 T:7 P:2 W:551 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:12:09 UTC run: 6492179 subRun: 1 event: 71700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:12:11 UTC run: 6492179 subRun: 1 event: 71700
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 136, 101, 77
minwire 0: 661
minwire 1: 2107
minwire 2: 534
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0162882, 0.951116, 0.0325958, 
Output 1: 0.825194, 0.173625, 0.00103332, 0.000148128, 
Output 2: 0.994756, 0.00524376, 

376
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1079!
23-Nov-2024 00:12:14 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2_reco_data_2024-11-22T_233323Z.root"
23-Nov-2024 00:12:14 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/1b/af/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.627005       22.0773       400.588       8.30074       46.8266        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00194162     0.0936953     0.283146      0.0791912     0.0589527       100    
reco:linecluster:LineCluster                           0.0637398     0.363711       5.32931       0.24609       0.59289        100    
reco:trajcluster:TrajCluster                          0.000869072    0.591562       15.7467      0.0843696      2.12513        100    
reco:pandora:StandardPandora                           0.0452834      2.36886       69.328        1.27797       6.94863        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000108765   0.00620144     0.149062     0.00163037     0.0160659       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000142024    0.014026      0.381644     0.00295284     0.0452111       100    
reco:pandoracalo:Calorimetry                          8.3156e-05     0.0143177     0.345369     0.000969363    0.0465675       100    
reco:pandorapid:Chi2ParticleID                        3.2008e-05    0.000171216   0.00186843    0.000127998   0.000199578      100    
reco:trkshowersplit:TrackShowerHits                   6.1523e-05     0.0196816     0.456345     0.000667557    0.067131        100    
reco:pmtrack:PMAlgTrackMaker                          0.000925557     2.16274       48.9182      0.201097       6.21342        100    
reco:pmtrackcalo:Calorimetry                          4.8864e-05    0.00885294     0.390309     0.000859352    0.0404015       100    
reco:pmtrackpid:Chi2ParticleID                        1.9059e-05    0.000253063   0.00223811    0.000150447   0.000338026      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000122125     1.48229       17.7318       0.23782       3.24557        100    
reco:pmtrajfitcalo:Calorimetry                        4.1363e-05     0.0136078     0.445457     0.00132031     0.0492831       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.7336e-05    0.000179008   0.00106097    0.000139445   0.000143672      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000654428     2.28722       72.1097      0.197279       8.07541        100    
reco:pmtracktccalo:Calorimetry                        4.4307e-05    0.00844291     0.488365     0.000885431    0.0486756       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8147e-05    0.000239855    0.0032592    0.000149355   0.000358052      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000116676     1.17302       25.7925       0.22994       2.93783        100    
reco:pmtrajfittccalo:Calorimetry                      3.7827e-05     0.0112081     0.452653     0.00111072     0.0469406       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7436e-05    0.000297485   0.00265188    0.000151859   0.00040732       100    
reco:blurredcluster:BlurredClustering                 0.000207634    0.925098       8.74841      0.452324       1.28952        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000113331     7.96211       135.613       2.13767       16.643         100    
reco:emshower:EMShower                                0.000166942    0.0193025      0.20482     0.00317391     0.032265        100    
reco:cvnmap:CVNMapper                                 1.6976e-05    0.00843527     0.0385723    0.00475347     0.0089512       100    
reco:cvneva:CVNEvaluator                              1.5684e-05     0.485283      0.981658      0.564549      0.332041        100    
reco:energyrecnumu:EnergyReco                         0.000345462    0.0273682     0.801778     0.00649112     0.0863303       100    
reco:energyrecnue:EnergyReco                          0.000144148    0.0018199     0.0508824    0.000508067   0.00521118       100    
reco:energyrecnc:EnergyReco                           0.00138514    0.00351458     0.0520591    0.00243799    0.00514973       100    
reco:energyrecnumurange:EnergyReco                    0.000158159    0.0232411      0.7668      0.00229704     0.0834821       100    
reco:energyrecnumumcs:EnergyReco                      0.000969723    0.0244615     0.791821     0.00270708     0.0854944       100    
reco:opdec:Deconvolution                               0.0401706     0.306465      0.832841      0.287038      0.145361        100    
reco:ophitspe:OpHitFinderDeco                          0.0974218      1.45315       2.96984       1.42646      0.719187        100    
reco:opflash:OpFlashFinder                            0.000118779   0.00134969    0.00455196    0.00128169    0.000730877      100    
reco:rns:RandomNumberSaver                            1.7186e-05    3.16156e-05   0.000304489   2.52785e-05   2.91497e-05      100    
reco:anglereconue:NuAngularReco                       0.000137448   0.00163183     0.0481274    0.000396292   0.00498601       100    
reco:anglereconumu:NuAngularReco                      4.7201e-05     0.0013529     0.0455537    0.000229376   0.00471833       100    
reco:anglereconuepfps:NuAngularReco                   9.1719e-05    0.00149158     0.0461906    0.000344639   0.00478564       100    
reco:anglereconumupfps:NuAngularReco                  6.4948e-05    0.00141311     0.0454008    0.000279627   0.00470821       100    
[art]:TriggerResults:TriggerResultInserter             7.982e-06    1.3692e-05    5.9209e-05    1.1893e-05    5.95149e-06      100    
end_path:out1:RootOutput                               2.694e-06    3.87909e-06   2.4627e-05    3.4405e-06    2.80574e-06      100    
end_path:out1:RootOutput(write)                        0.0133307     0.207364      0.889678      0.214735      0.143886        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40556.9 MB
  Peak resident set size usage (VmHWM): 2773.43 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2_reco_2024-11-22T_233323Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492179_716_20231208T050748Z_gen_g4_detsim_hitreco__20240510T041822Z_reco2_reco_data_2024-11-22T_233323Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:59:56 UTC       justIN version: 01.01.09