justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108521.46@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108521.46@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:47:01
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-22 23:58:38
From worker nodeHostnamen260.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:57:54
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2.root
JobscriptExit code0
Real time57m (3431s)
CPU time50m (3002s = 87%)
Outputting started2024-11-22 23:55:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2.root
Finished2024-11-22 23:58:38
Saved logsjustin-logs:108521.46-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Flip, endpoint closer to vStart.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
1st wire C:0 T:10 P:2 W:732 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:54:57 GMT run: 50601160 subRun: 1 event: 22000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 106, 96, 110
minwire 0: 1529
minwire 1: 2181
minwire 2: 991
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0633621, 0.00270129, 0.933937, 
Output 1: 0.0177293, 0.972162, 0.00994253, 0.000165788, 
Output 2: 0.950029, 0.049971, 

564
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1865!
22-Nov-2024 23:55:05 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2_reco_data_2024-11-22T_225758Z.root"
22-Nov-2024 23:55:05 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/a0/1e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.0988        30.3538       515.886       8.87527       74.808         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0165992     0.131863       0.63066      0.0592235     0.139479        100    
reco:linecluster:LineCluster                           0.0960212     0.442828       3.66008      0.185328      0.623312        100    
reco:trajcluster:TrajCluster                           0.0481732     0.925448       33.2274      0.057287       3.94725        100    
reco:pandora:StandardPandora                           0.0584451      2.64804       50.4218       1.24151       6.81506        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000130185   0.00583983     0.144359     0.00136215     0.0169466       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000188625    0.0093421     0.143703     0.00282947     0.0194592       100    
reco:pandoracalo:Calorimetry                          0.000117581    0.0216406     0.550515     0.00100418     0.0741484       100    
reco:pandorapid:Chi2ParticleID                        3.6469e-05    0.000162887   0.00137985    0.000126498   0.000161379      100    
reco:trkshowersplit:TrackShowerHits                   8.1353e-05     0.0279899     0.601878     0.000671077    0.0946349       100    
reco:pmtrack:PMAlgTrackMaker                          0.000963964     2.75069       58.3174       0.13584       8.89587        100    
reco:pmtrackcalo:Calorimetry                          6.2658e-05     0.0163626      0.55703     0.000913008    0.0756393       100    
reco:pmtrackpid:Chi2ParticleID                        2.5869e-05    0.000343136   0.00594569    0.000135571   0.000763239      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000169259     2.56997       79.5434      0.251311       9.20738        100    
reco:pmtrajfitcalo:Calorimetry                        5.4172e-05     0.022482       0.66333      0.0014593     0.0837027       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.3214e-05    0.00019166    0.000990262   0.000156795   0.000153483      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000813661     3.83113       102.701      0.199484       14.1389        100    
reco:pmtracktccalo:Calorimetry                        5.7217e-05    0.00918713     0.305122     0.00098927     0.0393843       100    
reco:pmtracktcpid:Chi2ParticleID                      2.2242e-05    0.000288911   0.00392406    0.000147167   0.000527901      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000232166     1.85948       38.1045      0.225054       5.47894        100    
reco:pmtrajfittccalo:Calorimetry                      8.2756e-05     0.019776      0.596425     0.000964369    0.0822128       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.5216e-05    0.000394356   0.00490973    0.000153579   0.000756592      100    
reco:blurredcluster:BlurredClustering                 9.2394e-05     0.951906       7.91523      0.365496       1.38813        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000148359     10.7956       160.366       2.34385       25.4051        100    
reco:emshower:EMShower                                0.000215395    0.0334554     0.492102     0.00455876     0.0679643       100    
reco:cvnmap:CVNMapper                                 2.7872e-05     0.0116798     0.0435833     0.0112707     0.010405        100    
reco:cvneva:CVNEvaluator                              1.9346e-05     0.545045       1.02481      0.691609      0.371967        100    
reco:energyrecnumu:EnergyReco                         0.000354927    0.0211686     0.326011      0.0035176     0.0540603       100    
reco:energyrecnue:EnergyReco                          0.000125256   0.00211426     0.0549495    0.000489587   0.00625146       100    
reco:energyrecnc:EnergyReco                           0.00154346     0.0044146     0.0595493    0.00306569    0.00653375       100    
reco:energyrecnumurange:EnergyReco                    0.000147627    0.0192953     0.321301     0.00275999     0.0541798       100    
reco:energyrecnumumcs:EnergyReco                      0.00110158     0.0208534      0.32313     0.00345804     0.054524        100    
reco:opdec:Deconvolution                               0.089696      0.419336       3.07833      0.288622      0.432786        100    
reco:ophitspe:OpHitFinderDeco                          0.457531       1.9871        4.90145        1.894        0.99236        100    
reco:opflash:OpFlashFinder                            0.000495092   0.00143659    0.00496977    0.00135049    0.00071823       100    
reco:rns:RandomNumberSaver                            1.6962e-05    3.96287e-05   0.000391356   3.63035e-05   3.64537e-05      100    
reco:anglereconue:NuAngularReco                       0.000178336   0.00181999     0.0430873    0.000394237    0.0055478       100    
reco:anglereconumu:NuAngularReco                      5.9643e-05    0.00158092     0.0417516    0.000212515   0.00539775       100    
reco:anglereconuepfps:NuAngularReco                   0.000117301   0.00173527     0.0413814    0.000352884    0.0053495       100    
reco:anglereconumupfps:NuAngularReco                  8.3467e-05    0.00164191     0.0410821    0.000279015   0.00533554       100    
[art]:TriggerResults:TriggerResultInserter             8.817e-06    1.4283e-05    6.6044e-05    1.35455e-05   6.21695e-06      100    
end_path:out1:RootOutput                               2.485e-06    6.30212e-06    3.723e-05     5.896e-06    4.02605e-06      100    
end_path:out1:RootOutput(write)                        0.0275312     0.238085       1.15339      0.228459      0.203443        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38912.6 MB
  Peak resident set size usage (VmHWM): 2720.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2_reco_2024-11-22T_225758Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50601160_219_20231204T233920Z_gen_g4_detsim_hitreco__20240509T222520Z_reco2_reco_data_2024-11-22T_225758Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:56:38 UTC       justIN version: 01.01.09