justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108512.178@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108512.178@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:14:30
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-22 23:21:25
From worker nodeHostnamen256.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:34:50
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2.root
JobscriptExit code0
Real time44m (2654s)
CPU time37m (2261s = 85%)
Outputting started2024-11-22 23:19:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2.root
Finished2024-11-22 23:21:25
Saved logsjustin-logs:108512.178-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ent: 47100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:51 GMT run: 6411871 subRun: 1 event: 47100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:51 GMT run: 6411871 subRun: 1 event: 47100
1st wire C:0 T:9 P:2 W:590 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:51 GMT run: 6411871 subRun: 1 event: 47100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:51 GMT run: 6411871 subRun: 1 event: 47100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:51 GMT run: 6411871 subRun: 1 event: 47100
1st wire C:0 T:13 P:2 W:544 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:18:52 GMT run: 6411871 subRun: 1 event: 47100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 294, 358, 353
minwire 0: 1209
minwire 1: 1161
minwire 2: 1224
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 8.89135e-05, 0.9999, 1.06999e-05, 
Output 1: 0.934238, 0.0638597, 0.00180996, 9.18718e-05, 
Output 2: 0.977111, 0.0228887, 

578
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1916!
22-Nov-2024 23:19:04 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2_reco_data_2024-11-22T_223455Z.root"
22-Nov-2024 23:19:04 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/09/40/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.80555       22.7226       479.498       8.78142       55.156         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.017561      0.047705      0.327534      0.0422161     0.0321763       100    
reco:linecluster:LineCluster                           0.172576      0.431264       14.8029      0.199353       1.51871        100    
reco:trajcluster:TrajCluster                           0.0506683     0.786327       45.1533      0.0615583      4.68003        100    
reco:pandora:StandardPandora                           0.821421       1.86871       30.0825       1.15402       3.99148        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000113894   0.00397573     0.0474621    0.00142928    0.00731339       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000153669   0.00921663     0.109133     0.00376035     0.0152473       100    
reco:pandoracalo:Calorimetry                          8.9378e-05     0.0156687     0.586089     0.00115711     0.0702488       100    
reco:pandorapid:Chi2ParticleID                        3.3213e-05    0.000147108   0.00175718    0.000113188   0.000178316      100    
reco:trkshowersplit:TrackShowerHits                    0.0001166     0.0203419     0.836564     0.000825608    0.095067        100    
reco:pmtrack:PMAlgTrackMaker                          0.000967621     1.97928       80.6257      0.240195       8.62239        100    
reco:pmtrackcalo:Calorimetry                          6.0514e-05    0.00619974     0.133757     0.000884184    0.0187518       100    
reco:pmtrackpid:Chi2ParticleID                        2.3204e-05    0.000242376   0.00219493    0.000135059   0.000335092      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000156074     1.77686       56.7463      0.392526       6.23582        100    
reco:pmtrajfitcalo:Calorimetry                        5.3631e-05     0.0159146     0.566088     0.00148603     0.0686665       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.2663e-05    0.000164124   0.000549854   0.000137438   0.000108615      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000769598     2.28841       80.9683       0.22497       9.13192        100    
reco:pmtracktccalo:Calorimetry                         5.844e-05    0.00412433     0.0557898    0.00102286    0.00890528       100    
reco:pmtracktcpid:Chi2ParticleID                      2.2993e-05    0.000234095   0.00176209    0.000149372   0.000284246      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000152086     1.1706        24.0621      0.276457       3.20926        100    
reco:pmtrajfittccalo:Calorimetry                      5.7388e-05     0.0122933     0.431878     0.00121937     0.0503913       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.2613e-05    0.000318592   0.00375682    0.000155583   0.000533743      100    
reco:blurredcluster:BlurredClustering                 0.00799777     0.855583       6.95499       0.44973       1.18879        100    
reco:emtrkmichelid:EmTrackMichelId                     0.168252       8.44431       130.727       2.66289       17.3844        100    
reco:emshower:EMShower                                0.00025504     0.0211807     0.159355      0.0027817     0.0346178       100    
reco:cvnmap:CVNMapper                                 2.4416e-05    0.00891974     0.0358061     0.0081512    0.00723699       100    
reco:cvneva:CVNEvaluator                              1.5579e-05     0.620212       1.20915      0.731109      0.357341        100    
reco:energyrecnumu:EnergyReco                         0.000324159    0.0346607     0.743349     0.00428953     0.0975082       100    
reco:energyrecnue:EnergyReco                          0.00012246    0.00129231     0.0141013    0.000474703   0.00217232       100    
reco:energyrecnc:EnergyReco                           0.00175075    0.00357543     0.0169505    0.00303896    0.00244718       100    
reco:energyrecnumurange:EnergyReco                    0.000173206    0.0327507      0.72476     0.00277783     0.0958108       100    
reco:energyrecnumumcs:EnergyReco                      0.000814823    0.0344573      0.7459      0.00349486     0.0971967       100    
reco:opdec:Deconvolution                               0.0792058     0.289989      0.527268      0.291613      0.0889206       100    
reco:ophitspe:OpHitFinderDeco                          0.238152       1.71459       3.45571       1.61839      0.714569        100    
reco:opflash:OpFlashFinder                            0.000283122   0.00135464    0.00492945    0.00125527    0.000641031      100    
reco:rns:RandomNumberSaver                            1.8295e-05    3.84865e-05   0.000368063   3.2777e-05    3.55431e-05      100    
reco:anglereconue:NuAngularReco                       0.000140785   0.000914215    0.0103806    0.000370983   0.00154979       100    
reco:anglereconumu:NuAngularReco                      6.5383e-05    0.000732418    0.0100765    0.000235142   0.00150487       100    
reco:anglereconuepfps:NuAngularReco                   0.000108023   0.00085426     0.0092566    0.000343506   0.00146387       100    
reco:anglereconumupfps:NuAngularReco                  8.7525e-05    0.000782158    0.0101325    0.000289114   0.00150859       100    
[art]:TriggerResults:TriggerResultInserter             9.147e-06    1.3367e-05    4.0265e-05    1.2809e-05    3.91661e-06      100    
end_path:out1:RootOutput                               2.885e-06    6.33481e-06   1.7373e-05    6.6575e-06    2.54993e-06      100    
end_path:out1:RootOutput(write)                        0.0139425     0.216402      0.709297      0.220482      0.130731        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38428.5 MB
  Peak resident set size usage (VmHWM): 2360.25 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2_reco_2024-11-22T_223455Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6411871_470_20231203T114444Z_gen_g4_detsim_hitreco__20240509T195340Z_reco2_reco_data_2024-11-22T_223455Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:05:20 UTC       justIN version: 01.01.09