justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108544.79@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108544.79@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:01:33
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-22 23:55:00
From worker nodeHostnamedune001-3353832.0-lcg2699.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:17:09
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2.root
JobscriptExit code0
Real time28m (1702s)
CPU time30m (1834s = 107%)
Outputting started2024-11-22 23:45:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2.root
Finished2024-11-22 23:55:00
Saved logsjustin-logs:108544.79-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:45:25 UTC run: 66027687 subRun: 1 event: 48900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:45:25 UTC run: 66027687 subRun: 1 event: 48900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:45:25 UTC run: 66027687 subRun: 1 event: 48900
1st wire C:0 T:20 P:2 W:872 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:45:25 UTC run: 66027687 subRun: 1 event: 48900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:45:28 UTC run: 66027687 subRun: 1 event: 48900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 53, 51, 44
minwire 0: 2319
minwire 1: 625
minwire 2: 2440
Used alternate method to get min and max wires due to vertex determination failure: 469, 668
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 123, 322
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 121, 320
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.995472, 0.000521936, 0.00400557, 
Output 1: 0.0506551, 0.319878, 0.575915, 0.0535513, 
Output 2: 0.992467, 0.00753282, 

442
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1429!
22-Nov-2024 23:45:30 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2_reco_data_2024-11-22T_231713Z.root"
22-Nov-2024 23:45:30 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/80/a4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.16111       15.7985       274.425       7.01273       30.3746        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00144774     0.0895024     0.408236      0.0768953     0.0608585       100    
reco:linecluster:LineCluster                           0.0570093     0.264522       1.52145      0.219095      0.201269        100    
reco:trajcluster:TrajCluster                          0.00515605     0.304585       12.4889      0.0812397      1.27312        100    
reco:pandora:StandardPandora                            0.93558       1.59908       24.2105       1.22097       2.32337        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000140281   0.00416958     0.0951651    0.00111541     0.0104889       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00019271    0.00970476     0.184188     0.00224479     0.0237189       100    
reco:pandoracalo:Calorimetry                          0.000112639   0.00743675     0.247839     0.000663583    0.0260548       100    
reco:pandorapid:Chi2ParticleID                        4.2514e-05    0.000145659   0.000765823   0.00012269    0.000107351      100    
reco:trkshowersplit:TrackShowerHits                   0.000104327    0.010771      0.502621     0.000437423    0.0521406       100    
reco:pmtrack:PMAlgTrackMaker                          0.00111081      1.24542       34.3411      0.0798676      3.85954        100    
reco:pmtrackcalo:Calorimetry                          6.7481e-05    0.00638098     0.292592     0.000734866    0.0299687       100    
reco:pmtrackpid:Chi2ParticleID                        2.5538e-05    0.000210784   0.00181946     0.0001397    0.000253852      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000185849    0.987508       27.2884      0.176903       3.00043        100    
reco:pmtrajfitcalo:Calorimetry                        5.6505e-05    0.00771046     0.246577     0.000963079    0.0266182       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.2474e-05    0.000173001   0.00102351    0.000130171   0.000141428      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00102635      1.36353       45.6913      0.111105       4.89355        100    
reco:pmtracktccalo:Calorimetry                        6.5388e-05    0.00378262     0.104265     0.000687806    0.0122736       100    
reco:pmtracktcpid:Chi2ParticleID                      2.5498e-05    0.000199185   0.00153265    0.000131859   0.000214306      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000168494    0.746827       13.3543      0.190976       1.67433        100    
reco:pmtrajfittccalo:Calorimetry                       5.996e-05    0.00642478     0.248366     0.000775227    0.0256654       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5378e-05    0.000239804   0.00201344    0.000138934   0.000274813      100    
reco:blurredcluster:BlurredClustering                 0.00755012     0.766288       5.24864      0.459532       1.03744        100    
reco:emtrkmichelid:EmTrackMichelId                     0.216003       5.91562       102.712       1.56951       12.2718        100    
reco:emshower:EMShower                                0.000307502    0.0154326     0.112779      0.0037806     0.0224183       100    
reco:cvnmap:CVNMapper                                 2.2344e-05    0.00698836     0.0577535    0.00414159     0.0086748       100    
reco:cvneva:CVNEvaluator                              1.7917e-05     0.462042      0.956172       0.56195      0.325629        100    
reco:energyrecnumu:EnergyReco                         0.000342996    0.0214616     0.393177      0.0059583     0.0574581       100    
reco:energyrecnue:EnergyReco                          0.000102464   0.00126481     0.0313448    0.00033251    0.00338654       100    
reco:energyrecnc:EnergyReco                            0.0012759    0.00291759     0.0335029    0.00234292    0.00345664       100    
reco:energyrecnumurange:EnergyReco                    0.000154412    0.0182918     0.402015     0.00186316     0.0581246       100    
reco:energyrecnumumcs:EnergyReco                      0.000821186    0.020304      0.412264     0.00271099     0.0607647       100    
reco:opdec:Deconvolution                               0.078643      0.275997      0.763355      0.260809      0.123163        100    
reco:ophitspe:OpHitFinderDeco                          0.352345       1.4388        2.70319       1.46327      0.580138        100    
reco:opflash:OpFlashFinder                            0.000334223    0.0013421    0.00393059    0.00130493    0.000543664      100    
reco:rns:RandomNumberSaver                            2.0111e-05    3.63735e-05   0.000275434   3.0816e-05    2.68351e-05      100    
reco:anglereconue:NuAngularReco                       0.00017278    0.00110938     0.0300882    0.000370563   0.00316522       100    
reco:anglereconumu:NuAngularReco                      5.6585e-05    0.00082801     0.0269941    0.000145464   0.00288409       100    
reco:anglereconuepfps:NuAngularReco                   0.000116956   0.000982439    0.0271573    0.00029564     0.0028965       100    
reco:anglereconumupfps:NuAngularReco                  8.2915e-05    0.000893927    0.0279643    0.000208725   0.00299175       100    
[art]:TriggerResults:TriggerResultInserter             8.492e-06    1.42566e-05   4.7322e-05    1.2909e-05    5.44773e-06      100    
end_path:out1:RootOutput                               2.965e-06    4.70098e-06   1.8739e-05     4.637e-06    1.59481e-06      100    
end_path:out1:RootOutput(write)                        0.0205424     0.187441      0.692998      0.209003      0.114562        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40256.7 MB
  Peak resident set size usage (VmHWM): 2463.06 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2_reco_2024-11-22T_231713Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_488_20231207T003141Z_gen_g4_detsim_hitreco__20240510T061700Z_reco2_reco_data_2024-11-22T_231713Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:55:18 UTC       justIN version: 01.01.09