justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108549.34@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108549.34@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:12:42
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:09:17
From worker nodeHostnamedune001-3354266.0-lcg2715.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:28:59
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2.root
JobscriptExit code0
Real time34m (2071s)
CPU time35m (2114s = 102%)
Outputting started2024-11-23 00:03:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2.root
Finished2024-11-23 00:09:17
Saved logsjustin-logs:108549.34-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

25 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:03:25 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:03:25 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:26 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:26 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:03:26 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:03:27 UTC run: 66006610 subRun: 1 event: 51500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 104, 121, 96
minwire 0: 65
minwire 1: 2250
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0395273, 0.957538, 0.00293486, 
Output 1: 0.990048, 0.00981728, 0.000125473, 9.45508e-06, 
Output 2: 0.998465, 0.00153538, 

264
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 716!
23-Nov-2024 00:03:29 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2_reco_data_2024-11-22T_232920Z.root"
23-Nov-2024 00:03:29 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/5c/57/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.41963       19.3144       499.679       6.9385        53.0783        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00129931     0.112294      0.513591      0.0867975     0.0826442       100    
reco:linecluster:LineCluster                           0.0287372     0.472319       11.8002      0.296001       1.1789         100    
reco:trajcluster:TrajCluster                          0.00167165     0.532593       24.7053      0.120073       2.51954        100    
reco:pandora:StandardPandora                           0.106497       3.14546       160.83        1.29501       15.8859        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000121863   0.00462076     0.102907     0.00108132     0.0115493       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000193361   0.00619943     0.0755515    0.00175381     0.0111666       100    
reco:pandoracalo:Calorimetry                           8.669e-05     0.0139475      0.72983     0.000565214    0.074627        100    
reco:pandorapid:Chi2ParticleID                        3.0896e-05    0.000135747   0.000538799   0.000107371   9.52946e-05      100    
reco:trkshowersplit:TrackShowerHits                   0.000101412    0.0157096     0.752791     0.000419815    0.0788376       100    
reco:pmtrack:PMAlgTrackMaker                          0.000953642     1.58102       63.7154      0.0793907      6.7637         100    
reco:pmtrackcalo:Calorimetry                          5.0426e-05    0.00645916     0.290156     0.000643026    0.0300904       100    
reco:pmtrackpid:Chi2ParticleID                         1.978e-05    0.000208066   0.00225414    0.000116556   0.000286631      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000217296     1.24395       34.8622      0.0914386      3.99913        100    
reco:pmtrajfitcalo:Calorimetry                         5.32e-05      0.0132981     0.686753     0.000806581    0.0701449       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8478e-05    0.000153988    0.0010268    0.000119955   0.000143769      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000939611     1.7758        62.9879      0.117217       6.97033        100    
reco:pmtracktccalo:Calorimetry                         5.264e-05    0.00395174      0.13004     0.000617808    0.0141035       100    
reco:pmtracktcpid:Chi2ParticleID                      2.1503e-05    0.000192515   0.00169528    0.000117356   0.000246654      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000175493    0.958582       24.4183      0.114408       2.86475        100    
reco:pmtrajfittccalo:Calorimetry                      4.7411e-05     0.0084845     0.295566     0.000718954    0.0333394       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.8958e-05    0.000250217    0.0025395    0.000120486   0.000378787      100    
reco:blurredcluster:BlurredClustering                 0.000205448    0.705166       5.71336      0.324875      0.986253        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000128272     6.10019       102.935       1.59127       13.6795        100    
reco:emshower:EMShower                                0.000171588    0.0153249     0.245415     0.00214274     0.0317902       100    
reco:cvnmap:CVNMapper                                 1.9159e-05    0.00485995     0.0333936    0.00398734    0.00543274       100    
reco:cvneva:CVNEvaluator                              1.4753e-05     0.504156       1.22484       0.62394      0.334144        100    
reco:energyrecnumu:EnergyReco                         0.000299189    0.0213518     0.424446     0.00724107     0.059394        100    
reco:energyrecnue:EnergyReco                          0.000101953   0.00141006     0.0314624    0.000329725   0.00365298       100    
reco:energyrecnc:EnergyReco                           0.00116677    0.00300662     0.0328365     0.0022771    0.00373044       100    
reco:energyrecnumurange:EnergyReco                    0.000124507    0.0159163     0.418423     0.00202057     0.0587321       100    
reco:energyrecnumumcs:EnergyReco                      0.000398598    0.0173002     0.413739      0.0025368     0.0594352       100    
reco:opdec:Deconvolution                               0.0522219     0.350215       2.13463      0.281624      0.276986        100    
reco:ophitspe:OpHitFinderDeco                          0.106131       1.48575       2.80896       1.48543      0.621498        100    
reco:opflash:OpFlashFinder                            0.000248182   0.00129959    0.00628248    0.00116259    0.000710294      100    
reco:rns:RandomNumberSaver                            1.8929e-05    3.40082e-05   0.000467161   2.8488e-05    4.41111e-05      100    
reco:anglereconue:NuAngularReco                       0.00015331    0.00115114     0.0293856    0.000307056   0.00327733       100    
reco:anglereconumu:NuAngularReco                      6.1252e-05    0.00094239     0.0287135    0.000169059   0.00319584       100    
reco:anglereconuepfps:NuAngularReco                   0.000101012   0.00105937     0.029224     0.000271552   0.00324102       100    
reco:anglereconumupfps:NuAngularReco                   7.322e-05    0.000970241    0.0271789    0.000200782   0.00307134       100    
[art]:TriggerResults:TriggerResultInserter             8.893e-06    1.33146e-05   7.6585e-05    1.22885e-05    6.996e-06       100    
end_path:out1:RootOutput                               3.175e-06    4.68097e-06   3.2499e-05     4.196e-06    2.92113e-06      100    
end_path:out1:RootOutput(write)                        0.015829      0.186697      0.740496      0.198096      0.120407        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40301.6 MB
  Peak resident set size usage (VmHWM): 2468.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2_reco_2024-11-22T_232920Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_514_20231202T202755Z_gen_g4_detsim_hitreco__20240508T065949Z_reco2_reco_data_2024-11-22T_232920Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:44:01 UTC       justIN version: 01.01.09