justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108549.172@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108549.172@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:12:42
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:26:42
From worker nodeHostnamedune001-3355294.0-lcg2705.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:32:26
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2.root
JobscriptExit code0
Real time49m (2940s)
CPU time49m (2999s = 102%)
Outputting started2024-11-23 00:21:50
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2.root
Finished2024-11-23 00:26:42
Saved logsjustin-logs:108549.172-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:21:13 UTC run: 66050399 subRun: 1 event: 72500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 248, 371, 253
minwire 0: 2412
minwire 1: 516
minwire 2: 2434
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00384379, 0.996059, 9.68007e-05, 
Output 1: 0.764792, 0.223789, 0.00973755, 0.00168161, 
Output 2: 0.992454, 0.0075457, 

488
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1611!
23-Nov-2024 00:21:25 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2_reco_data_2024-11-22T_233231Z.root"
23-Nov-2024 00:21:25 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/6b/bd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.96181       27.9773       737.033       8.83581       80.7972        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00179583     0.124553      0.417187      0.0978129     0.0829895       100    
reco:linecluster:LineCluster                           0.0457288      1.26023       78.3704      0.281208       7.90394        100    
reco:trajcluster:TrajCluster                          0.00777046      1.30551       74.7699       0.12852       7.67522        100    
reco:pandora:StandardPandora                           0.984914       2.64726       67.3628       1.37794       6.96766        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000150527   0.00662196     0.153798     0.00148278     0.018298        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000204007    0.0119018     0.177689     0.00274027     0.0267504       100    
reco:pandoracalo:Calorimetry                          9.8919e-05     0.0294789      1.61318     0.000971429    0.165591        100    
reco:pandorapid:Chi2ParticleID                        3.8117e-05    0.000167703   0.00148196    0.000120647   0.000174332      100    
reco:trkshowersplit:TrackShowerHits                   0.000114763    0.040326        2.327      0.000637726    0.237248        100    
reco:pmtrack:PMAlgTrackMaker                          0.00143818      2.91676       114.566      0.183462       12.4019        100    
reco:pmtrackcalo:Calorimetry                           7.96e-05     0.00927975     0.245274     0.000978274    0.031088        100    
reco:pmtrackpid:Chi2ParticleID                        3.0746e-05     0.0002582    0.00223661    0.00014326    0.00034891       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000254574     2.20782       77.8492      0.270399       8.34406        100    
reco:pmtrajfitcalo:Calorimetry                        7.0075e-05     0.0253223      1.26121     0.00135969     0.132731        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.8633e-05    0.000177316   0.000711842   0.000142314   0.000130687      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00140564      3.59292       128.02       0.211345       14.5793        100    
reco:pmtracktccalo:Calorimetry                        7.5874e-05    0.00522419     0.0860119    0.000966767    0.0135584       100    
reco:pmtracktcpid:Chi2ParticleID                      3.1688e-05    0.000232971   0.00140412    0.000150051   0.000253785      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000240953     1.58941       44.7467      0.281723       5.13196        100    
reco:pmtrajfittccalo:Calorimetry                      7.2109e-05     0.0147069     0.550217     0.00111764     0.0605178       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.0176e-05    0.000332489   0.00469553    0.000158013   0.000579142      100    
reco:blurredcluster:BlurredClustering                 0.00242001     0.889549       6.33975      0.448111       1.1542         100    
reco:emtrkmichelid:EmTrackMichelId                      0.22807       8.46954       132.652       2.26801       18.4095        100    
reco:emshower:EMShower                                0.000312441    0.0245073     0.281822     0.00530338     0.0463762       100    
reco:cvnmap:CVNMapper                                 2.5539e-05    0.00788656     0.0408751    0.00480159    0.00825819       100    
reco:cvneva:CVNEvaluator                               2.028e-05     0.538254      0.999812      0.626892      0.346546        100    
reco:energyrecnumu:EnergyReco                         0.000295996    0.0267811     0.433842     0.00712542     0.0685524       100    
reco:energyrecnue:EnergyReco                          8.8003e-05    0.00194546     0.0435854    0.00045513    0.00537926       100    
reco:energyrecnc:EnergyReco                            0.0014788    0.00386479     0.0473849    0.00245054    0.00568164       100    
reco:energyrecnumurange:EnergyReco                    0.000140972    0.0220246     0.422796     0.00229797     0.0646972       100    
reco:energyrecnumumcs:EnergyReco                      0.00112355     0.0233273     0.430669     0.00279425     0.0657212       100    
reco:opdec:Deconvolution                               0.0852884     0.344824       2.19284      0.308332      0.254759        100    
reco:ophitspe:OpHitFinderDeco                          0.165254       1.60898       3.28779       1.48867      0.627356        100    
reco:opflash:OpFlashFinder                            0.00036477     0.0014069    0.00476629    0.00127613    0.000660841      100    
reco:rns:RandomNumberSaver                            1.6425e-05    3.39194e-05   0.000340743   2.74265e-05   3.30354e-05      100    
reco:anglereconue:NuAngularReco                       0.000142915   0.00151279     0.0276852    0.000387824   0.00385739       100    
reco:anglereconumu:NuAngularReco                      5.4513e-05     0.0012463     0.0246151    0.000214163   0.00352261       100    
reco:anglereconuepfps:NuAngularReco                   0.000105278   0.00137531     0.0252245    0.00031833    0.00355829       100    
reco:anglereconumupfps:NuAngularReco                  6.8182e-05    0.00130545     0.0252604    0.000247588    0.0036358       100    
[art]:TriggerResults:TriggerResultInserter             8.393e-06    1.32972e-05   4.8202e-05    1.2028e-05    4.96428e-06      100    
end_path:out1:RootOutput                               2.774e-06    3.72368e-06   1.8328e-05    3.4655e-06    1.58235e-06      100    
end_path:out1:RootOutput(write)                        0.022509      0.218434      0.832695      0.221468      0.146952        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40333.2 MB
  Peak resident set size usage (VmHWM): 2527.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2_reco_2024-11-22T_233231Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66050399_724_20231207T233337Z_gen_g4_detsim_hitreco__20240510T050553Z_reco2_reco_data_2024-11-22T_233231Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:40:43 UTC       justIN version: 01.01.09