justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 280330.66@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID280330.66@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3836
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-10-26 02:34:22
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce13-multicore
Last heartbeat2024-10-26 06:39:45
From worker nodeHostnametd821.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-26 03:05:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2.root
JobscriptExit code0
Real time3h (12823s)
CPU time3h (11744s = 91%)
Outputting started2024-10-26 06:39:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2.root
Finished2024-10-26 06:39:45
Saved logsjustin-logs:280330.66-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

bRun: 1 event: 23600
1st wire C:0 T:22 P:2 W:689 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 08:39:01 CEST run: 50258586 subRun: 1 event: 23600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 08:39:01 CEST run: 50258586 subRun: 1 event: 23600
1st wire C:0 T:22 P:2 W:644 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 08:39:01 CEST run: 50258586 subRun: 1 event: 23600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 08:39:01 CEST run: 50258586 subRun: 1 event: 23600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  26-Oct-2024 08:39:08 CEST run: 50258586 subRun: 1 event: 23600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  26-Oct-2024 08:39:08 CEST run: 50258586 subRun: 1 event: 23600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 345, 322, 240
minwire 0: 2302
minwire 1: 619
minwire 2: 2353
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0121057, 0.978807, 0.00908686, 
Output 1: 0.95491, 0.0447874, 0.000286106, 1.61641e-05, 
Output 2: 0.0583248, 0.941675, 

478
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1539!
26-Oct-2024 08:39:13 CEST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2_reco_data_2024-10-26T_030536Z.root"
26-Oct-2024 08:39:13 CEST  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/76/bd/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.36498       59.9612       2560.64       11.0304       218.277        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0471097     0.088574      0.356812      0.0929713     0.0329841       200    
reco:linecluster:LineCluster                           0.273989       1.94023       178.531      0.436797       12.9895        200    
reco:trajcluster:TrajCluster                            0.13735       5.23099       401.098      0.149224       31.9965        200    
reco:pandora:StandardPandora                            0.14723       10.001        694.012       1.68605       59.8135        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000134871    0.0104282     0.239591     0.00159021     0.0274546       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000191391    0.0167712      0.42853     0.00339821     0.0444941       200    
reco:pandoracalo:Calorimetry                          0.00010361     0.0470358      2.38902     0.00106236     0.205999        200    
reco:pandorapid:Chi2ParticleID                         3.883e-05    0.000196125   0.00206322    0.000136145   0.000205132      200    
reco:trkshowersplit:TrackShowerHits                    7.458e-05     0.0564574      2.39898     0.000629063    0.230779        200    
reco:pmtrack:PMAlgTrackMaker                          0.00138311      5.81879       319.862      0.189985       25.8678        200    
reco:pmtrackcalo:Calorimetry                           7.162e-05     0.0244252     0.990402     0.000925325    0.0995686       200    
reco:pmtrackpid:Chi2ParticleID                         3.014e-05    0.000410348   0.00552723    0.000149746   0.000784074      200    
reco:pmtrajfit:PMAlgTrajFitter                         0.0001919      5.50729       269.407      0.249734       24.1607        200    
reco:pmtrajfitcalo:Calorimetry                         6.812e-05     0.0482441      2.33171     0.00151507     0.207586        200    
reco:pmtrajfitpid:Chi2ParticleID                       2.881e-05    0.000218147   0.00139627    0.000147666   0.000208743      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00116111      6.6362        295.154      0.199614       26.5829        200    
reco:pmtracktccalo:Calorimetry                         7.107e-05     0.0126354     0.352405     0.000887349    0.039631        200    
reco:pmtracktcpid:Chi2ParticleID                      3.0781e-05    0.000357604   0.00387037    0.000146421   0.00058249       200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00018979      2.97715       99.2417      0.293672       9.35511        200    
reco:pmtrajfittccalo:Calorimetry                       6.664e-05     0.037255       2.04067     0.00111546     0.167163        200    
reco:pmtrajfittcpid:Chi2ParticleID                     2.941e-05    0.000534136    0.0100522    0.000164011   0.00112087       200    
reco:blurredcluster:BlurredClustering                 0.00010583      1.33467       13.3955      0.541225       2.05377        200    
reco:emtrkmichelid:EmTrackMichelId                    0.00013766      16.0915       260.417       2.96581       36.3812        200    
reco:emshower:EMShower                                0.000209641    0.0455316     0.659759      0.0087289     0.100489        200    
reco:cvnmap:CVNMapper                                 2.3871e-05     0.0093605     0.0800197    0.00753432     0.0107279       200    
reco:cvneva:CVNEvaluator                               1.757e-05     0.711516       1.55857       0.88946      0.484774        200    
reco:energyrecnumu:EnergyReco                         0.000310212    0.0834228      2.89353     0.00559705     0.340814        200    
reco:energyrecnue:EnergyReco                          0.000140951   0.00387897     0.0854047    0.000643468    0.0101128       200    
reco:energyrecnc:EnergyReco                           0.00204335    0.00673208     0.0931621    0.00371663     0.0109634       200    
reco:energyrecnumurange:EnergyReco                    0.000160721    0.0777664      2.87163     0.00359442     0.324815        200    
reco:energyrecnumumcs:EnergyReco                      0.00118025     0.0790412      2.85755     0.00410472     0.323015        200    
reco:opdec:Deconvolution                               0.144033      0.427696      0.754175      0.416787      0.134407        200    
reco:ophitspe:OpHitFinderDeco                           0.41566       2.28526       5.10244       2.15669      0.946413        200    
reco:opflash:OpFlashFinder                            0.000228511   0.00151972    0.00659166    0.00134107    0.000812733      200    
reco:rns:RandomNumberSaver                             1.717e-05    3.27506e-05   0.000441482   2.6605e-05    3.09367e-05      200    
reco:anglereconue:NuAngularReco                       0.000162871   0.00278011     0.0939975    0.000344687   0.00874492       200    
reco:anglereconumu:NuAngularReco                      6.9901e-05    0.00263709     0.0942814    0.000227136   0.00876705       200    
reco:anglereconuepfps:NuAngularReco                   0.000119421   0.00276947     0.0963074    0.000356117    0.0088633       200    
reco:anglereconumupfps:NuAngularReco                  0.00010191     0.0027201     0.0944889    0.000295386   0.00878698       200    
[art]:TriggerResults:TriggerResultInserter             8.33e-06     1.39399e-05   8.9591e-05    1.2975e-05    7.1871e-06       200    
end_path:out1:RootOutput                               2.92e-06     5.49412e-06    2.786e-05     4.195e-06    3.21685e-06      200    
end_path:out1:RootOutput(write)                        0.017531      0.335007       3.85741      0.280933      0.388214        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21733.3 MB
  Peak resident set size usage (VmHWM): 2590.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2_reco_2024-10-26T_030536Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50258586_117_20231122T051524Z_gen_g4_detsim_hitreco__20240503T053209Z_reco2_reco_data_2024-10-26T_030536Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 09:53:05 UTC       justIN version: 01.01.09