justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.10@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.10@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:26:40
From worker nodeHostnameb9p05p7101.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:07
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2.root
JobscriptExit code0
Real time54m (3277s)
CPU time44m (2668s = 81%)
Outputting started2024-11-23 00:18:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2.root
Finished2024-11-23 00:26:40
Saved logsjustin-logs:301492.10-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

23-Nov-2024 01:18:34 CET run: 74552530 subRun: 1 event: 13999
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:18:34 CET run: 74552530 subRun: 1 event: 13999
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:18:34 CET run: 74552530 subRun: 1 event: 13999
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:18:34 CET run: 74552530 subRun: 1 event: 13999
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 61, 64, 51
minwire 0: 1949
minwire 1: 423
minwire 2: 2154
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.99318, 0.0014355, 0.00538463, 
Output 1: 0.101839, 0.533297, 0.358969, 0.00589526, 
Output 2: 0.986118, 0.0138816, 

341
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1033!
Begin processing the 100th record. run: 74552530 subRun: 1 event: 14000 at 23-Nov-2024 01:18:39 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
106
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 250!
23-Nov-2024 01:18:43 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2_reco_data_2024-11-22T_233223Z.root"
23-Nov-2024 01:18:43 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/36/9d/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.20158       25.1595       532.911       12.4914       56.2069        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0165518     0.0907605      4.08266      0.0419213     0.405134        100    
reco:linecluster:LineCluster                           0.151048      0.513841       25.6145       0.18375       2.56591        100    
reco:trajcluster:TrajCluster                           0.0479177     0.636185        37.63       0.0740598      3.76833        100    
reco:pandora:StandardPandora                           0.0590006      2.2414        36.3018       1.31529       4.85696        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000141841   0.00452816     0.0551358    0.00193843    0.00753964       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000181911    0.0117266     0.105153     0.00426661     0.0196666       100    
reco:pandoracalo:Calorimetry                          0.000132981    0.0143813     0.705166     0.00160819     0.0713702       100    
reco:pandorapid:Chi2ParticleID                        5.0201e-05    0.000189694   0.00182156    0.000155791   0.000182343      100    
reco:trkshowersplit:TrackShowerHits                    9.842e-05     0.0183771     0.898696     0.00116645     0.0917465       100    
reco:pmtrack:PMAlgTrackMaker                          0.00125755      2.29936       104.525      0.406313       10.5527        100    
reco:pmtrackcalo:Calorimetry                          6.4891e-05     0.0058941      0.15254     0.00139167     0.0170056       100    
reco:pmtrackpid:Chi2ParticleID                         2.857e-05    0.000285312   0.00254093    0.000197917   0.000341074      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000224302     2.19481       85.8418      0.395397       8.78758        100    
reco:pmtrajfitcalo:Calorimetry                         7.468e-05     0.0153322     0.766138     0.00238908     0.0771323       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.4901e-05    0.000211085   0.000662904   0.000182921   0.000145535      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000932446     2.53204       88.3746      0.428936       9.44937        100    
reco:pmtracktccalo:Calorimetry                         6.688e-05    0.00446244     0.0496134    0.00157124     0.0084022       100    
reco:pmtracktcpid:Chi2ParticleID                       2.571e-05    0.000275273   0.00175929    0.000194006   0.000280667      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000160621     1.38583       29.3179      0.510005        3.294         100    
reco:pmtrajfittccalo:Calorimetry                       5.802e-05     0.0101544     0.371927     0.00180788     0.0387413       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.463e-05    0.000340879   0.00311264    0.000213611   0.00043044       100    
reco:blurredcluster:BlurredClustering                 0.00410449     0.948724       6.49391      0.488621       1.1929         100    
reco:emtrkmichelid:EmTrackMichelId                     0.0871047      8.55553       112.467       3.76594       14.6813        100    
reco:emshower:EMShower                                0.000283792    0.027106      0.369608     0.00290313     0.0558193       100    
reco:cvnmap:CVNMapper                                 2.6431e-05     0.0140041     0.0665016     0.0148117    0.00943075       100    
reco:cvneva:CVNEvaluator                               1.758e-05     0.853848       1.28339       1.01951      0.408995        100    
reco:energyrecnumu:EnergyReco                         0.000387142    0.0159212     0.237624     0.00519772     0.0302372       100    
reco:energyrecnue:EnergyReco                          0.000117951   0.00151182     0.0119466    0.00070886    0.00222061       100    
reco:energyrecnc:EnergyReco                           0.00171857    0.00408765     0.0184093    0.00345563    0.00268138       100    
reco:energyrecnumurange:EnergyReco                    0.000170361    0.0134346     0.219489     0.00305838     0.0286006       100    
reco:energyrecnumumcs:EnergyReco                      0.00127559     0.0147788     0.191975     0.00429933     0.0263224       100    
reco:opdec:Deconvolution                               0.063131      0.310592       1.00599      0.301089      0.130057        100    
reco:ophitspe:OpHitFinderDeco                          0.284627       2.13602       3.77953       2.18148      0.817748        100    
reco:opflash:OpFlashFinder                            0.000295782   0.00168881    0.00463203    0.00163431    0.00070185       100    
reco:rns:RandomNumberSaver                             2.598e-05    4.61714e-05   0.000353983   4.25605e-05   3.19225e-05      100    
reco:anglereconue:NuAngularReco                       0.000212841    0.0011873     0.0103573    0.000603279    0.0016772       100    
reco:anglereconumu:NuAngularReco                      9.6061e-05     0.0008419    0.00871201    0.000328432   0.00146128       100    
reco:anglereconuepfps:NuAngularReco                   0.000177852   0.00105684    0.00919438    0.000521243   0.00155207       100    
reco:anglereconumupfps:NuAngularReco                  0.000136801   0.000949623   0.00968869    0.000427072   0.00162694       100    
[art]:TriggerResults:TriggerResultInserter             8.61e-06     1.51654e-05    5.027e-05     1.461e-05    5.46786e-06      100    
end_path:out1:RootOutput                               3.86e-06     7.65363e-06    1.939e-05     7.54e-06     2.00416e-06      100    
end_path:out1:RootOutput(write)                        0.0173191     0.275504      0.826448      0.285915       0.14213        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21697.9 MB
  Peak resident set size usage (VmHWM): 2214.71 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2_reco_2024-11-22T_233223Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74552530_139_20231207T114337Z_gen_g4_detsim_hitreco__20240510T054320Z_reco2_reco_data_2024-11-22T_233223Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:08:17 UTC       justIN version: 01.01.09