justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301489.176@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301489.176@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:05:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:17:04
From worker nodeHostnamedune001-2992525.0-lcg2474.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:07
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2.root
JobscriptExit code0
Real time47m (2854s)
CPU time45m (2729s = 95%)
Outputting started2024-11-23 00:11:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2.root
Finished2024-11-23 00:17:04
Saved logsjustin-logs:301489.176-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:11:28 UTC run: 6472706 subRun: 1 event: 21099
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:11:28 UTC run: 6472706 subRun: 1 event: 21099
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:11:28 UTC run: 6472706 subRun: 1 event: 21099
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 501, 368, 351
minwire 0: 1549
minwire 1: 474
minwire 2: 1627
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.803459, 0.120755, 0.0757868, 
Output 1: 0.111601, 0.381551, 0.324294, 0.182554, 
Output 2: 0.116132, 0.883868, 

611
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2272!
Begin processing the 100th record. run: 6472706 subRun: 1 event: 21100 at 23-Nov-2024 00:11:33 UTC
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:11:35 UTC run: 6472706 subRun: 1 event: 21100
Comparing two wires in the same plane: return failure
%MSG
331
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 875!
23-Nov-2024 00:11:39 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2_reco_data_2024-11-22T_232414Z.root"
23-Nov-2024 00:11:39 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/04/3a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.37286       26.7119       582.864       9.90029       68.4879        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00232306     0.0922918     0.356011      0.0705874     0.0621326       100    
reco:linecluster:LineCluster                           0.0432967     0.344477       3.88737      0.256011      0.474796        100    
reco:trajcluster:TrajCluster                           0.0013415     0.856834       36.8796      0.108145       4.37235        100    
reco:pandora:StandardPandora                           0.0494832      2.3221        35.3838       1.70296       3.68083        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000136607   0.00580849     0.128247     0.00141093     0.0164856       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000213843    0.0134259     0.369846     0.00275429     0.0393222       100    
reco:pandoracalo:Calorimetry                          0.000123883    0.0130162     0.436916     0.00095528     0.0537765       100    
reco:pandorapid:Chi2ParticleID                        4.2831e-05    0.000211354   0.00307447    0.00015927    0.000313689      100    
reco:trkshowersplit:TrackShowerHits                   8.4539e-05     0.0178947     0.573402     0.000716545    0.0794475       100    
reco:pmtrack:PMAlgTrackMaker                          0.00127553      2.02588       77.1342      0.104851       8.62499        100    
reco:pmtrackcalo:Calorimetry                          7.5161e-05     0.011509      0.654141     0.000749186    0.0662951       100    
reco:pmtrackpid:Chi2ParticleID                        2.8965e-05    0.000283057   0.00434853    0.000142408   0.000514094      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000204977     1.89476       46.4672      0.214778       6.48297        100    
reco:pmtrajfitcalo:Calorimetry                        5.7337e-05     0.0149331     0.633722     0.00124662     0.0692237       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.5549e-05    0.000209774   0.00118243    0.000171047   0.00017844       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00143346      2.43357       94.4937      0.145731       10.6737        100    
reco:pmtracktccalo:Calorimetry                        0.000103125   0.00896053     0.426686     0.000857094    0.0439589       100    
reco:pmtracktcpid:Chi2ParticleID                      4.3041e-05    0.000292544   0.00343252    0.000159385   0.000461902      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000226256     1.45345       43.6761       0.23227       5.06618        100    
reco:pmtrajfittccalo:Calorimetry                      9.1623e-05     0.0151287     0.713374     0.000872664    0.0759365       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4555e-05    0.000353792   0.00528364    0.000167706   0.000689434      100    
reco:blurredcluster:BlurredClustering                 0.000135515     1.21835       11.9143      0.402984       1.91873        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000153429     10.4992       220.273       2.55994       27.1955        100    
reco:emshower:EMShower                                0.000221497    0.0298364     0.499231     0.00301993     0.0713583       100    
reco:cvnmap:CVNMapper                                 2.4426e-05     0.0177451     0.0655378     0.0215046     0.0147593       100    
reco:cvneva:CVNEvaluator                              1.9807e-05     0.912794       2.11151       1.28527      0.638052        100    
reco:energyrecnumu:EnergyReco                         0.000383171    0.0250591      0.36502     0.00487117     0.0580594       100    
reco:energyrecnue:EnergyReco                          0.000178626   0.00209557     0.0496194    0.000591104    0.0057157       100    
reco:energyrecnc:EnergyReco                           0.00201133     0.0048398     0.055674     0.00333426    0.00617497       100    
reco:energyrecnumurange:EnergyReco                    0.00018585     0.0221706     0.367202     0.00316403     0.0570418       100    
reco:energyrecnumumcs:EnergyReco                      0.00200582     0.0236469      0.35762     0.00376328     0.0563934       100    
reco:opdec:Deconvolution                               0.0838866     0.361424       2.61669      0.319254      0.271256        100    
reco:ophitspe:OpHitFinderDeco                          0.033018       1.79694       3.82076       1.73668      0.852286        100    
reco:opflash:OpFlashFinder                            0.000136527   0.00175186    0.00570077    0.00162781    0.000863592      100    
reco:rns:RandomNumberSaver                            1.9737e-05    4.26072e-05   0.00044059    3.7445e-05    4.10612e-05      100    
reco:anglereconue:NuAngularReco                       0.000178626   0.00160436     0.0429939    0.000507285   0.00486101       100    
reco:anglereconumu:NuAngularReco                      8.3166e-05    0.00126992     0.040662     0.000197041   0.00466904       100    
reco:anglereconuepfps:NuAngularReco                   0.000146597   0.00146433     0.039357     0.00041162    0.00457131       100    
reco:anglereconumupfps:NuAngularReco                  0.000109125   0.00136401     0.040108     0.000283048   0.00465994       100    
[art]:TriggerResults:TriggerResultInserter             9.758e-06    1.75336e-05   0.000108835   1.55845e-05   1.04396e-05      100    
end_path:out1:RootOutput                               3.386e-06    5.85137e-06   3.2511e-05    5.6055e-06    3.54525e-06      100    
end_path:out1:RootOutput(write)                        0.0132222     0.262192       1.40305      0.281883       0.19886        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21735.1 MB
  Peak resident set size usage (VmHWM): 2306.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2_reco_2024-11-22T_232414Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6472706_210_20231208T080113Z_gen_g4_detsim_hitreco__20240510T052706Z_reco2_reco_data_2024-11-22T_232414Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:34:27 UTC       justIN version: 01.01.09