justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.173@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.173@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:18:49
From worker nodeHostnamedune001-3355061.0-lcg2688.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:08
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2.root
JobscriptExit code0
Real time47m (2838s)
CPU time1h (3652s = 128%)
Outputting started2024-11-23 00:11:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2.root
Finished2024-11-23 00:18:49
Saved logsjustin-logs:301491.173-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

bRun: 1 event: 32499
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:11:18 UTC run: 6400858 subRun: 1 event: 32499
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:11:19 UTC run: 6400858 subRun: 1 event: 32499
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 39, 40, 32
minwire 0: 981
minwire 1: 1380
minwire 2: 1076
Used alternate method to get min and max wires due to vertex determination failure: 40, 239
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 66, 265
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.70337, 0.0807702, 0.21586, 
Output 1: 0.945433, 0.0512034, 0.00296384, 0.000400199, 
Output 2: 0.973943, 0.0260565, 

324
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 868!
Begin processing the 100th record. run: 6400858 subRun: 1 event: 32500 at 23-Nov-2024 00:11:21 UTC
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
43
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 43!
23-Nov-2024 00:11:25 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2_reco_data_2024-11-22T_232413Z.root"
23-Nov-2024 00:11:25 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ed/ae/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.696751       26.8819       437.564       13.0683       51.3252        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00172958     0.103801       1.23137      0.0721444     0.128817        100    
reco:linecluster:LineCluster                           0.0449624     0.359983       6.5946       0.204982       0.70214        100    
reco:trajcluster:TrajCluster                           0.0012215     0.524675       15.7127      0.0906058      1.7965         100    
reco:pandora:StandardPandora                           0.0335726      2.08802       32.542        1.46946       3.23089        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000140334    0.0054909     0.0675246    0.00186892    0.00985515       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000222939    0.0137194      0.27746     0.00407956     0.0329871       100    
reco:pandoracalo:Calorimetry                          0.000101091    0.0151505     0.345942     0.00152603     0.046698        100    
reco:pandorapid:Chi2ParticleID                        3.7741e-05    0.000201364   0.00248604    0.000136762   0.000259406      100    
reco:trkshowersplit:TrackShowerHits                   8.0983e-05     0.0178015     0.439168     0.00101274     0.0569834       100    
reco:pmtrack:PMAlgTrackMaker                          0.00139851      2.48077       58.6839       0.26073       7.58166        100    
reco:pmtrackcalo:Calorimetry                          7.3859e-05    0.00841375      0.25559     0.000991079    0.0288232       100    
reco:pmtrackpid:Chi2ParticleID                        2.7592e-05    0.000318583   0.00324472    0.00017215    0.000470817      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00021792      1.90633       21.8229      0.408015       3.86067        100    
reco:pmtrajfitcalo:Calorimetry                        8.3387e-05     0.0151092     0.344734      0.0021149     0.045928        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.4545e-05    0.000220272   0.000790077   0.000171117   0.000154886      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00127633      2.60937       83.6329      0.333862       9.12056        100    
reco:pmtracktccalo:Calorimetry                        8.9488e-05    0.00518662     0.114235     0.00106978     0.0137029       100    
reco:pmtracktcpid:Chi2ParticleID                      3.6569e-05    0.000261541    0.0017251    0.000177313   0.000265989      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000207471     1.56499       47.6997       0.37009       4.96395        100    
reco:pmtrajfittccalo:Calorimetry                      8.2586e-05     0.0110608     0.332328     0.00148889     0.0369762       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.3523e-05    0.000444553   0.00854736    0.000199775   0.000944756      100    
reco:blurredcluster:BlurredClustering                 0.000204875     1.16904       7.50442      0.608265       1.45999        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000157797     9.91054       148.295       3.56148       19.077         100    
reco:emshower:EMShower                                0.000210877    0.0281355     0.199296     0.00617475     0.0421923       100    
reco:cvnmap:CVNMapper                                 3.0657e-05    0.00999166     0.0437071    0.00649662    0.00963048       100    
reco:cvneva:CVNEvaluator                              1.8295e-05     0.919941       1.85935       1.24761       0.57398        100    
reco:energyrecnumu:EnergyReco                         0.000354587    0.0502287      1.16942     0.00553018     0.167387        100    
reco:energyrecnue:EnergyReco                          0.000156685   0.00181473     0.0285846    0.000689553   0.00351468       100    
reco:energyrecnc:EnergyReco                           0.00171684    0.00466477     0.0337964    0.00364174     0.0038003       100    
reco:energyrecnumurange:EnergyReco                    0.000173757    0.0479717      1.15616     0.00341127     0.163868        100    
reco:energyrecnumumcs:EnergyReco                       0.0018557     0.0510346      1.15901      0.0048349     0.166683        100    
reco:opdec:Deconvolution                               0.0407652     0.316967       0.68082      0.299268      0.140885        100    
reco:ophitspe:OpHitFinderDeco                          0.133576       2.35311       4.57035       2.39835      0.948737        100    
reco:opflash:OpFlashFinder                            0.000232868   0.00162152    0.00502453    0.00162505    0.000728591      100    
reco:rns:RandomNumberSaver                            1.8264e-05    3.20038e-05   0.000348185   2.82285e-05   3.23101e-05      100    
reco:anglereconue:NuAngularReco                       0.000147769   0.00139956     0.0232657    0.000459343   0.00284423       100    
reco:anglereconumu:NuAngularReco                       6.899e-05    0.00119754     0.0221085    0.000298006   0.00275401       100    
reco:anglereconuepfps:NuAngularReco                   0.000114415   0.00134731     0.021814     0.000422104   0.00274887       100    
reco:anglereconumupfps:NuAngularReco                  0.000102914   0.00127952     0.0219279    0.000391096   0.00275167       100    
[art]:TriggerResults:TriggerResultInserter             8.837e-06    1.50287e-05   4.9844e-05    1.4147e-05    4.77627e-06      100    
end_path:out1:RootOutput                               3.035e-06    5.37035e-06   2.4035e-05    5.0645e-06    2.26214e-06      100    
end_path:out1:RootOutput(write)                        0.0228868     0.277944       1.22504      0.300457      0.176209        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39326.5 MB
  Peak resident set size usage (VmHWM): 2179.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2_reco_2024-11-22T_232413Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6400858_324_20231202T080228Z_gen_g4_detsim_hitreco__20240507T210151Z_reco2_reco_data_2024-11-22T_232413Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:41:23 UTC       justIN version: 01.01.09