justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301492.146@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301492.146@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:11:25
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:18:29
From worker nodeHostnamedune001-3354176.0-lcg2721.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:28:28
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2.root
JobscriptExit code0
Real time37m (2257s)
CPU time36m (2197s = 97%)
Outputting started2024-11-23 00:06:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2.root
Finished2024-11-23 00:18:26
Saved logsjustin-logs:301492.146-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.134222, 0.0991041, 0.766674, 
Output 1: 0.224975, 0.699439, 0.0713941, 0.00419232, 
Output 2: 0.225124, 0.774876, 

333
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 841!
Begin processing the 100th record. run: 6453326 subRun: 1 event: 2000 at 23-Nov-2024 00:06:01 UTC
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:06:03 UTC run: 6453326 subRun: 1 event: 2000
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:06:03 UTC run: 6453326 subRun: 1 event: 2000
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:06:03 UTC run: 6453326 subRun: 1 event: 2000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:03 UTC run: 6453326 subRun: 1 event: 2000
Comparing two wires in the same plane: return failure
%MSG
186
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 375!
23-Nov-2024 00:06:04 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2_reco_data_2024-11-22T_232913Z.root"
23-Nov-2024 00:06:04 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/38/12/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.712354       20.8025       294.642       10.1512       35.7583        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00140139     0.114811      0.368502      0.0941503     0.079811        100    
reco:linecluster:LineCluster                           0.0515087     0.316042       1.37289      0.286046      0.203234        100    
reco:trajcluster:TrajCluster                          0.000867908    0.356249       8.98268      0.139743       1.04762        100    
reco:pandora:StandardPandora                           0.129333       1.85941       30.2285       1.3931        3.00219        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00013252    0.00612342     0.124271     0.00213058     0.0158338       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000208535    0.0118804     0.165219      0.0035523     0.0267258       100    
reco:pandoracalo:Calorimetry                          8.7672e-05    0.00953975     0.218576     0.00150332     0.0263236       100    
reco:pandorapid:Chi2ParticleID                        3.2249e-05    0.00018059    0.00196228     0.0001393    0.000212238      100    
reco:trkshowersplit:TrackShowerHits                   6.8653e-05     0.0140521     0.434635     0.000903127    0.0494714       100    
reco:pmtrack:PMAlgTrackMaker                          0.00116816      1.5786        35.7499      0.273136       4.28942        100    
reco:pmtrackcalo:Calorimetry                          6.4827e-05    0.00903359     0.447422     0.00124237     0.0463196       100    
reco:pmtrackpid:Chi2ParticleID                        2.2113e-05    0.000275163   0.00304657    0.000172815   0.000365518      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000222045     1.53444       26.7093      0.389602       3.28137        100    
reco:pmtrajfitcalo:Calorimetry                        6.5459e-05      0.01089      0.241975     0.00195069     0.031939        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.9774e-05    0.00021231    0.00121945    0.00018596    0.000174654      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000977123     1.80913       52.713       0.292414       5.81635        100    
reco:pmtracktccalo:Calorimetry                        5.8308e-05    0.00557374     0.162208     0.00123117     0.0198509       100    
reco:pmtracktcpid:Chi2ParticleID                      2.1893e-05    0.000254579   0.00168042    0.000187263   0.000256298      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000180051     1.20598       17.2281      0.312183       2.32038        100    
reco:pmtrajfittccalo:Calorimetry                       6.628e-05    0.00945859     0.238002     0.00141637     0.031219        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.7401e-05    0.000342957   0.00213657    0.00019578    0.000384342      100    
reco:blurredcluster:BlurredClustering                 0.000217709    0.884663       6.39166      0.520301       1.1761         100    
reco:emtrkmichelid:EmTrackMichelId                    0.00011289      8.07202       102.836       3.07564       14.6778        100    
reco:emshower:EMShower                                0.000183857    0.0322604     0.308979     0.00905827     0.0515635       100    
reco:cvnmap:CVNMapper                                 2.0611e-05    0.00900971     0.0489913    0.00495798    0.00994073       100    
reco:cvneva:CVNEvaluator                              1.7386e-05     0.584191      0.996609      0.738532      0.361835        100    
reco:energyrecnumu:EnergyReco                         0.000327944    0.0374451       1.628      0.00703083     0.171875        100    
reco:energyrecnue:EnergyReco                          0.000107352   0.00204346     0.0514073    0.000648067   0.00646637       100    
reco:energyrecnc:EnergyReco                           0.00145572    0.00412802     0.0558584    0.00281601    0.00689657       100    
reco:energyrecnumurange:EnergyReco                    0.000137888    0.0338938      1.65616     0.00258499     0.174857        100    
reco:energyrecnumumcs:EnergyReco                      0.000869301    0.0348697      1.60653     0.00352384      0.1704         100    
reco:opdec:Deconvolution                               0.0578501     0.331714      0.884829      0.304638      0.140769        100    
reco:ophitspe:OpHitFinderDeco                          0.116126       1.68853       3.22511       1.76065      0.685384        100    
reco:opflash:OpFlashFinder                            0.000114853   0.00142094     0.0063679    0.00142803    0.000765682      100    
reco:rns:RandomNumberSaver                            1.8719e-05    3.35222e-05   0.000270417   2.7006e-05    2.59855e-05      100    
reco:anglereconue:NuAngularReco                       0.00016562     0.0017279     0.0482107    0.000430343    0.0058817       100    
reco:anglereconumu:NuAngularReco                      6.8684e-05    0.00147465     0.0466943    0.000237623   0.00572756       100    
reco:anglereconuepfps:NuAngularReco                   0.000124187   0.00161849     0.0475394    0.000359738   0.00581142       100    
reco:anglereconumupfps:NuAngularReco                  9.5574e-05    0.00150175     0.043953     0.000272181   0.00552484       100    
[art]:TriggerResults:TriggerResultInserter             8.734e-06    1.33921e-05   6.0992e-05    1.2018e-05    6.29861e-06      100    
end_path:out1:RootOutput                               2.744e-06    4.76264e-06   1.3521e-05     3.826e-06    1.91606e-06      100    
end_path:out1:RootOutput(write)                        0.0143247     0.225537       1.02712      0.232081      0.150975        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40291.8 MB
  Peak resident set size usage (VmHWM): 2484.46 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2_reco_2024-11-22T_232913Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6453326_19_20231206T021400Z_gen_g4_detsim_hitreco__20240510T024741Z_reco2_reco_data_2024-11-22T_232913Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:50:27 UTC       justIN version: 01.01.09