justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108544.150@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108544.150@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:01:33
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-23 00:10:56
From worker nodeHostnamen255.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:18:09
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2.root
JobscriptExit code0
Real time45m (2711s)
CPU time37m (2252s = 83%)
Outputting started2024-11-23 00:03:21
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2.root
Finished2024-11-23 00:10:56
Saved logsjustin-logs:108544.150-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:02:51 GMT run: 50542214 subRun: 1 event: 64799
1st wire C:0 T:15 P:2 W:803 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 607, 778, 823
minwire 0: 994
minwire 1: 1264
minwire 2: 1018
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00195954, 0.000191682, 0.997849, 
Output 1: 0.00303172, 0.934812, 0.0591056, 0.00305045, 
Output 2: 0.988158, 0.0118424, 

655
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2637!
Begin processing the 100th record. run: 50542214 subRun: 1 event: 64800 at 23-Nov-2024 00:03:15 GMT
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:03:17 GMT run: 50542214 subRun: 1 event: 64800
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:03:17 GMT run: 50542214 subRun: 1 event: 64800
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
110
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 144!
23-Nov-2024 00:03:19 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2_reco_data_2024-11-22T_231814Z.root"
23-Nov-2024 00:03:19 GMT  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/65/dc/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.44256       22.8421       278.776       11.9304       35.3595        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0184537     0.111859      0.354586      0.0957278     0.0606562       100    
reco:linecluster:LineCluster                            0.19921      0.453099       2.00655      0.384304      0.243099        100    
reco:trajcluster:TrajCluster                           0.0564954     0.382346       7.75414       0.14605       1.02449        100    
reco:pandora:StandardPandora                            1.0931        2.26608       42.9996       1.67597       4.17839        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00017409     0.0046784     0.0642123    0.00187775    0.00836815       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000241818    0.0150303     0.176132     0.00375584     0.0271555       100    
reco:pandoracalo:Calorimetry                          0.00014272    0.00891533     0.166931     0.00138971     0.0246214       100    
reco:pandorapid:Chi2ParticleID                        5.0666e-05    0.000214513   0.00194766    0.00014807    0.000228619      100    
reco:trkshowersplit:TrackShowerHits                   0.000123714    0.0120498     0.288458     0.000845934    0.0432374       100    
reco:pmtrack:PMAlgTrackMaker                          0.00152498      1.31313       28.6101      0.206759       3.57276        100    
reco:pmtrackcalo:Calorimetry                          9.3998e-05    0.00584984     0.216358     0.00105544     0.0222764       100    
reco:pmtrackpid:Chi2ParticleID                         3.735e-05    0.000275656   0.00279424    0.000179235   0.000353904      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000250405     1.23539       16.9282       0.31817       2.65248        100    
reco:pmtrajfitcalo:Calorimetry                         8.391e-05    0.00948335      0.16776     0.00199564     0.0250082       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.4566e-05    0.000227167   0.000837127   0.000190145   0.000160757      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00145503      1.42202       27.6185      0.218662       3.72679        100    
reco:pmtracktccalo:Calorimetry                        9.4479e-05    0.00519575     0.126757     0.00105535     0.0143307       100    
reco:pmtracktcpid:Chi2ParticleID                      3.8873e-05    0.000273063   0.00210032    0.000171625   0.000302327      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000250045     1.0554        15.5918      0.279344       2.16016        100    
reco:pmtrajfittccalo:Calorimetry                      9.0341e-05    0.00749457     0.170347     0.00137099     0.0217934       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4646e-05    0.000337061    0.0026592    0.000196738   0.00043582       100    
reco:blurredcluster:BlurredClustering                  0.0098598      1.12208       7.37636      0.735444       1.35188        100    
reco:emtrkmichelid:EmTrackMichelId                     0.363139       9.36976       115.086       3.34943       16.4226        100    
reco:emshower:EMShower                                0.000397694    0.026805      0.421568     0.00333617     0.0558597       100    
reco:cvnmap:CVNMapper                                 3.6109e-05     0.0107697     0.0541583    0.00943619    0.00995398       100    
reco:cvneva:CVNEvaluator                              2.4868e-05     0.706138       1.4909       0.966871      0.442162        100    
reco:energyrecnumu:EnergyReco                         0.000381483    0.0440566      2.02451     0.00533934     0.214388        100    
reco:energyrecnue:EnergyReco                          0.00019514    0.00156199     0.0199493    0.000577951   0.00266136       100    
reco:energyrecnc:EnergyReco                           0.00220839     0.0045069     0.0246382    0.00371326    0.00289474       100    
reco:energyrecnumurange:EnergyReco                    0.000199258    0.041571       2.01546     0.00341657     0.213557        100    
reco:energyrecnumumcs:EnergyReco                      0.000979948    0.0433222      2.00899     0.00412969     0.212728        100    
reco:opdec:Deconvolution                               0.160632      0.445022      0.888548      0.437827      0.149465        100    
reco:ophitspe:OpHitFinderDeco                          0.595519       2.44153       4.26246       2.39033      0.922274        100    
reco:opflash:OpFlashFinder                            0.00045913    0.00165296    0.00529711    0.00158178    0.000708017      100    
reco:rns:RandomNumberSaver                            1.9677e-05    4.76843e-05   0.000418083   3.94495e-05   4.21809e-05      100    
reco:anglereconue:NuAngularReco                       0.00020615    0.00114404     0.0153924    0.000462272   0.00209396       100    
reco:anglereconumu:NuAngularReco                      9.1403e-05    0.000913449    0.0152274    0.000244088   0.00206157       100    
reco:anglereconuepfps:NuAngularReco                   0.000156105   0.00111395     0.0155959    0.000396922   0.00216001       100    
reco:anglereconumupfps:NuAngularReco                  0.000137571   0.00101717     0.0158779    0.000330832   0.00220257       100    
[art]:TriggerResults:TriggerResultInserter             1.055e-05    1.82782e-05   6.9933e-05    1.6241e-05    7.63571e-06      100    
end_path:out1:RootOutput                               3.276e-06    7.56532e-06   2.5929e-05    6.2325e-06    3.90001e-06      100    
end_path:out1:RootOutput(write)                        0.0327066     0.267267      0.934245      0.282228      0.155735        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38211.8 MB
  Peak resident set size usage (VmHWM): 2156.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2_reco_2024-11-22T_231814Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50542214_647_20231201T223423Z_gen_g4_detsim_hitreco__20240507T204026Z_reco2_reco_data_2024-11-22T_231814Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:23:59 UTC       justIN version: 01.01.09