justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301488.163@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301488.163@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:59:12
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:04:30
From worker nodeHostnamedune001-3353678.0-lcg2710.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:16:46
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2.root
JobscriptExit code0
Real time39m (2344s)
CPU time40m (2449s = 104%)
Outputting started2024-11-22 23:55:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2.root
Finished2024-11-23 00:04:30
Saved logsjustin-logs:301488.163-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

1 event: 4000
Flip, endpoint closer to vStart.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:28 UTC run: 6483936 subRun: 1 event: 4000
1st wire C:0 T:10 P:2 W:715 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:28 UTC run: 6483936 subRun: 1 event: 4000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:28 UTC run: 6483936 subRun: 1 event: 4000
1st wire C:0 T:10 P:2 W:752 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:28 UTC run: 6483936 subRun: 1 event: 4000
1st wire C:0 T:10 P:2 W:542 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:29 UTC run: 6483936 subRun: 1 event: 4000
1st wire C:0 T:18 P:2 W:743 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:55:29 UTC run: 6483936 subRun: 1 event: 4000
1st wire C:0 T:18 P:2 W:879 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 783, 761, 886
minwire 0: 1481
minwire 1: 981
minwire 2: 1232
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0127186, 0.00163635, 0.985645, 
Output 1: 0.312102, 0.631892, 0.0498293, 0.00617672, 
Output 2: 0.685979, 0.314021, 

696
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2663!
22-Nov-2024 23:55:50 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2_reco_data_2024-11-22T_231651Z.root"
22-Nov-2024 23:55:50 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/a2/9a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.05626       22.1677       317.102       8.43552       49.0232        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00115884     0.0997519     0.712441      0.0738727     0.0895369       100    
reco:linecluster:LineCluster                           0.0417383     0.674411       23.0053      0.180483       2.9445         100    
reco:trajcluster:TrajCluster                          0.00510006      0.80386       29.8595      0.0591321      3.64088        100    
reco:pandora:StandardPandora                           0.961403       1.96524       21.6861       1.23756       2.98777        100    
reco:pandoraTrack:LArPandoraTrackCreation              0.0001192    0.00540824     0.0539638    0.00169189     0.0100554       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000141033   0.00908335     0.0835503    0.00263125     0.014629        100    
reco:pandoracalo:Calorimetry                          8.3225e-05     0.0152604     0.384364     0.00101426     0.055037        100    
reco:pandorapid:Chi2ParticleID                        3.2589e-05    0.00015017    0.000754459   0.000119731   0.000111384      100    
reco:trkshowersplit:TrackShowerHits                   9.3251e-05     0.0231614      0.6095      0.000760783    0.0924903       100    
reco:pmtrack:PMAlgTrackMaker                          0.000863753     2.16575       55.6602       0.16986       7.21295        100    
reco:pmtrackcalo:Calorimetry                          4.7672e-05    0.00811848     0.150495     0.000925878    0.0245978       100    
reco:pmtrackpid:Chi2ParticleID                        1.9149e-05    0.000266167   0.00228033    0.000142635   0.000395626      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000140172     1.59378       35.309       0.249684       5.07053        100    
reco:pmtrajfitcalo:Calorimetry                        4.0311e-05     0.0162194      0.46896     0.00145931     0.0611317       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.7257e-05    0.000178386   0.000681819   0.000150523   0.000126828      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000683982     2.45982       62.6305      0.244944       8.26664        100    
reco:pmtracktccalo:Calorimetry                        4.2894e-05    0.00481945     0.0610834    0.00105381     0.0108209       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8188e-05    0.000221668   0.00124384    0.000158244   0.000250909      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000117618     1.33723       20.2351      0.283046       3.50126        100    
reco:pmtrajfittccalo:Calorimetry                      3.9269e-05     0.012169       0.24305     0.00123576     0.0412124       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7286e-05    0.000302599   0.00299982    0.000167979   0.000485227      100    
reco:blurredcluster:BlurredClustering                 0.00318989     0.777207       5.37544      0.395693        1.034         100    
reco:emtrkmichelid:EmTrackMichelId                     0.239975       7.50938       86.3971       2.64343       15.1758        100    
reco:emshower:EMShower                                0.000303488    0.0205111     0.223979     0.00386837     0.0374401       100    
reco:cvnmap:CVNMapper                                 2.5008e-05    0.00709523     0.0408893    0.00418259    0.00823143       100    
reco:cvneva:CVNEvaluator                              1.6635e-05     0.492485       1.02053      0.581376       0.34061        100    
reco:energyrecnumu:EnergyReco                         0.000295145    0.028716      0.679756     0.00637961     0.0828046       100    
reco:energyrecnue:EnergyReco                          9.8008e-05    0.00179125     0.0248328    0.000390203   0.00404635       100    
reco:energyrecnc:EnergyReco                           0.00131511    0.00357504     0.0287372    0.00236881    0.00437184       100    
reco:energyrecnumurange:EnergyReco                    0.000156255    0.0241363      0.63093     0.00235616     0.0775204       100    
reco:energyrecnumumcs:EnergyReco                      0.000612384    0.025123      0.616824     0.00267457     0.0762041       100    
reco:opdec:Deconvolution                               0.0541827     0.315694       1.74675      0.259447      0.249227        100    
reco:ophitspe:OpHitFinderDeco                          0.319832       1.55511       3.16301       1.37914      0.724358        100    
reco:opflash:OpFlashFinder                            0.000377529   0.00134718    0.00424448    0.00119966    0.000665189      100    
reco:rns:RandomNumberSaver                            1.8068e-05    3.12725e-05   0.000324981   2.61245e-05   3.07318e-05      100    
reco:anglereconue:NuAngularReco                       0.000135985   0.00139026      0.01876     0.000362062   0.00292302       100    
reco:anglereconumu:NuAngularReco                      4.8122e-05    0.00115426     0.0187447    0.000183927    0.0028622       100    
reco:anglereconuepfps:NuAngularReco                   0.000109325   0.00128807     0.0188086    0.000301866   0.00287581       100    
reco:anglereconumupfps:NuAngularReco                  6.9525e-05    0.00120612     0.0189143    0.000239271   0.00287835       100    
[art]:TriggerResults:TriggerResultInserter             7.461e-06    1.26233e-05   5.8168e-05    1.1267e-05    5.5635e-06       100    
end_path:out1:RootOutput                               2.764e-06    3.83396e-06   2.2033e-05    3.3955e-06    2.04787e-06      100    
end_path:out1:RootOutput(write)                        0.0245212     0.203359      0.801445      0.200868       0.1505         100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40256.5 MB
  Peak resident set size usage (VmHWM): 2479.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2_reco_2024-11-22T_231651Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_39_20231207T081508Z_gen_g4_detsim_hitreco__20240510T035705Z_reco2_reco_data_2024-11-22T_231651Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:49:38 UTC       justIN version: 01.01.09