justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301440.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301440.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:12:02
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:36:08
From worker nodeHostnametds436.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:36:37
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2.root
JobscriptExit code0
Real time57m (3455s)
CPU time56m (3386s = 98%)
Outputting started2024-11-22 23:34:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2.root
Finished2024-11-22 23:36:08
Saved logsjustin-logs:301440.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

: 1 event: 99500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
1st wire C:0 T:6 P:2 W:1041 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
1st wire C:0 T:7 P:2 W:961 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:33:53 CET run: 6390196 subRun: 1 event: 99500
1st wire C:0 T:9 P:2 W:619 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 303, 392, 316
minwire 0: 785
minwire 1: 2021
minwire 2: 561
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.32685, 0.659023, 0.014127, 
Output 1: 0.142674, 0.744524, 0.110226, 0.00257591, 
Output 2: 0.746451, 0.253549, 

658
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2501!
23-Nov-2024 00:34:12 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2_reco_data_2024-11-22T_223644Z.root"
23-Nov-2024 00:34:12 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/23/53/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.07315       33.1693       593.591       12.541        75.8705        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00182884     0.0166676     0.0416931     0.0190311    0.00892004       100    
reco:linecluster:LineCluster                          0.00191176     0.243779       8.60499      0.0257676      1.14753        100    
reco:trajcluster:TrajCluster                          0.000971097     1.05185       39.5682      0.0145992      5.19401        100    
reco:pandora:StandardPandora                           0.0101764      2.63261       27.9508       1.9387        3.20447        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000146343   0.00680609      0.10632     0.00180605     0.0151514       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000192543    0.012078      0.116267     0.00359486     0.0209264       100    
reco:pandoracalo:Calorimetry                          0.000114732    0.0182167     0.525615     0.00117711     0.0657301       100    
reco:pandorapid:Chi2ParticleID                         4.077e-05    0.000235668   0.00311632    0.000156098   0.000326122      100    
reco:trkshowersplit:TrackShowerHits                   7.9341e-05     0.0263551     0.822088     0.00087204      0.10822        100    
reco:pmtrack:PMAlgTrackMaker                          0.00142583      2.98469       92.4178      0.179244       11.1855        100    
reco:pmtrackcalo:Calorimetry                          8.6181e-05     0.0108329     0.297122     0.00107305     0.0394149       100    
reco:pmtrackpid:Chi2ParticleID                         3.845e-05    0.000371804   0.00313124    0.000198498   0.000567627      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000188243     2.47956       67.2144      0.329709       7.97308        100    
reco:pmtrajfitcalo:Calorimetry                        8.4191e-05     0.020759      0.530961      0.0017743     0.0723541       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.8471e-05    0.000263437   0.00116998    0.000192879   0.000230442      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00111951      3.91224       131.341      0.246419       15.2386        100    
reco:pmtracktccalo:Calorimetry                        7.0791e-05    0.00571436     0.117664     0.00109339     0.0146862       100    
reco:pmtracktcpid:Chi2ParticleID                       2.967e-05    0.000508555    0.0195304    0.000183198   0.00194765       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000163803     1.79225       32.1426      0.402785       4.43504        100    
reco:pmtrajfittccalo:Calorimetry                      6.4881e-05     0.0148821     0.462872     0.00151155     0.0552067       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.9121e-05    0.000448595   0.00411904    0.000236435   0.000650069      100    
reco:blurredcluster:BlurredClustering                 0.000109422     1.13643       6.04531      0.580692       1.37274        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000100881     13.1849       179.637       4.12617       26.7305        100    
reco:emshower:EMShower                                0.000183123    0.0280108     0.236314      0.0066609     0.0478332       100    
reco:cvnmap:CVNMapper                                 1.6971e-05     0.0141518     0.065741      0.0104851     0.0147425       100    
reco:cvneva:CVNEvaluator                              1.7051e-05     0.882871       2.5936        1.14817      0.695565        100    
reco:energyrecnumu:EnergyReco                         0.000392567    0.0465774     0.948696     0.00553264     0.134733        100    
reco:energyrecnue:EnergyReco                          0.000169203   0.00223455     0.0288712    0.000692062   0.00437457       100    
reco:energyrecnc:EnergyReco                           0.00215973    0.00550669     0.0358245    0.00404883    0.00499489       100    
reco:energyrecnumurange:EnergyReco                    0.000212164    0.042407      0.888848      0.0037339     0.127611        100    
reco:energyrecnumumcs:EnergyReco                      0.00218334     0.0446231     0.891372     0.00466462     0.126531        100    
reco:opdec:Deconvolution                               0.0246781     0.211079      0.467977      0.200486      0.0896678       100    
reco:ophitspe:OpHitFinderDeco                          0.205164       2.02728       3.99963       1.97597      0.895465        100    
reco:opflash:OpFlashFinder                            0.000352276   0.00179086    0.00451108    0.00168108    0.000831375      100    
reco:rns:RandomNumberSaver                             2.031e-05    4.63103e-05   0.000338517   3.8746e-05    3.62356e-05      100    
reco:anglereconue:NuAngularReco                       0.000186923   0.00150095     0.0227785    0.000462739   0.00340501       100    
reco:anglereconumu:NuAngularReco                      9.0292e-05     0.001281      0.0233179    0.00026281     0.0034016       100    
reco:anglereconuepfps:NuAngularReco                   0.000162923   0.00145544     0.0233245    0.000431593   0.00351624       100    
reco:anglereconumupfps:NuAngularReco                  0.000130872   0.00138935     0.0231428    0.000351341   0.00354469       100    
[art]:TriggerResults:TriggerResultInserter             1.005e-05    1.73837e-05   5.9801e-05     1.533e-05    7.35707e-06      100    
end_path:out1:RootOutput                               3.16e-06     8.48885e-06   0.000203604    5.365e-06    1.99064e-05      100    
end_path:out1:RootOutput(write)                        0.0296686     0.301828       1.2448       0.313059      0.224054        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21295.4 MB
  Peak resident set size usage (VmHWM): 2157.03 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2_reco_2024-11-22T_223644Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6390196_994_20231201T211134Z_gen_g4_detsim_hitreco__20240508T024440Z_reco2_reco_data_2024-11-22T_223644Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:59:49 UTC       justIN version: 01.01.09