justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108550.166@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108550.166@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:15:23
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:16:04
From worker nodeHostnamedune001-2993327.0-lcg2699.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2.root
JobscriptExit code0
Real time37m (2226s)
CPU time38m (2318s = 104%)
Outputting started2024-11-23 00:10:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2.root
Finished2024-11-23 00:16:04
Saved logsjustin-logs:108550.166-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:10:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:31 UTC run: 50602933 subRun: 1 event: 76500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 38, 40, 36
minwire 0: 1788
minwire 1: 1046
minwire 2: 1743
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 11, 210
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0931881, 0.831108, 0.0757037, 
Output 1: 0.828864, 0.167806, 0.00287593, 0.000454202, 
Output 2: 0.989944, 0.0100558, 

317
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 700!
23-Nov-2024 00:10:35 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2_reco_data_2024-11-22T_233334Z.root"
23-Nov-2024 00:10:36 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/e5/67/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.445047       20.8491       211.01        8.58558       32.8152        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0301002     0.0970176     0.314911      0.080517      0.0610147       100    
reco:linecluster:LineCluster                           0.033203      0.449181       7.15529       0.31702      0.761774        100    
reco:trajcluster:TrajCluster                          0.00567847     0.529352       12.2063      0.145698       1.52294        100    
reco:pandora:StandardPandora                           0.0755722      1.80771       27.5484       1.23935       2.81572        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000113401    0.0054995     0.0427078    0.00130692    0.00878388       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000147582    0.0142112     0.290801     0.00257019     0.0375327       100    
reco:pandoracalo:Calorimetry                          8.5709e-05     0.0145639     0.345273     0.000853795    0.0437538       100    
reco:pandorapid:Chi2ParticleID                        3.4092e-05    0.000168786   0.00266272    0.000108478   0.000268354      100    
reco:trkshowersplit:TrackShowerHits                   0.000109054    0.0167084     0.436045     0.000626687    0.0535371       100    
reco:pmtrack:PMAlgTrackMaker                          0.00103949      1.86395       26.6136      0.149507       4.30059        100    
reco:pmtrackcalo:Calorimetry                          4.8603e-05    0.00741872     0.158736     0.000869794    0.0202479       100    
reco:pmtrackpid:Chi2ParticleID                        1.8829e-05    0.000246712   0.00162469    0.000134998   0.000305393      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00016592      1.64314       41.1215      0.209477       4.63762        100    
reco:pmtrajfitcalo:Calorimetry                        4.2143e-05     0.0145392     0.354397     0.00116211     0.0439609       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.7917e-05    0.000174837   0.000643688   0.000144978   0.000124819      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000823128     1.97704       29.7625      0.189268       4.95924        100    
reco:pmtracktccalo:Calorimetry                        4.4798e-05    0.00518855      0.09119     0.000815266    0.0121236       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8217e-05    0.000222363   0.00155116    0.000139831   0.000239972      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00013945      1.07985       12.8659      0.209281       2.14537        100    
reco:pmtrajfittccalo:Calorimetry                      4.0351e-05     0.0088124     0.113661     0.000998463    0.0209747       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6274e-05    0.000288391   0.00179057    0.000157511   0.000356419      100    
reco:blurredcluster:BlurredClustering                 0.000145819    0.863079       4.4694        0.51145      0.941716        100    
reco:emtrkmichelid:EmTrackMichelId                     0.0267384      7.82831       57.3292       2.3773        12.212         100    
reco:emshower:EMShower                                0.000243947    0.0186455     0.123173     0.00693519     0.0260831       100    
reco:cvnmap:CVNMapper                                  1.967e-05    0.00536054     0.0402412    0.00411316    0.00700221       100    
reco:cvneva:CVNEvaluator                              1.5433e-05     0.470444      0.985197      0.550332      0.318853        100    
reco:energyrecnumu:EnergyReco                         0.000266261    0.0259638     0.838639     0.00694113     0.087311        100    
reco:energyrecnue:EnergyReco                           9.326e-05    0.00153957     0.0161491    0.000411589   0.00267509       100    
reco:energyrecnc:EnergyReco                           0.00127749    0.00316155     0.0183485    0.00236174    0.00276807       100    
reco:energyrecnumurange:EnergyReco                    0.000123967    0.022087      0.839732     0.00238645     0.0873026       100    
reco:energyrecnumumcs:EnergyReco                      0.00122144     0.0212084     0.660357     0.00317079     0.0704218       100    
reco:opdec:Deconvolution                               0.0588616     0.364252       1.26572      0.341147       0.20323        100    
reco:ophitspe:OpHitFinderDeco                          0.115703       1.48337       3.67716       1.43006      0.692884        100    
reco:opflash:OpFlashFinder                            0.000260252    0.0013287    0.00629389    0.00120762    0.000758618      100    
reco:rns:RandomNumberSaver                            1.8739e-05    3.33754e-05   0.000446411   2.70005e-05   4.23862e-05      100    
reco:anglereconue:NuAngularReco                       0.000146501   0.00136703     0.0114352    0.000398059   0.00226339       100    
reco:anglereconumu:NuAngularReco                      5.2309e-05    0.00109772     0.0109805    0.000203606   0.00212376       100    
reco:anglereconuepfps:NuAngularReco                   0.000105769   0.00124185     0.0107562    0.000337603   0.00214548       100    
reco:anglereconumupfps:NuAngularReco                  7.2709e-05    0.00115006     0.0106379    0.00024887    0.00212786       100    
[art]:TriggerResults:TriggerResultInserter             8.172e-06    1.26996e-05   6.4036e-05    1.15375e-05   6.28668e-06      100    
end_path:out1:RootOutput                               3.044e-06    5.2014e-06     2.687e-05     4.277e-06    3.44972e-06      100    
end_path:out1:RootOutput(write)                        0.0154731     0.198217      0.699553       0.19118      0.136986        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40161.7 MB
  Peak resident set size usage (VmHWM): 2404.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2_reco_2024-11-22T_233334Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50602933_764_20231205T111119Z_gen_g4_detsim_hitreco__20240510T042237Z_reco2_reco_data_2024-11-22T_233334Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:59:47 UTC       justIN version: 01.01.09