justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301489.119@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301489.119@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:05:17
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:07:36
From worker nodeHostnamedune001-2994638.0-lcg2720.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:22:29
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2.root
JobscriptExit code0
Real time36m (2180s)
CPU time38m (2330s = 106%)
Outputting started2024-11-22 23:58:50
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2.root
Finished2024-11-23 00:07:36
Saved logsjustin-logs:301489.119-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

8:30 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:30 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:30 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:30 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:58:30 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:46 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:58:46 UTC run: 74506302 subRun: 1 event: 99600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1211, 1508, 616
minwire 0: 1205
minwire 1: 2011
minwire 2: 847
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0039447, 0.995571, 0.000483899, 
Output 1: 0.0357462, 0.902527, 0.0602737, 0.00145329, 
Output 2: 0.955892, 0.0441078, 

817
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3271!
22-Nov-2024 23:58:49 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2_reco_data_2024-11-22T_232233Z.root"
22-Nov-2024 23:58:49 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/fb/71/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.710308       20.5368       255.71        8.47837       36.2377        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00146026     0.103613       0.54207      0.0790732     0.0774874       100    
reco:linecluster:LineCluster                           0.0315008     0.380277       6.96608      0.217222       0.75869        100    
reco:trajcluster:TrajCluster                          0.00299013     0.533086       15.5764      0.101448       1.80242        100    
reco:pandora:StandardPandora                            0.10253       2.14418       40.1696       1.30999       4.32891        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000110847   0.00554943     0.0657758    0.00135183     0.0107481       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000158488   0.00838376     0.109748     0.00226145     0.0165184       100    
reco:pandoracalo:Calorimetry                          8.2975e-05     0.0148332     0.485675     0.000724287    0.0547399       100    
reco:pandorapid:Chi2ParticleID                        3.3801e-05    0.000155445   0.00102033    0.000120177   0.000139798      100    
reco:trkshowersplit:TrackShowerHits                   8.2424e-05     0.0210518     0.598716     0.000628252    0.0739415       100    
reco:pmtrack:PMAlgTrackMaker                          0.000857833     1.67817       23.3756       0.16001       4.07568        100    
reco:pmtrackcalo:Calorimetry                          4.9244e-05    0.00677823     0.117644     0.000845084    0.0179828       100    
reco:pmtrackpid:Chi2ParticleID                        2.0451e-05    0.000250254   0.00148927    0.000144638   0.000299284      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000140171     1.55543       46.9546      0.287555       4.96113        100    
reco:pmtrajfitcalo:Calorimetry                        3.6806e-05     0.0128428     0.365124     0.00112136     0.0440409       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.7066e-05    0.000169822   0.000713866   0.000136556   0.000122324      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000658743     1.98343       31.676        0.19952       5.14075        100    
reco:pmtracktccalo:Calorimetry                        4.3696e-05    0.00435479     0.0669137    0.000850682    0.0101831       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8648e-05    0.000218609   0.00134614    0.000134277   0.000241177      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000120973     1.11317       13.2772      0.213008       2.47614        100    
reco:pmtrajfittccalo:Calorimetry                      3.7807e-05    0.00924339     0.143287     0.000965981    0.0260589       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6865e-05    0.000298532   0.00188744    0.000154438   0.000380074      100    
reco:blurredcluster:BlurredClustering                 0.000260102    0.934104       5.11597      0.632804       1.10922        100    
reco:emtrkmichelid:EmTrackMichelId                    0.00011959      7.4366        67.0626       1.9914        12.842         100    
reco:emshower:EMShower                                0.000173061    0.0247219     0.303396     0.00696572     0.0396532       100    
reco:cvnmap:CVNMapper                                 1.8819e-05    0.00776584     0.0442829    0.00424342    0.00899918       100    
reco:cvneva:CVNEvaluator                              1.6084e-05     0.509419      0.990598      0.586428      0.301111        100    
reco:energyrecnumu:EnergyReco                         0.000337458    0.0314173     0.609995     0.00626884     0.0895968       100    
reco:energyrecnue:EnergyReco                           9.992e-05    0.00162935     0.0326431    0.000394966   0.00379552       100    
reco:energyrecnc:EnergyReco                           0.00127424    0.00322793     0.0363517    0.00230416     0.0039892       100    
reco:energyrecnumurange:EnergyReco                    0.000156566    0.0262483     0.609615     0.00193083     0.0867272       100    
reco:energyrecnumumcs:EnergyReco                      0.00104511     0.027341      0.605206     0.00262477     0.086959        100    
reco:opdec:Deconvolution                               0.0931148      0.28438      0.608689      0.273272      0.120165        100    
reco:ophitspe:OpHitFinderDeco                          0.225299       1.47026       3.36955       1.39255      0.643417        100    
reco:opflash:OpFlashFinder                            0.000264499   0.00121377    0.00408268    0.00115942    0.000565821      100    
reco:rns:RandomNumberSaver                            1.9559e-05    3.19589e-05   0.000266361   2.74665e-05   2.50476e-05      100    
reco:anglereconue:NuAngularReco                       0.000142795   0.00146602     0.0320372    0.000388862   0.00393608       100    
reco:anglereconumu:NuAngularReco                      4.5859e-05    0.00126664     0.0324622    0.000178299   0.00397717       100    
reco:anglereconuepfps:NuAngularReco                   8.7983e-05    0.00140814     0.0336954    0.000281064   0.00409976       100    
reco:anglereconumupfps:NuAngularReco                  6.1573e-05     0.0013182     0.0331059    0.000234103   0.00404874       100    
[art]:TriggerResults:TriggerResultInserter             8.943e-06    1.29014e-05   4.6851e-05    1.1528e-05    5.65362e-06      100    
end_path:out1:RootOutput                               3.265e-06    4.88859e-06   1.8578e-05     4.236e-06    2.00897e-06      100    
end_path:out1:RootOutput(write)                        0.0183182     0.195568      0.769186      0.190594       0.13281        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40123.3 MB
  Peak resident set size usage (VmHWM): 2332.88 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2_reco_2024-11-22T_232233Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_995_20231202T182947Z_gen_g4_detsim_hitreco__20240508T070101Z_reco2_reco_data_2024-11-22T_232233Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:01:41 UTC       justIN version: 01.01.09