justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.182@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.182@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:11:05
From worker nodeHostnamedune001-3354171.0-lcg2630.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:10
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2.root
JobscriptExit code0
Real time38m (2315s)
CPU time1h (3846s = 166%)
Outputting started2024-11-23 00:02:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2.root
Finished2024-11-23 00:11:05
Saved logsjustin-logs:301491.182-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:02:37 UTC run: 6468412 subRun: 1 event: 24400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1477, 2248, 1567
minwire 0: 2232
minwire 1: 670
minwire 2: 1967
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00768877, 0.974767, 0.0175444, 
Output 1: 0.0989041, 0.869059, 0.0305107, 0.00152611, 
Output 2: 0.0364369, 0.963563, 

754
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2898!
23-Nov-2024 00:02:45 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2_reco_data_2024-11-22T_232413Z.root"
23-Nov-2024 00:02:45 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/ce/46/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.548821       21.9646       412.119       8.06785       47.414         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00147895     0.102767      0.411757      0.0763423     0.0886954       100    
reco:linecluster:LineCluster                           0.0325294     0.418384       15.5211      0.204878       1.53471        100    
reco:trajcluster:TrajCluster                          0.00137349     0.532063       18.7569      0.0808462      2.05106        100    
reco:pandora:StandardPandora                           0.246737       1.99357       51.4046       1.31852       5.02447        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000119432   0.00436527     0.0717348    0.00117857     0.0096353       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000157803    0.0107208     0.262505     0.00204323     0.0307765       100    
reco:pandoracalo:Calorimetry                          9.0132e-05     0.0183184     0.944365     0.000664177    0.0960513       100    
reco:pandorapid:Chi2ParticleID                        3.4481e-05    0.000155791   0.00169005    0.000109477   0.000194243      100    
reco:trkshowersplit:TrackShowerHits                   9.0911e-05     0.0159559     0.575701     0.00055306     0.0645524       100    
reco:pmtrack:PMAlgTrackMaker                          0.000993438     1.92629       63.1035      0.0937303      6.97476        100    
reco:pmtrackcalo:Calorimetry                          6.4121e-05    0.00693167     0.212346     0.000637812    0.0231474       100    
reco:pmtrackpid:Chi2ParticleID                         2.491e-05    0.000236186   0.00217728    0.000130713   0.000301833      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000169383     1.7738        46.0102      0.159152       5.23651        100    
reco:pmtrajfitcalo:Calorimetry                        5.8541e-05     0.0195015     0.981497     0.00100548     0.0999236       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.5371e-05    0.000157653   0.000533569   0.000128743   0.000119546      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000841105     2.05479       50.4199      0.0961668      6.33282        100    
reco:pmtracktccalo:Calorimetry                        6.1652e-05    0.00477027     0.0851002    0.000619096    0.0115143       100    
reco:pmtracktcpid:Chi2ParticleID                      2.5951e-05    0.000224876   0.00185666    0.000129032   0.000282384      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000165033     1.14185       27.0988      0.185169       3.05967        100    
reco:pmtrajfittccalo:Calorimetry                      5.7651e-05     0.0108925     0.406169     0.000741353    0.0430399       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.4171e-05    0.00028304    0.00322676    0.000136497   0.000422162      100    
reco:blurredcluster:BlurredClustering                 0.000290785    0.883871       5.87996      0.359058       1.22457        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000196293     8.15672       125.079       1.79608        16.7          100    
reco:emshower:EMShower                                0.000242745    0.0236393     0.150832     0.00400036     0.0355741       100    
reco:cvnmap:CVNMapper                                  2.368e-05    0.00755672     0.038413     0.00581179    0.00725355       100    
reco:cvneva:CVNEvaluator                              1.6021e-05     0.709615       1.57428      0.936612      0.475029        100    
reco:energyrecnumu:EnergyReco                         0.000284876    0.0182749     0.404684     0.00384323     0.0542534       100    
reco:energyrecnue:EnergyReco                          0.000121352   0.00157443     0.0294119    0.000537639   0.00351197       100    
reco:energyrecnc:EnergyReco                           0.00155137    0.00353625     0.035172     0.00247341    0.00394268       100    
reco:energyrecnumurange:EnergyReco                    0.000126752    0.0160043     0.388936     0.00218743     0.0519867       100    
reco:energyrecnumumcs:EnergyReco                      0.000906957    0.0171576     0.389723     0.00334958     0.051765        100    
reco:opdec:Deconvolution                               0.0520782     0.301289      0.716359      0.281302      0.131448        100    
reco:ophitspe:OpHitFinderDeco                          0.0423002      1.57291       4.30218       1.46619      0.816651        100    
reco:opflash:OpFlashFinder                            0.000180483   0.00122224    0.00484038    0.00114808    0.000663061      100    
reco:rns:RandomNumberSaver                             1.846e-05    3.22141e-05   0.000312666   2.70505e-05   2.9445e-05       100    
reco:anglereconue:NuAngularReco                       0.000156883   0.00105763     0.0142542    0.000358062   0.00223404       100    
reco:anglereconumu:NuAngularReco                      7.1691e-05    0.000847762    0.0136036    0.000186129   0.00203716       100    
reco:anglereconuepfps:NuAngularReco                   0.000115442   0.000951719    0.0137871    0.000293335   0.00198787       100    
reco:anglereconumupfps:NuAngularReco                  0.000105071   0.000889908    0.0141579    0.000239809   0.00199737       100    
[art]:TriggerResults:TriggerResultInserter             9.04e-06     1.22018e-05   4.3101e-05    1.14705e-05   3.99783e-06      100    
end_path:out1:RootOutput                               2.83e-06     3.9539e-06    2.0841e-05    3.4505e-06    2.32866e-06      100    
end_path:out1:RootOutput(write)                        0.0199279     0.209571       0.78923      0.209564       0.14544        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39583.8 MB
  Peak resident set size usage (VmHWM): 2414.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2_reco_2024-11-22T_232413Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6468412_243_20231207T074806Z_gen_g4_detsim_hitreco__20240510T055835Z_reco2_reco_data_2024-11-22T_232413Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:39:22 UTC       justIN version: 01.01.09