justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301440.8@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301440.8@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:12:02
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-22 23:25:17
From worker nodeHostnamen252.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:36:34
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2.root
JobscriptExit code0
Real time45m (2713s)
CPU time39m (2360s = 86%)
Outputting started2024-11-22 23:21:48
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2.root
Finished2024-11-22 23:25:17
Saved logsjustin-logs:301440.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

1 event: 56400
1st wire C:0 T:20 P:2 W:519 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:21:33 GMT run: 6432575 subRun: 1 event: 56400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:21:33 GMT run: 6432575 subRun: 1 event: 56400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:21:33 GMT run: 6432575 subRun: 1 event: 56400
1st wire C:0 T:20 P:2 W:619 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:21:33 GMT run: 6432575 subRun: 1 event: 56400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:21:33 GMT run: 6432575 subRun: 1 event: 56400
1st wire C:0 T:20 P:2 W:883 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:21:42 GMT run: 6432575 subRun: 1 event: 56400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 537, 296, 354
minwire 0: 2409
minwire 1: 708
minwire 2: 2226
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.151628, 0.800131, 0.0482407, 
Output 1: 0.558998, 0.422294, 0.0178342, 0.000873906, 
Output 2: 0.212318, 0.787682, 

541
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1951!
22-Nov-2024 23:21:47 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2_reco_data_2024-11-22T_223638Z.root"
22-Nov-2024 23:21:47 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/00/9a/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.4185        23.4281       249.039       11.4661       33.8805        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0179054     0.0438269     0.0829375     0.0428235     0.0125005       100    
reco:linecluster:LineCluster                           0.175631      0.258604       2.57887      0.198267      0.252776        100    
reco:trajcluster:TrajCluster                           0.0511515     0.266197       4.46188      0.0680418     0.567875        100    
reco:pandora:StandardPandora                           0.885887       1.59572       20.7294       1.23119       1.98511        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000139314   0.00582818     0.0854017    0.00220182     0.0114958       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00020585     0.0174414     0.235969     0.00398105     0.0398292       100    
reco:pandoracalo:Calorimetry                          0.000124385    0.0127797     0.402633     0.00194655     0.0425908       100    
reco:pandorapid:Chi2ParticleID                        4.1909e-05    0.000186761   0.00216285    0.000140606   0.000229978      100    
reco:trkshowersplit:TrackShowerHits                   0.000133111    0.0131035     0.368166     0.00127985     0.0406773       100    
reco:pmtrack:PMAlgTrackMaker                          0.00128089      1.83388       27.9702      0.310663       4.08662        100    
reco:pmtrackcalo:Calorimetry                          7.6965e-05    0.00752826     0.149004     0.00122353     0.0201189       100    
reco:pmtrackpid:Chi2ParticleID                        3.2371e-05    0.000290326   0.00248305    0.000183507   0.000338813      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000224754     1.50084       18.9334      0.453854       2.73521        100    
reco:pmtrajfitcalo:Calorimetry                        7.0102e-05     0.0135156     0.404059     0.00242574     0.0430065       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.1579e-05    0.000211343   0.000958653   0.000179138   0.00016028       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00116869      2.00149       29.5755      0.351011       4.36946        100    
reco:pmtracktccalo:Calorimetry                        8.6013e-05    0.00613865     0.077335      0.001632      0.0121077       100    
reco:pmtracktcpid:Chi2ParticleID                      2.9135e-05    0.000284556   0.00182626    0.000186814   0.000292786      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00022248      1.53778       25.1537      0.370582       3.27302        100    
reco:pmtrajfittccalo:Calorimetry                      8.6874e-05     0.0103968     0.295357     0.00188606     0.0317796       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4926e-05    0.000370869   0.00372857    0.000219646   0.000472404      100    
reco:blurredcluster:BlurredClustering                 0.00860043     0.976632       6.77676       0.60631       1.13991        100    
reco:emtrkmichelid:EmTrackMichelId                     0.289479       9.92523       104.389       3.7341        15.4718        100    
reco:emshower:EMShower                                0.000287694    0.0289889     0.321298     0.00441784     0.0479286       100    
reco:cvnmap:CVNMapper                                 2.5227e-05    0.00979676     0.0372953    0.00812761    0.00793954       100    
reco:cvneva:CVNEvaluator                              1.9887e-05     0.633146       1.01804      0.796576      0.351357        100    
reco:energyrecnumu:EnergyReco                         0.000323692    0.0399789     0.671872     0.00452242     0.114764        100    
reco:energyrecnue:EnergyReco                          0.000140065   0.00182012     0.025024     0.000605194   0.00344246       100    
reco:energyrecnc:EnergyReco                           0.00175268    0.00430751     0.0284562    0.00322337    0.00359799       100    
reco:energyrecnumurange:EnergyReco                    0.000152729    0.0378957     0.665069     0.00296007     0.114106        100    
reco:energyrecnumumcs:EnergyReco                      0.000997937    0.0395166     0.668704     0.00401073     0.114056        100    
reco:opdec:Deconvolution                               0.0852277     0.297772      0.550525      0.295362      0.0836718       100    
reco:ophitspe:OpHitFinderDeco                           0.32516       2.05253       3.58568       2.03318      0.676261        100    
reco:opflash:OpFlashFinder                            0.000335083   0.00147275     0.005212     0.00143768    0.000609115      100    
reco:rns:RandomNumberSaver                            2.0128e-05    3.7402e-05    0.000380349   3.45305e-05   3.54392e-05      100    
reco:anglereconue:NuAngularReco                       0.000167617   0.00141192     0.0207907    0.000462449   0.00291881       100    
reco:anglereconumu:NuAngularReco                      7.3108e-05    0.00120475     0.020339     0.00025935     0.0028411       100    
reco:anglereconuepfps:NuAngularReco                   0.000134915   0.00135493     0.0207184    0.000415165   0.00287181       100    
reco:anglereconumupfps:NuAngularReco                  0.000117472   0.00128567     0.0209732    0.000344136   0.00290834       100    
[art]:TriggerResults:TriggerResultInserter             8.957e-06    1.4193e-05    3.8413e-05    1.3225e-05    3.7093e-06       100    
end_path:out1:RootOutput                               2.876e-06    6.68872e-06   1.6522e-05     6.808e-06    2.56813e-06      100    
end_path:out1:RootOutput(write)                        0.019567      0.245213      0.817116      0.249068      0.136562        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38273.8 MB
  Peak resident set size usage (VmHWM): 2215.61 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2_reco_2024-11-22T_223638Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6432575_563_20231207T031938Z_gen_g4_detsim_hitreco__20240510T043930Z_reco2_reco_data_2024-11-22T_223638Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:01:14 UTC       justIN version: 01.01.09