justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108512.7@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108512.7@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:14:30
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-11-23 00:18:43
From worker nodeHostnamen257.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:32:51
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2.root
JobscriptExit code0
Real time1h (5835s)
CPU time1h (5370s = 92%)
Outputting started2024-11-23 00:10:07
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2.root
Finished2024-11-23 00:18:43
Saved logsjustin-logs:108512.7-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3-Nov-2024 00:09:53 GMT run: 50515286 subRun: 1 event: 45000
1st wire C:0 T:15 P:2 W:587 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:53 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:53 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:53 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:10:00 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:10:00 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:10:00 GMT run: 50515286 subRun: 1 event: 45000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 312, 291, 255
minwire 0: 1660
minwire 1: 1166
minwire 2: 1577
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.373777, 0.121202, 0.505021, 
Output 1: 0.234061, 0.747342, 0.0179514, 0.000644796, 
Output 2: 0.156851, 0.843149, 

616
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2294!
23-Nov-2024 00:10:05 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2_reco_data_2024-11-22T_223255Z.root"
23-Nov-2024 00:10:05 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/9a/a2/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.745286       54.0386       1517.71       11.8755       177.686        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0166656     0.0700065     0.706787      0.0442033     0.0934261       100    
reco:linecluster:LineCluster                           0.153396       1.73647       95.8467      0.203645       10.1643        100    
reco:trajcluster:TrajCluster                           0.0487672      3.65021       235.291      0.0685102      24.2933        100    
reco:pandora:StandardPandora                           0.0615894      4.49693       151.441       1.26206       17.1164        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000144865    0.011543      0.317272     0.00220527     0.0385504       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000193757    0.0167565     0.242819      0.0042528      0.03367        100    
reco:pandoracalo:Calorimetry                          0.000112714    0.0576668      2.42557     0.00145669     0.274559        100    
reco:pandorapid:Chi2ParticleID                        4.4785e-05    0.000208541   0.00142163    0.000168184   0.000201708      100    
reco:trkshowersplit:TrackShowerHits                   0.000145086    0.0657973      2.67874     0.00114667      0.30837        100    
reco:pmtrack:PMAlgTrackMaker                          0.00130473      6.74942       230.323       0.38721       28.9498        100    
reco:pmtrackcalo:Calorimetry                          7.8369e-05     0.0273826      1.31155     0.00129835     0.140372        100    
reco:pmtrackpid:Chi2ParticleID                         3.181e-05    0.000444432    0.0064944    0.000174111   0.000860455      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000228534     4.97295       183.145      0.432712       20.4796        100    
reco:pmtrajfitcalo:Calorimetry                        7.0634e-05     0.0588182      2.46592      0.0018235     0.278765        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.9426e-05    0.000233576    0.0012271    0.000178745   0.000204411      100    
reco:pmtracktc:PMAlgTrackMaker                          0.00116       7.16703       250.162       0.47727       29.9665        100    
reco:pmtracktccalo:Calorimetry                        8.2516e-05     0.0139903      0.42723     0.00148127     0.0510676       100    
reco:pmtracktcpid:Chi2ParticleID                      3.1771e-05    0.000390341   0.00416377    0.000203712   0.000588158      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000206873     3.14793       75.2944      0.443038       9.89301        100    
reco:pmtrajfittccalo:Calorimetry                      7.2819e-05     0.036012       1.35522      0.0018022     0.155856        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.0267e-05    0.000551877   0.00622515    0.000220209   0.00100942       100    
reco:blurredcluster:BlurredClustering                  8.458e-05      1.26136       9.59531      0.608497       1.74109        100    
reco:emtrkmichelid:EmTrackMichelId                     0.0335678      16.6562       263.258       3.72868       37.3984        100    
reco:emshower:EMShower                                0.000288839    0.0455949     0.605014      0.0184921     0.0800192       100    
reco:cvnmap:CVNMapper                                 2.6631e-05     0.0102696     0.0593091    0.00887525    0.00971528       100    
reco:cvneva:CVNEvaluator                              2.0549e-05     0.655396       1.2272        0.84591      0.383128        100    
reco:energyrecnumu:EnergyReco                         0.000441749    0.0482541      1.20009     0.00522534     0.148137        100    
reco:energyrecnue:EnergyReco                          0.000173981   0.00350939     0.105169     0.000857334    0.0121693       100    
reco:energyrecnc:EnergyReco                           0.00180619    0.00607569     0.107371     0.00316755     0.0123891       100    
reco:energyrecnumurange:EnergyReco                    0.000231169    0.0459309      1.17856      0.0029107     0.146428        100    
reco:energyrecnumumcs:EnergyReco                      0.000936299    0.0478193      1.19644     0.00378975     0.148261        100    
reco:opdec:Deconvolution                               0.0648478     0.353156       1.86895      0.280452      0.267496        100    
reco:ophitspe:OpHitFinderDeco                          0.291467       2.32114       5.00848       2.24115       1.04834        100    
reco:opflash:OpFlashFinder                            0.00026843     0.001535      0.0040014    0.00144791    0.000708789      100    
reco:rns:RandomNumberSaver                            1.8385e-05    3.65655e-05   0.000295662   3.34485e-05   2.82726e-05      100    
reco:anglereconue:NuAngularReco                       0.000171706   0.00281248     0.0882719    0.000479356    0.010536        100    
reco:anglereconumu:NuAngularReco                      8.2107e-05    0.00256832     0.0884497    0.000335191    0.0102615       100    
reco:anglereconuepfps:NuAngularReco                   0.000143803   0.00274526     0.0877053    0.000471707    0.0104115       100    
reco:anglereconumupfps:NuAngularReco                  0.000122323   0.00268285     0.0886651    0.000400596    0.0104525       100    
[art]:TriggerResults:TriggerResultInserter             1.005e-05    1.40785e-05   4.0397e-05    1.3135e-05    3.93111e-06      100    
end_path:out1:RootOutput                               2.786e-06    5.40238e-06   1.6321e-05     5.004e-06    2.42242e-06      100    
end_path:out1:RootOutput(write)                        0.0163998     0.288541       1.80621       0.26216      0.251755        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38588.6 MB
  Peak resident set size usage (VmHWM): 2535.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2_reco_2024-11-22T_223255Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515286_449_20231201T145424Z_gen_g4_detsim_hitreco__20240507T191210Z_reco2_reco_data_2024-11-22T_223255Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:20:51 UTC       justIN version: 01.01.09