justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 61260.159@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID61260.159@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 21:40:20
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod02
Last heartbeat2024-08-24 01:34:05
From worker nodeHostnamewj42.grid.hep.ph.ic.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 21:42:28
Input filesfardet-hd:nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2.root
JobscriptExit code0
Real time3h (13852s)
CPU time3h (13392s = 96%)
Outputting started2024-08-24 01:33:26
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2.root
Finished2024-08-24 01:34:05
Saved logsjustin-logs:61260.159-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ile /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2_reco_data_2024-08-23T_214255Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
  33
  36
  37
  39
  44
  50
  51
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:33:09 BST run: 1106 subRun: 1 event: 60400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 983, 1160, 1059
minwire 0: 1701
minwire 1: 913
minwire 2: 1580
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0201927, 
Output 1: 0.00141262, 0.995012, 0.00223301, 0.00134196, 
Output 2: 0.000885061, 0.0614788, 0.937466, 0.000169646, 
Output 3: 0.951092, 0.0472034, 0.00106987, 0.000634332, 
Output 4: 0.0110182, 0.961561, 0.0272921, 0.000128248, 
Output 5: 0.0272636, 0.869107, 0.09717, 0.00645982, 
Output 6: 0.0203765, 0.714669, 0.202452, 0.0625031, 

708
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2755!
24-Aug-2024 02:33:19 BST  Closed output file "nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2_reco_data_2024-08-23T_214255Z.root"
24-Aug-2024 02:33:19 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/8f/05/nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.432011       135.098       1089.98       71.7919       191.526        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0183503     0.102144      0.435787      0.0832076     0.0599618       100    
reco:linecluster:LineCluster                           0.0733881      1.58249       72.136       0.290032       7.40345        100    
reco:trajcluster:TrajCluster                           0.0254354      8.26289       137.517      0.777483       22.301         100    
reco:pandora:StandardPandora                           0.0587997      7.8012        82.9185       3.24511        14.06         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000248806    0.0298658     0.305095      0.013967      0.0445107       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000347644    0.0373553     0.318167      0.0196562     0.0515166       100    
reco:pandoracalo:Calorimetry                          0.000195949    0.111386       1.77053      0.0262838     0.267737        100    
reco:pandorapid:Chi2ParticleID                        7.9421e-05    0.000414343   0.00296841    0.000360369   0.000343463      100    
reco:trkshowersplit:TrackShowerHits                   0.000104531    0.104492       1.30769      0.021824      0.222303        100    
reco:pmtrack:PMAlgTrackMaker                          0.00162265      15.2965       166.199       5.25255        28.39         100    
reco:pmtrackcalo:Calorimetry                          0.000105278    0.0768256      1.13634      0.0183901     0.158253        100    
reco:pmtrackpid:Chi2ParticleID                        5.3326e-05    0.00141726    0.00840725    0.00093855    0.00156113       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000396245     9.44684       63.8226       4.8366        13.0381        100    
reco:pmtrajfitcalo:Calorimetry                        0.000145297    0.120274       1.89415      0.0321191     0.283238        100    
reco:pmtrajfitpid:Chi2ParticleID                       6.837e-05    0.000564194   0.00220265    0.000447584   0.000379813      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00222544      19.9462       197.334       5.66059       36.866         100    
reco:pmtracktccalo:Calorimetry                        0.000155475    0.0537085     0.710223      0.0187981     0.103765        100    
reco:pmtracktcpid:Chi2ParticleID                      6.5519e-05    0.00123056    0.00626245    0.000835163   0.00124933       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000364627     9.63558       79.092        4.64892       14.6962        100    
reco:pmtrajfittccalo:Calorimetry                      0.000148848    0.100574       1.31328      0.0270053     0.215402        100    
reco:pmtrajfittcpid:Chi2ParticleID                    6.4475e-05    0.00159448    0.00969159    0.00107175    0.00176224       100    
reco:blurredcluster:BlurredClustering                 0.000292469     3.15325       15.0267       2.50671       2.95852        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000212885     50.9444       297.608       31.7649       59.1306        100    
reco:emshower:EMShower                                0.000335313    0.141724      0.624353      0.0968055     0.143126        100    
reco:cvnmap:CVNMapper                                 3.8071e-05     0.0524491     0.161136      0.0542323     0.0239075       100    
reco:cvneva:CVNEvaluator                              2.6669e-05      2.06896       4.52444       2.20346      0.628482        100    
reco:energyrecnumu:EnergyReco                         0.00091002     0.313157       4.79812      0.0532131     0.687187        100    
reco:energyrecnue:EnergyReco                          0.00027556    0.00988389     0.108791     0.00417666     0.0153087       100    
reco:energyrecnc:EnergyReco                           0.00298493     0.0131424      0.11185     0.00746843     0.0153331       100    
reco:energyrecnumurange:EnergyReco                    0.000465856    0.289968       4.3104       0.0424847     0.627128        100    
reco:energyrecnumumcs:EnergyReco                      0.00326342     0.304102       4.7695       0.0416646     0.676128        100    
reco:opdec:Deconvolution                               0.0542252      0.48684      0.748133      0.521672      0.141611        100    
reco:ophitspe:OpHitFinderDeco                          0.0857969      3.49948       5.43193       3.74808       1.10595        100    
reco:opflash:OpFlashFinder                            0.000197213   0.00300431    0.00697697    0.00323353    0.00119709       100    
reco:rns:RandomNumberSaver                            2.0153e-05    4.51812e-05   0.000418071   4.21015e-05   3.86828e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2617e-05    2.15754e-05   6.6369e-05    2.0983e-05    5.61228e-06      100    
end_path:out1:RootOutput                               3.105e-06    7.84237e-06   2.7095e-05    8.4015e-06    2.85457e-06      100    
end_path:out1:RootOutput(write)                        0.0133376      1.10096       2.5496        1.0685       0.429482        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8727.19 MB
  Peak resident set size usage (VmHWM): 2768.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2_reco_2024-08-23T_214255Z.log
nue_dune10kt_1x2x6_1106_603_20230826T163354Z_gen_g4_detsim_hitreco__20240221T020015Z_reco2_reco_data_2024-08-23T_214255Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:17:27 UTC       justIN version: 01.01.09