justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108593.70@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108593.70@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:25:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:13:40
From worker nodeHostnamedune001-2995139.0-lcg2695.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:35:34
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2.root
JobscriptExit code0
Real time31m (1870s)
CPU time32m (1952s = 104%)
Outputting started2024-11-23 00:06:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2.root
Finished2024-11-23 00:13:40
Saved logsjustin-logs:108593.70-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

UTC run: 74540126 subRun: 1 event: 34800
1st wire C:0 T:21 P:2 W:529 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:37 UTC run: 74540126 subRun: 1 event: 34800
1st wire C:0 T:21 P:2 W:1068 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:37 UTC run: 74540126 subRun: 1 event: 34800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:06:37 UTC run: 74540126 subRun: 1 event: 34800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:40 UTC run: 74540126 subRun: 1 event: 34800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:06:40 UTC run: 74540126 subRun: 1 event: 34800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 43, 56, 46
minwire 0: 2179
minwire 1: 666
minwire 2: 2310
Used alternate method to get min and max wires due to vertex determination failure: 188, 387
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 64, 263
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.985005, 0.00100969, 0.0139852, 
Output 1: 0.071818, 0.484812, 0.43209, 0.0112796, 
Output 2: 0.980031, 0.0199694, 

494
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1892!
23-Nov-2024 00:06:44 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2_reco_data_2024-11-22T_233538Z.root"
23-Nov-2024 00:06:44 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/2b/d8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.291063       17.2322        203.5        8.26859       32.3642        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0019508     0.110001      0.361667      0.0907954     0.0775604       100    
reco:linecluster:LineCluster                           0.0296897     0.416638       8.4008       0.268913      0.936571        100    
reco:trajcluster:TrajCluster                          0.00194348     0.451888       14.0007      0.0975242      1.79169        100    
reco:pandora:StandardPandora                           0.0928675      1.59272       13.8697       1.24878       1.76202        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000110486   0.00390552     0.0417147    0.00155955    0.00706566       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000151138    0.0084538     0.131327     0.00252154     0.0173081       100    
reco:pandoracalo:Calorimetry                          8.2314e-05     0.0111633     0.335182     0.000928772    0.043136        100    
reco:pandorapid:Chi2ParticleID                        3.2869e-05    0.000161375    0.0024347    0.000128709   0.000238349      100    
reco:trkshowersplit:TrackShowerHits                   7.0817e-05     0.0135028     0.413817     0.000636724    0.0575965       100    
reco:pmtrack:PMAlgTrackMaker                          0.000999775     1.5534        34.264       0.179918       5.1114         100    
reco:pmtrackcalo:Calorimetry                          4.8503e-05    0.00447602     0.112285     0.000847931    0.0140148       100    
reco:pmtrackpid:Chi2ParticleID                        1.8538e-05    0.000207166   0.00198923    0.000146831   0.000261856      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000155594     1.22882       25.2791      0.253591       3.60963        100    
reco:pmtrajfitcalo:Calorimetry                        4.2774e-05     0.0108723     0.343814     0.00144753     0.0423094       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8047e-05    0.000162303   0.000501495   0.000152584   9.05245e-05      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000829979     1.53537       34.0681       0.18886       5.22626        100    
reco:pmtracktccalo:Calorimetry                        4.4818e-05    0.00330634     0.0478555    0.000991767   0.00766128       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8288e-05    0.000207738   0.00157542    0.00015581    0.000215433      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000132029    0.889184       13.9675      0.227278       2.17704        100    
reco:pmtrajfittccalo:Calorimetry                      4.0911e-05    0.00643863      0.13026     0.00112024     0.0205986       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6925e-05    0.000252825   0.00195012    0.000163866   0.000308996      100    
reco:blurredcluster:BlurredClustering                 0.000224859    0.791834       5.19483      0.460384       1.04633        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000114162     5.91364       66.0365       2.24115       11.0626        100    
reco:emshower:EMShower                                0.000183205     0.01616      0.130934     0.00419237     0.0249753       100    
reco:cvnmap:CVNMapper                                 1.7857e-05    0.00921027     0.0386447    0.00645165    0.00862593       100    
reco:cvneva:CVNEvaluator                              1.6094e-05     0.536508      0.994731      0.632797      0.328107        100    
reco:energyrecnumu:EnergyReco                         0.000320302    0.0293095     0.940003     0.00595018     0.108191        100    
reco:energyrecnue:EnergyReco                          0.00011315     0.0011429     0.0128738    0.000424594   0.00213056       100    
reco:energyrecnc:EnergyReco                           0.00127388    0.00294893     0.0157058    0.00242124    0.00231548       100    
reco:energyrecnumurange:EnergyReco                    0.000181903    0.0242667     0.814203     0.00194442     0.097363        100    
reco:energyrecnumumcs:EnergyReco                      0.000529407    0.0250801     0.792054     0.00280332     0.0938495       100    
reco:opdec:Deconvolution                               0.0137614     0.303833      0.694025      0.290079      0.119619        100    
reco:ophitspe:OpHitFinderDeco                          0.0278286      1.52114       3.26352       1.51093      0.655078        100    
reco:opflash:OpFlashFinder                            0.000132149   0.00137698    0.00634093    0.00133943    0.000723832      100    
reco:rns:RandomNumberSaver                            1.8438e-05    3.7763e-05    0.000427463   3.35305e-05   4.04248e-05      100    
reco:anglereconue:NuAngularReco                       0.000158989   0.000994404    0.0142702    0.000415246   0.00208986       100    
reco:anglereconumu:NuAngularReco                      5.1568e-05    0.000755977    0.0140892    0.000218383   0.00206495       100    
reco:anglereconuepfps:NuAngularReco                   9.7908e-05    0.00091311     0.0143818    0.000351403   0.00210701       100    
reco:anglereconumupfps:NuAngularReco                  6.9094e-05    0.000819521    0.0144503    0.000287057   0.00208301       100    
[art]:TriggerResults:TriggerResultInserter             8.362e-06    1.42104e-05   9.0235e-05    1.2514e-05    8.80466e-06      100    
end_path:out1:RootOutput                               3.325e-06    5.48214e-06   2.5017e-05     5.408e-06    2.41744e-06      100    
end_path:out1:RootOutput(write)                        0.0141174     0.209036      0.746568      0.211944       0.13113        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40245.4 MB
  Peak resident set size usage (VmHWM): 2450.86 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2_reco_2024-11-22T_233538Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74540126_347_20231207T050352Z_gen_g4_detsim_hitreco__20240510T053607Z_reco2_reco_data_2024-11-22T_233538Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:07:24 UTC       justIN version: 01.01.09