justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.178@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.178@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:21:47
From worker nodeHostnamedune001-2994313.0-lcg2680.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:49
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2.root
JobscriptExit code0
Real time51m (3119s)
CPU time1h (3904s = 125%)
Outputting started2024-11-23 00:16:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2.root
Finished2024-11-23 00:21:47
Saved logsjustin-logs:301491.178-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:16:34 UTC run: 6419587 subRun: 1 event: 82900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 10538, 10293, 7013
minwire 0: 1016
minwire 1: 569
minwire 2: 744
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.142867, 0.69041, 0.166723, 
Output 1: 0.47352, 0.494994, 0.0298183, 0.00166697, 
Output 2: 0.173529, 0.826471, 

962
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3839!
23-Nov-2024 00:16:47 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2_reco_data_2024-11-22T_232454Z.root"
23-Nov-2024 00:16:47 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/e5/4b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.533603       29.5989       902.563       10.2004       93.782         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00144799     0.106053      0.564198      0.0756189      0.08681        100    
reco:linecluster:LineCluster                           0.0362499     0.415211       8.0623       0.285986      0.804544        100    
reco:trajcluster:TrajCluster                          0.00105976     0.623122       24.7578      0.0991173      2.67945        100    
reco:pandora:StandardPandora                           0.0710855      4.54139       248.181       1.46729       24.7718        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000158177   0.00537974     0.0923042    0.00110526     0.0125826       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000221967    0.010057      0.139715     0.00274456     0.0208924       100    
reco:pandoracalo:Calorimetry                          0.000121388    0.0183235     0.964762     0.000862794    0.0977865       100    
reco:pandorapid:Chi2ParticleID                        4.8842e-05    0.000198214   0.00271718    0.000136521   0.000286684      100    
reco:trkshowersplit:TrackShowerHits                   8.4709e-05     0.0175864     0.455812     0.000563427    0.0624872       100    
reco:pmtrack:PMAlgTrackMaker                          0.00118397      2.34586       94.8337      0.124192       9.96265        100    
reco:pmtrackcalo:Calorimetry                          8.4358e-05    0.00912263     0.409955     0.000765892    0.0425522       100    
reco:pmtrackpid:Chi2ParticleID                        3.4284e-05    0.000287743   0.00324471    0.00015219    0.000438029      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000213491     2.1085        88.8221      0.200047       9.15039        100    
reco:pmtrajfitcalo:Calorimetry                        7.3708e-05     0.0252391      1.59899     0.000977995    0.160159        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.1339e-05    0.000210366   0.00121482    0.000147883   0.000195908      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000959189     3.4188        145.147      0.145138       15.3768        100    
reco:pmtracktccalo:Calorimetry                         6.947e-05     0.007611      0.396586     0.000737699    0.0398876       100    
reco:pmtracktcpid:Chi2ParticleID                       3.221e-05    0.000293928   0.00455725    0.000154565   0.00051189       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000226375     1.73741       74.5701      0.210398       7.63218        100    
reco:pmtrajfittccalo:Calorimetry                      7.9319e-05     0.0137029     0.697994     0.000856422    0.0710846       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.3874e-05    0.000348366   0.00454431    0.000155958   0.000576647      100    
reco:blurredcluster:BlurredClustering                 0.000214914     1.04745       7.41587      0.468063       1.45267        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000159489     9.39432       194.712       2.10446       23.0142        100    
reco:emshower:EMShower                                0.000210995    0.0278212     0.251064     0.00452533     0.0484391       100    
reco:cvnmap:CVNMapper                                 2.5849e-05    0.00931139     0.0513656    0.00591271     0.011223        100    
reco:cvneva:CVNEvaluator                              1.7372e-05     0.812815       1.43873       1.15391      0.593892        100    
reco:energyrecnumu:EnergyReco                         0.00036195     0.0275965      1.19612     0.00379551     0.123202        100    
reco:energyrecnue:EnergyReco                          0.000153779   0.00202523     0.0506942    0.000491312   0.00562792       100    
reco:energyrecnc:EnergyReco                           0.00167739    0.00469771     0.0547704    0.00345058    0.00589214       100    
reco:energyrecnumurange:EnergyReco                    0.000182342    0.0253776      1.2449      0.00322117     0.126577        100    
reco:energyrecnumumcs:EnergyReco                      0.00120168     0.0269824      1.22506     0.00377342     0.124959        100    
reco:opdec:Deconvolution                               0.112211      0.361592      0.889781      0.354458      0.162219        100    
reco:ophitspe:OpHitFinderDeco                          0.112927       2.18409       4.96398       2.09987      0.958307        100    
reco:opflash:OpFlashFinder                            0.000258796    0.0015267    0.00537059    0.00136711    0.000863078      100    
reco:rns:RandomNumberSaver                            1.9116e-05    3.76796e-05   0.000429286   3.15745e-05   4.16746e-05      100    
reco:anglereconue:NuAngularReco                       0.000174337   0.00159022     0.0420662    0.000362645   0.00474892       100    
reco:anglereconumu:NuAngularReco                       8.006e-05    0.00137651     0.0397069    0.000205726   0.00450467       100    
reco:anglereconuepfps:NuAngularReco                   0.000155752    0.0015231     0.0392321    0.000331357   0.00446464       100    
reco:anglereconumupfps:NuAngularReco                  0.000131357   0.00145811     0.0392868    0.000280727   0.00448447       100    
[art]:TriggerResults:TriggerResultInserter            1.0039e-05    1.65552e-05   5.5985e-05    1.50385e-05   5.81638e-06      100    
end_path:out1:RootOutput                               3.145e-06    4.79989e-06   1.9226e-05     4.233e-06    1.91442e-06      100    
end_path:out1:RootOutput(write)                        0.0218302     0.260263       1.57271       0.27418      0.209281        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39457.3 MB
  Peak resident set size usage (VmHWM): 2251.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2_reco_2024-11-22T_232454Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419587_828_20231204T004948Z_gen_g4_detsim_hitreco__20240509T211202Z_reco2_reco_data_2024-11-22T_232454Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:34:45 UTC       justIN version: 01.01.09