justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 280329.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID280329.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3836
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-10-26 02:30:04
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-10-26 07:24:52
From worker nodeHostnamedune001-3032218.0-lcg2624.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-26 02:51:53
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2.root
JobscriptExit code0
Real time4h (16354s)
CPU time4h (16327s = 99%)
Outputting started2024-10-26 07:24:28
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2.root
Finished2024-10-26 07:24:52
Saved logsjustin-logs:280329.46-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  26-Oct-2024 07:24:22 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  26-Oct-2024 07:24:24 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  26-Oct-2024 07:24:24 UTC run: 50515284 subRun: 1 event: 41900
Comparing two wires in the same plane: return failure
%MSG
258
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 519!
26-Oct-2024 07:24:26 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2_reco_data_2024-10-26T_025158Z.root"
26-Oct-2024 07:24:26 UTC  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/64/13/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.858537       160.456       10304.5       11.9655       1039.71        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0271151     0.0646472     0.499852      0.0543321     0.0493356       100    
reco:linecluster:LineCluster                           0.157396       1.18886       49.0389      0.273444       5.46004        100    
reco:trajcluster:TrajCluster                           0.0793409      2.60302       138.495      0.0931531      14.1642        100    
reco:pandora:StandardPandora                           0.0946851      111.853       9979.28       1.56648       995.834        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000158613    0.0126906     0.364215     0.00208232     0.039464        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000217104    0.0172009     0.181015     0.00412845     0.0315241       100    
reco:pandoracalo:Calorimetry                          0.000114212    0.0618196      2.72342     0.00129291     0.284035        100    
reco:pandorapid:Chi2ParticleID                        4.4771e-05    0.000224522   0.00142357    0.000171118   0.00019407       100    
reco:trkshowersplit:TrackShowerHits                   9.3222e-05     0.0857176      3.42739     0.00104978     0.370535        100    
reco:pmtrack:PMAlgTrackMaker                          0.00123201      5.49942       134.997      0.220247       16.8622        100    
reco:pmtrackcalo:Calorimetry                          7.3052e-05     0.0241474     0.971435      0.0014059     0.104351        100    
reco:pmtrackpid:Chi2ParticleID                        3.2531e-05    0.000457484   0.00621603    0.000194254   0.000814992      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000192444     5.8434        193.708      0.404362       21.3199        100    
reco:pmtrajfitcalo:Calorimetry                        7.3692e-05     0.0589479      2.70351     0.00224217     0.278222        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7101e-05    0.000263436   0.00178332    0.000195605   0.00026972       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00090069      6.69055       172.621      0.286019       20.8471        100    
reco:pmtracktccalo:Calorimetry                        7.0152e-05     0.0151202     0.457565     0.00140029     0.0541906       100    
reco:pmtracktcpid:Chi2ParticleID                      3.0251e-05    0.000434795   0.00466643    0.000209315   0.00068858       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000155034     3.29824       85.5578       0.37376       9.84005        100    
reco:pmtrajfittccalo:Calorimetry                      6.4992e-05     0.0377324      1.44901     0.00165274     0.153981        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.8881e-05    0.000623479   0.00992787    0.00022804    0.00123115       100    
reco:blurredcluster:BlurredClustering                 0.000157444     1.50848       11.2127      0.672875       1.98564        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000155023     16.9994       242.055       3.0409        35.2755        100    
reco:emshower:EMShower                                0.000207955    0.0386107      0.44583      0.0128582     0.0621134       100    
reco:cvnmap:CVNMapper                                 2.3591e-05     0.0174484     0.0643724     0.0203993     0.0142045       100    
reco:cvneva:CVNEvaluator                              1.8461e-05      1.01707       1.72365       1.32631      0.618477        100    
reco:energyrecnumu:EnergyReco                         0.000459099    0.0413705     0.617895     0.00531057     0.106505        100    
reco:energyrecnue:EnergyReco                          0.000156323   0.00397004     0.104388     0.000718846    0.0118113       100    
reco:energyrecnc:EnergyReco                           0.00202988    0.00705352      0.11035     0.00399604     0.0122282       100    
reco:energyrecnumurange:EnergyReco                    0.000232526    0.0397719     0.611184     0.00321214     0.108926        100    
reco:energyrecnumumcs:EnergyReco                      0.00088677     0.0425458     0.613483     0.00475066     0.109645        100    
reco:opdec:Deconvolution                               0.109128       0.37764      0.636547      0.386108       0.11339        100    
reco:ophitspe:OpHitFinderDeco                          0.237346       2.63565       5.36175       2.52519       1.17003        100    
reco:opflash:OpFlashFinder                            0.000320757   0.00215397    0.00471201    0.00216533    0.00106809       100    
reco:rns:RandomNumberSaver                             2.035e-05    4.66555e-05   0.000421449   4.31265e-05   3.90315e-05      100    
reco:anglereconue:NuAngularReco                       0.000167123   0.00357305     0.104206     0.000655345    0.0115828       100    
reco:anglereconumu:NuAngularReco                      7.6551e-05    0.00311127     0.100127     0.000326262    0.0111055       100    
reco:anglereconuepfps:NuAngularReco                   0.000117492   0.00329463     0.100018     0.000489961    0.0110696       100    
reco:anglereconumupfps:NuAngularReco                  9.9132e-05    0.00319765     0.101203     0.000394299    0.0111956       100    
[art]:TriggerResults:TriggerResultInserter             9.52e-06     1.70904e-05   6.3092e-05    1.60605e-05   5.92547e-06      100    
end_path:out1:RootOutput                               3.39e-06     7.58577e-06    2.554e-05     7.92e-06     2.61643e-06      100    
end_path:out1:RootOutput(write)                        0.0223415     0.352293       2.00983      0.328633      0.295313        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40229.3 MB
  Peak resident set size usage (VmHWM): 2934.85 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2_reco_2024-10-26T_025158Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_418_20231201T115306Z_gen_g4_detsim_hitreco__20240507T190044Z_reco2_reco_data_2024-10-26T_025158Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 09:52:39 UTC       justIN version: 01.01.09