justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301707.104@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301707.104@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 04:33:23
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce505
Last heartbeat2024-11-23 05:14:15
From worker nodeHostnameb9p02p2167.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 04:34:55
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2.root
JobscriptExit code0
Real time39m (2341s)
CPU time42m (2549s = 108%)
Outputting started2024-11-23 05:13:57
Output files
Finished2024-11-23 05:14:15
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

t. 3.18379, nMCHits 24 (7, 9, 8)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 24 (7, 9, 8), nPfoHits 24 (7, 9, 8)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.0592427 GeV, E=0.997515 GeV, p2=0.114681
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 06:13:51 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:13:51 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:13:51 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 06:13:51 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 06:13:52 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 06:13:53 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 06:13:53 CET run: 50604274 subRun: 1 event: 19500
Comparing two wires in the same plane: return failure
%MSG
283
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 636!
23-Nov-2024 06:13:55 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2_reco_data_2024-11-23T_043501Z.root"
23-Nov-2024 06:13:55 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/9f/41/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.549969       21.3615       407.133       10.1805       44.2676        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0166899     0.0427022     0.0987739     0.0433003     0.0149878       100    
reco:linecluster:LineCluster                           0.095698      0.246039       5.96106      0.164509      0.590516        100    
reco:trajcluster:TrajCluster                           0.0472776      0.45255       23.6516      0.0610479      2.43319        100    
reco:pandora:StandardPandora                           0.0573957      2.24246       77.3435       1.31851       7.60002        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000130001   0.00400236     0.0677404    0.00150449    0.00789909       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000211822    0.0171114     0.260674     0.00366562     0.0451434       100    
reco:pandoracalo:Calorimetry                          9.0531e-05     0.0106153     0.381605     0.00105882     0.0407027       100    
reco:pandorapid:Chi2ParticleID                         3.362e-05    0.000164773   0.00136609    0.000132046   0.000141122      100    
reco:trkshowersplit:TrackShowerHits                   9.8011e-05     0.0112368     0.423478     0.000926879    0.0470834       100    
reco:pmtrack:PMAlgTrackMaker                          0.00101407      1.35423       39.7499      0.225245       4.2736         100    
reco:pmtrackcalo:Calorimetry                          6.5941e-05    0.00642433     0.268855     0.000979735    0.0273717       100    
reco:pmtrackpid:Chi2ParticleID                         2.484e-05    0.000243282   0.00200705    0.000164807   0.000266541      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000251682     1.71299       51.2573      0.245264       5.6667         100    
reco:pmtrajfitcalo:Calorimetry                        8.1871e-05     0.013086       0.42713     0.00149309     0.0490712       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.432e-05    0.000189213   0.000777098   0.000161036   0.000118351      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000815279     1.92082       57.729       0.280977       6.49278        100    
reco:pmtracktccalo:Calorimetry                        6.2221e-05    0.00640311     0.200168     0.000950709    0.0246122       100    
reco:pmtracktcpid:Chi2ParticleID                       2.374e-05    0.000240529   0.00265869    0.000162341   0.000313055      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000214833     1.1183        20.0255      0.335292       2.48985        100    
reco:pmtrajfittccalo:Calorimetry                      7.9541e-05    0.00786556     0.217079     0.00113433     0.0245149       100    
reco:pmtrajfittcpid:Chi2ParticleID                     3.536e-05    0.000305232   0.00213846    0.000177732   0.000369958      100    
reco:blurredcluster:BlurredClustering                 0.000117961    0.989852       6.57607      0.626313       1.21626        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000127111     7.66633       115.561       2.55367       14.2959        100    
reco:emshower:EMShower                                0.000186662    0.0227523     0.205764     0.00627276     0.0381493       100    
reco:cvnmap:CVNMapper                                 2.2931e-05     0.0100718     0.0327493     0.0116841    0.00735765       100    
reco:cvneva:CVNEvaluator                               1.584e-05      0.73301       1.25018      0.872268      0.406876        100    
reco:energyrecnumu:EnergyReco                         0.000367504    0.0217104     0.521147     0.00397464     0.0679873       100    
reco:energyrecnue:EnergyReco                          0.000139481   0.00129605     0.016958     0.000543021   0.00210359       100    
reco:energyrecnc:EnergyReco                           0.00163387    0.00386278     0.020066     0.00332482    0.00224182       100    
reco:energyrecnumurange:EnergyReco                    0.000177082    0.0197427     0.523417     0.00292087     0.0675114       100    
reco:energyrecnumumcs:EnergyReco                      0.000530226    0.0213808     0.528451     0.00392752     0.067199        100    
reco:opdec:Deconvolution                               0.0657001     0.278377      0.459407      0.277113      0.0720583       100    
reco:ophitspe:OpHitFinderDeco                          0.140731       2.16741       4.18007       2.11927      0.816021        100    
reco:opflash:OpFlashFinder                            0.000141712   0.00150054    0.00459378    0.00145008    0.000651375      100    
reco:rns:RandomNumberSaver                             2.035e-05    4.23061e-05   0.000285053   3.9996e-05    2.68644e-05      100    
reco:anglereconue:NuAngularReco                       0.000192882   0.00102303     0.0221796    0.00047286    0.00227013       100    
reco:anglereconumu:NuAngularReco                      8.5941e-05    0.000820978    0.0212548    0.000253363   0.00223145       100    
reco:anglereconuepfps:NuAngularReco                   0.000139041   0.000946275    0.0219359    0.000392674   0.00223556       100    
reco:anglereconumupfps:NuAngularReco                  0.000110851   0.00085168     0.0213199    0.000316023   0.00217985       100    
[art]:TriggerResults:TriggerResultInserter             8.39e-06     1.36976e-05    4.687e-05    1.25255e-05   4.96019e-06      100    
end_path:out1:RootOutput                               3.041e-06    6.3815e-06     1.694e-05     6.25e-06     2.26687e-06      100    
end_path:out1:RootOutput(write)                        0.0115092     0.250424       1.08392      0.266315      0.146586        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21768.2 MB
  Peak resident set size usage (VmHWM): 2329.31 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2_reco_2024-11-23T_043501Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50604274_194_20231207T004558Z_gen_g4_detsim_hitreco__20240510T044516Z_reco2_reco_data_2024-11-23T_043501Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:45:24 UTC       justIN version: 01.01.09