justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108793.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108793.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 05:21:12
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2024-11-23 06:13:23
From worker nodeHostnameb9p05p7407.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 05:22:23
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2.root
JobscriptExit code0
Real time50m (3042s)
CPU time52m (3142s = 103%)
Outputting started2024-11-23 06:13:05
Output files
Finished2024-11-23 06:13:23
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

:   x: -0.0143017  y: 0.18598  z: 0.368817 length: 0.413302
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.07125, Dist. 12.7586, nMCHits 70 (16, 29, 25)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 70 (16, 29, 25), nPfoHits 70 (16, 29, 25)

------------------------------------------------------------------------------------------------

---INTERPRETED-MATCHING-OUTPUT------------------(my version)-----------------------------------------
Found: 2212 with KE=0.132978 GeV, E=1.07125 GeV, p2=0.267222
NCQEL_P (Nuance 1002, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 14
Neutrino Energy: 0.4133
Neutrino Momentum:   x: -0.0143017  y: 0.18598  z: 0.368817 length: 0.413302
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.07125, Dist. 12.7586, nMCHits 70 (16, 29, 25)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 70 (16, 29, 25), nPfoHits 70 (16, 29, 25)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.132978 GeV, E=1.07125 GeV, p2=0.267222
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 07:13:00 CET run: 66009532 subRun: 1 event: 57800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 07:13:00 CET run: 66009532 subRun: 1 event: 57800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 07:13:00 CET run: 66009532 subRun: 1 event: 57800
Comparing two wires in the same plane: return failure
%MSG
334
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 974!
23-Nov-2024 07:13:04 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2_reco_data_2024-11-23T_052228Z.root"
23-Nov-2024 07:13:04 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/86/a0/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.55328       28.3635       457.49        8.56164       70.4728        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0175561     0.0392165     0.0731326     0.0370231     0.0125689       100    
reco:linecluster:LineCluster                           0.102269      0.643317       22.228       0.171043       2.92437        100    
reco:trajcluster:TrajCluster                           0.050838       1.18948       47.9761      0.0596868      5.87315        100    
reco:pandora:StandardPandora                           0.0615679      2.17689       39.7888       1.23153       4.48774        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000151184   0.00633353     0.102589     0.00119243     0.0165333       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000218795    0.010521      0.157723      0.002579      0.0232127       100    
reco:pandoracalo:Calorimetry                          0.000115473    0.0222308     0.769213     0.000867675    0.0965125       100    
reco:pandorapid:Chi2ParticleID                        4.7021e-05    0.000175313   0.00126058    0.000116828   0.000180838      100    
reco:trkshowersplit:TrackShowerHits                   9.2342e-05     0.0330399      1.29748     0.00061281     0.149933        100    
reco:pmtrack:PMAlgTrackMaker                          0.000942563     3.34342       100.209      0.158433       13.123         100    
reco:pmtrackcalo:Calorimetry                          6.0002e-05     0.0112761      0.26813     0.000710587    0.0398465       100    
reco:pmtrackpid:Chi2ParticleID                        2.3991e-05    0.000297639   0.00272377    0.000137073   0.000498895      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000211085     1.99682       44.2063      0.158439       6.06929        100    
reco:pmtrajfitcalo:Calorimetry                        7.5722e-05     0.0182615     0.523921     0.00115267     0.0718417       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.014e-05    0.000182246    0.0011657    0.000124978   0.000179474      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00101176      3.67116       89.5567      0.175625       13.0787        100    
reco:pmtracktccalo:Calorimetry                        8.0242e-05    0.00644311     0.104538     0.000746143    0.0179717       100    
reco:pmtracktcpid:Chi2ParticleID                      3.3311e-05    0.00024306    0.00149059    0.000120353   0.000320794      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000197095     1.5685        26.8406      0.217832       4.2128         100    
reco:pmtrajfittccalo:Calorimetry                      8.0022e-05     0.015382      0.499588     0.000877906    0.0591122       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.3331e-05    0.000339085   0.00418671    0.000134418   0.000587362      100    
reco:blurredcluster:BlurredClustering                 0.000149974    0.879662       6.91247      0.360843       1.27271        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000126303     9.35404       121.669       2.0037        20.7972        100    
reco:emshower:EMShower                                0.000191164    0.0276555     0.265722     0.00400143     0.0533345       100    
reco:cvnmap:CVNMapper                                 1.9601e-05     0.0113442     0.0468246     0.0126172    0.00975269       100    
reco:cvneva:CVNEvaluator                               1.616e-05     0.660295       1.31997      0.822513      0.428708        100    
reco:energyrecnumu:EnergyReco                         0.000305858    0.0645091      1.67142     0.00379271     0.227582        100    
reco:energyrecnue:EnergyReco                          0.000114233   0.00203951     0.0381739    0.000414255   0.00495089       100    
reco:energyrecnc:EnergyReco                           0.00163791     0.0044688     0.0453596    0.00309455    0.00552552       100    
reco:energyrecnumurange:EnergyReco                    0.000138723    0.0619397      1.5156      0.00221425     0.223763        100    
reco:energyrecnumumcs:EnergyReco                      0.000708606    0.0619022      1.56506     0.00330515     0.216553        100    
reco:opdec:Deconvolution                               0.0540646     0.271947      0.453383      0.269766      0.0820456       100    
reco:ophitspe:OpHitFinderDeco                           0.15238       1.96658       4.92427       1.83946      0.891213        100    
reco:opflash:OpFlashFinder                            0.000191605   0.00140771    0.00463713    0.00127852    0.000689521      100    
reco:rns:RandomNumberSaver                             1.775e-05    4.32335e-05   0.000370108   3.9111e-05    3.50415e-05      100    
reco:anglereconue:NuAngularReco                       0.000170224   0.00180846     0.0357659    0.000367193   0.00509649       100    
reco:anglereconumu:NuAngularReco                      7.1082e-05    0.00157159     0.0365541    0.000170694   0.00505957       100    
reco:anglereconuepfps:NuAngularReco                   0.000130823    0.0017585     0.0368742    0.000327608   0.00512347       100    
reco:anglereconumupfps:NuAngularReco                  8.4672e-05    0.00166783     0.0367263    0.000238316   0.00510828       100    
[art]:TriggerResults:TriggerResultInserter             8.06e-06     1.30692e-05   4.4632e-05    1.20555e-05   5.09145e-06      100    
end_path:out1:RootOutput                               2.77e-06     6.94226e-06    2.372e-05    6.6555e-06    3.60533e-06      100    
end_path:out1:RootOutput(write)                        0.0105752     0.233197       1.05336      0.219309      0.185491        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21708.6 MB
  Peak resident set size usage (VmHWM): 2275.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2_reco_2024-11-23T_052228Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66009532_577_20231203T233555Z_gen_g4_detsim_hitreco__20240509T210002Z_reco2_reco_data_2024-11-23T_052228Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:21:46 UTC       justIN version: 01.01.09