justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.115@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.115@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:26:29
From worker nodeHostnameb9p09p0373.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:22
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2.root
JobscriptExit code0
Real time53m (3232s)
CPU time43m (2584s = 79%)
Outputting started2024-11-23 00:17:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2.root
Finished2024-11-23 00:26:29
Saved logsjustin-logs:301491.115-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:17:10 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:17:11 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:17:11 CET run: 74517726 subRun: 1 event: 14800
Comparing two wires in the same plane: return failure
%MSG
287
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 785!
23-Nov-2024 01:17:13 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2_reco_data_2024-11-22T_233225Z.root"
23-Nov-2024 01:17:13 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/3e/e5/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.66827       24.179        232.14        10.6106       38.974         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0166602     0.0452585     0.310091      0.0413181     0.032198        100    
reco:linecluster:LineCluster                           0.148362      0.273663       3.19091      0.182139      0.379399        100    
reco:trajcluster:TrajCluster                           0.0478576     0.408714       8.08349      0.0620613      1.21677        100    
reco:pandora:StandardPandora                            1.02836       2.15191       33.2712       1.31551       3.8561         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000159412   0.00512672     0.067274     0.00144958     0.0104679       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000217042    0.0130151     0.427069     0.00293432     0.0438145       100    
reco:pandoracalo:Calorimetry                          0.000126901    0.0171259     0.493552     0.00103521     0.0583279       100    
reco:pandorapid:Chi2ParticleID                         4.398e-05    0.000180817   0.00114112    0.000147221   0.000145711      100    
reco:trkshowersplit:TrackShowerHits                   0.000149621    0.0166919     0.336768     0.00107616     0.0504331       100    
reco:pmtrack:PMAlgTrackMaker                          0.00105676      1.91664       24.8821      0.270921       4.55199        100    
reco:pmtrackcalo:Calorimetry                          6.4901e-05    0.00666923      0.15737     0.00110611     0.0193153       100    
reco:pmtrackpid:Chi2ParticleID                         2.747e-05    0.000281898   0.00222072    0.000161257   0.000360254      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000172911     2.02243       36.018       0.232997       5.34474        100    
reco:pmtrajfitcalo:Calorimetry                        7.1541e-05     0.0167196     0.488352      0.0015963     0.0571642       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.761e-05    0.000195661   0.000633466   0.000158036   0.000131964      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000832138     2.2346        33.6583      0.309765       5.57323        100    
reco:pmtracktccalo:Calorimetry                        6.2451e-05    0.00494384     0.0934995    0.00113945     0.0124513       100    
reco:pmtracktcpid:Chi2ParticleID                       2.578e-05    0.000244846   0.00143509    0.000170191   0.000250251      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000150512     1.29692       13.9373      0.371326       2.41225        100    
reco:pmtrajfittccalo:Calorimetry                       5.778e-05     0.0100501     0.174906     0.00143104     0.0271585       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.672e-05    0.000341387   0.00236587    0.000183622   0.000422411      100    
reco:blurredcluster:BlurredClustering                  0.0113338     0.949489       7.74135       0.5185        1.35092        100    
reco:emtrkmichelid:EmTrackMichelId                     0.284555       9.3751        88.4793       3.26718       16.2081        100    
reco:emshower:EMShower                                0.000312764    0.0288492     0.230616      0.0093889     0.0441527       100    
reco:cvnmap:CVNMapper                                  3.076e-05     0.012964      0.0402907     0.0160758    0.00922453       100    
reco:cvneva:CVNEvaluator                               1.947e-05     0.665859       1.1603        0.86573      0.424735        100    
reco:energyrecnumu:EnergyReco                         0.000330453    0.0306829     0.625835     0.00502972     0.0803548       100    
reco:energyrecnue:EnergyReco                          0.000123052   0.00180157     0.0216963    0.000601721   0.00334507       100    
reco:energyrecnc:EnergyReco                           0.00170842    0.00439968     0.0261363    0.00326411    0.00369406       100    
reco:energyrecnumurange:EnergyReco                    0.000130141    0.0278871     0.616394     0.00323459     0.0770951       100    
reco:energyrecnumumcs:EnergyReco                      0.00123183     0.0292286     0.601842     0.00368222     0.0767317       100    
reco:opdec:Deconvolution                               0.0895095     0.297499      0.799452      0.299173      0.103709        100    
reco:ophitspe:OpHitFinderDeco                          0.412385       2.05659       3.90844       2.0043       0.805702        100    
reco:opflash:OpFlashFinder                            0.000300083   0.00152568    0.00415576    0.00145736    0.000656104      100    
reco:rns:RandomNumberSaver                             2.023e-05    4.51641e-05   0.000339184    4.201e-05    3.12012e-05      100    
reco:anglereconue:NuAngularReco                       0.000170612    0.0012732     0.0234348    0.000486715   0.00274411       100    
reco:anglereconumu:NuAngularReco                      6.0751e-05    0.000958296    0.0169393    0.000255882   0.00225586       100    
reco:anglereconuepfps:NuAngularReco                   0.000124941   0.00106684     0.0129824    0.000406229   0.00194158       100    
reco:anglereconumupfps:NuAngularReco                  8.7641e-05    0.000959132    0.0143406    0.000296928   0.00200425       100    
[art]:TriggerResults:TriggerResultInserter             8.55e-06     1.37159e-05   4.7631e-05    1.32755e-05   4.81159e-06      100    
end_path:out1:RootOutput                                3.2e-06     6.70129e-06    2.264e-05     6.46e-06     2.04196e-06      100    
end_path:out1:RootOutput(write)                        0.0246915     0.248895      0.810245      0.271717      0.157107        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21792.4 MB
  Peak resident set size usage (VmHWM): 2341.05 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2_reco_2024-11-22T_233225Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517726_147_20231204T100341Z_gen_g4_detsim_hitreco__20240509T213611Z_reco2_reco_data_2024-11-22T_233225Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:44:31 UTC       justIN version: 01.01.09