justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.160@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.160@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:20
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-22 23:45:00
From worker nodeHostnameb9p07p1853.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:10:27
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2.root
JobscriptExit code0
Real time29m (1773s)
CPU time29m (1779s = 100%)
Outputting started2024-11-22 23:40:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2.root
Finished2024-11-22 23:45:00
Saved logsjustin-logs:301452.160-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ucedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:39:56 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:39:57 CET run: 6457551 subRun: 1 event: 26600
Comparing two wires in the same plane: return failure
%MSG
246
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 663!
23-Nov-2024 00:39:59 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2_reco_data_2024-11-22T_231032Z.root"
23-Nov-2024 00:39:59 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/f7/f4/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.79965       15.6739       87.5923       10.1085       16.084         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0177825     0.0428743      0.29335      0.0411283     0.0272502       100    
reco:linecluster:LineCluster                           0.150919      0.187569      0.365401      0.174048      0.0441697       100    
reco:trajcluster:TrajCluster                           0.0476062     0.169581       1.93938      0.0600652     0.296631        100    
reco:pandora:StandardPandora                           0.925728       1.55998       24.0302        1.276        2.29242        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000141752   0.00327099     0.0339394    0.00160399    0.00485688       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000176983   0.00789014     0.0574868    0.00265401     0.0121238       100    
reco:pandoracalo:Calorimetry                          0.000105661    0.0051823     0.0560216    0.00109695    0.00994282       100    
reco:pandorapid:Chi2ParticleID                         4.271e-05    0.000142811   0.000461437   0.000129356   7.88903e-05      100    
reco:trkshowersplit:TrackShowerHits                   8.6562e-05    0.00685075     0.103698     0.000769926    0.016164        100    
reco:pmtrack:PMAlgTrackMaker                          0.00119014     0.968562       10.8127      0.175144       1.74035        100    
reco:pmtrackcalo:Calorimetry                          6.7291e-05    0.00290877     0.0264391    0.000748809   0.00509857       100    
reco:pmtrackpid:Chi2ParticleID                         2.502e-05    0.000207434   0.000819591   0.000140067   0.000193558      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000168752    0.850307       9.59255      0.313132       1.35926        100    
reco:pmtrajfitcalo:Calorimetry                         5.487e-05    0.00514652     0.055734     0.00137399    0.00842618       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.34e-05     0.000173182   0.000671509   0.000152987   0.000122919      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00100262      1.14849       10.0266      0.227797       2.11465        100    
reco:pmtracktccalo:Calorimetry                         6.202e-05    0.00256544     0.0183278    0.000861071   0.00388455       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7271e-05    0.000192985   0.000768041   0.000139432   0.000156447      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000156062    0.748332       4.90336      0.238009       1.07493        100    
reco:pmtrajfittccalo:Calorimetry                       5.789e-05    0.00408796     0.0498009    0.00113684    0.00724707       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.329e-05    0.000240037    0.0010904    0.000149452   0.000222573      100    
reco:blurredcluster:BlurredClustering                 0.00436657      0.77084       4.62835       0.39608       0.96155        100    
reco:emtrkmichelid:EmTrackMichelId                     0.117684       6.06767       38.7782       2.48075       8.06632        100    
reco:emshower:EMShower                                0.000256983    0.0195281      0.15675      0.0034457     0.0315524       100    
reco:cvnmap:CVNMapper                                  2.32e-05      0.0121498     0.0327422     0.0154946      0.00861        100    
reco:cvneva:CVNEvaluator                               1.663e-05     0.664019       1.19908       0.86503      0.431982        100    
reco:energyrecnumu:EnergyReco                         0.000345984    0.0185818     0.248158     0.00414612     0.0478301       100    
reco:energyrecnue:EnergyReco                          0.000121102   0.00128061     0.0112399    0.000593333   0.00158323       100    
reco:energyrecnc:EnergyReco                           0.00141352    0.00341301     0.0146825    0.00294702    0.00176748       100    
reco:energyrecnumurange:EnergyReco                    0.000168822    0.0171157     0.243106      0.0026016     0.0482612       100    
reco:energyrecnumumcs:EnergyReco                      0.000942602    0.0183292     0.251459     0.00322291     0.0470345       100    
reco:opdec:Deconvolution                               0.0569049     0.266366      0.443668      0.276351      0.0787164       100    
reco:ophitspe:OpHitFinderDeco                          0.194817       1.8684        3.88813       1.85733       0.78311        100    
reco:opflash:OpFlashFinder                            0.000190032   0.00150209    0.00452224    0.00139191    0.000655043      100    
reco:rns:RandomNumberSaver                             2.53e-05     4.13962e-05   0.000354155   3.67805e-05   3.22176e-05      100    
reco:anglereconue:NuAngularReco                       0.000144492   0.000954054    0.0113693    0.000491997   0.00136346       100    
reco:anglereconumu:NuAngularReco                      6.9351e-05    0.000676361    0.0111321    0.000224638   0.00132453       100    
reco:anglereconuepfps:NuAngularReco                   0.000122042    0.0008489     0.0112769    0.000420576   0.00132948       100    
reco:anglereconumupfps:NuAngularReco                  9.5182e-05    0.000732653    0.0112545    0.000277844   0.00132333       100    
[art]:TriggerResults:TriggerResultInserter             8.58e-06     1.36371e-05   5.4861e-05    1.2895e-05    5.03374e-06      100    
end_path:out1:RootOutput                               4.94e-06     7.74699e-06   2.6091e-05     7.23e-06     3.39669e-06      100    
end_path:out1:RootOutput(write)                        0.0115996      0.22495      0.578867      0.245754      0.131236        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21450.6 MB
  Peak resident set size usage (VmHWM): 2012.41 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2_reco_2024-11-22T_231032Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6457551_265_20231207T143443Z_gen_g4_detsim_hitreco__20240510T060744Z_reco2_reco_data_2024-11-22T_231032Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:25:35 UTC       justIN version: 01.01.09