justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.120@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.120@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:18:41
From worker nodeHostnameb9p05p6356.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:58
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2.root
JobscriptExit code0
Real time45m (2753s)
CPU time36m (2168s = 78%)
Outputting started2024-11-23 00:09:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2.root
Finished2024-11-23 00:18:41
Saved logsjustin-logs:301491.120-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:09:43 CET run: 74517882 subRun: 1 event: 44899
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:09:43 CET run: 74517882 subRun: 1 event: 44899
Comparing two wires in the same plane: return failure
%MSG
377
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1176!
Begin processing the 100th record. run: 74517882 subRun: 1 event: 44900 at 23-Nov-2024 01:09:47 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 01:09:48 CET run: 74517882 subRun: 1 event: 44900
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 01:09:48 CET run: 74517882 subRun: 1 event: 44900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:09:48 CET run: 74517882 subRun: 1 event: 44900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:09:48 CET run: 74517882 subRun: 1 event: 44900
Comparing two wires in the same plane: return failure
%MSG
146
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 191!
23-Nov-2024 01:09:51 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2_reco_data_2024-11-22T_233226Z.root"
23-Nov-2024 01:09:51 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/f7/22/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.550337       19.9454       313.152       9.80241       35.9587        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0172997     0.0414297     0.128509      0.0409323     0.0139971       100    
reco:linecluster:LineCluster                           0.0947642     0.305762       10.2037       0.17568       1.00226        100    
reco:trajcluster:TrajCluster                           0.0479506     0.368836       16.0772      0.0600692      1.64119        100    
reco:pandora:StandardPandora                           0.0615659      2.0539        45.8044       1.30941       4.78013        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00013178    0.00393045     0.0591837    0.00152491    0.00744025       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000199992    0.0076785     0.0655504     0.0033103     0.0115167       100    
reco:pandoracalo:Calorimetry                          0.00011741     0.0114402     0.560109     0.00106674     0.0568271       100    
reco:pandorapid:Chi2ParticleID                        4.5411e-05    0.000182529   0.00204085    0.000134986   0.000209818      100    
reco:trkshowersplit:TrackShowerHits                   0.000109231    0.0125151     0.457483     0.000790294    0.0504208       100    
reco:pmtrack:PMAlgTrackMaker                           0.0010615      1.62301       55.8612      0.196623       5.92669        100    
reco:pmtrackcalo:Calorimetry                           6.586e-05    0.00440884     0.0866573    0.00096791     0.0109904       100    
reco:pmtrackpid:Chi2ParticleID                         2.626e-05    0.000232784   0.00150987    0.000146186   0.000271008      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000183191     1.31577       24.4833      0.354715       2.88869        100    
reco:pmtrajfitcalo:Calorimetry                         6.174e-05     0.0113049     0.494562     0.00158889     0.0503503       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.813e-05    0.00018876    0.000598523   0.000162841   0.000131366      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000830565     1.90118       66.1487      0.194964       6.97221        100    
reco:pmtracktccalo:Calorimetry                         6.334e-05    0.00406103     0.0842246    0.000937325   0.00980499       100    
reco:pmtracktcpid:Chi2ParticleID                       2.79e-05     0.000254074   0.00206721    0.000160661   0.00027906       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000176201     1.07824       20.9252      0.265828       2.48195        100    
reco:pmtrajfittccalo:Calorimetry                       6.209e-05    0.00688157     0.189236     0.00108018     0.021004        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5161e-05    0.000297988   0.00210589    0.000172136   0.000355309      100    
reco:blurredcluster:BlurredClustering                 0.000148391    0.937996       6.0031       0.646696       1.06011        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000155601     7.10307       87.7418       2.69042       12.1954        100    
reco:emshower:EMShower                                0.000206711    0.0301344     0.220375      0.006222      0.0450897       100    
reco:cvnmap:CVNMapper                                  2.312e-05     0.0109822     0.0346747     0.0144553    0.00839751       100    
reco:cvneva:CVNEvaluator                              2.1781e-05     0.669087       2.14147      0.919638       0.48812        100    
reco:energyrecnumu:EnergyReco                         0.000420172    0.0282881      0.48041     0.00406883     0.0735491       100    
reco:energyrecnue:EnergyReco                          0.000132811   0.00155159     0.0153983    0.000698419   0.00216844       100    
reco:energyrecnc:EnergyReco                            0.0016958    0.00383691     0.0209418    0.00330114    0.00252075       100    
reco:energyrecnumurange:EnergyReco                    0.000146721    0.0258488     0.469635     0.00309145     0.069845        100    
reco:energyrecnumumcs:EnergyReco                      0.000965555    0.0260449     0.363808     0.00340452     0.0633436       100    
reco:opdec:Deconvolution                               0.048653       0.26951      0.557433      0.271862      0.0925374       100    
reco:ophitspe:OpHitFinderDeco                          0.150431       1.85652       4.4833        1.88801      0.838903        100    
reco:opflash:OpFlashFinder                            0.000326312   0.00157707    0.00527708    0.00151853    0.000748482      100    
reco:rns:RandomNumberSaver                             2.354e-05    5.20467e-05   0.000321012    4.707e-05    2.99719e-05      100    
reco:anglereconue:NuAngularReco                       0.000182631   0.00106744     0.012946     0.000536828   0.00168879       100    
reco:anglereconumu:NuAngularReco                       8.391e-05    0.000735964    0.0117609    0.000256337   0.00153025       100    
reco:anglereconuepfps:NuAngularReco                   0.000145041   0.000931451    0.0120878    0.000460187   0.00158183       100    
reco:anglereconumupfps:NuAngularReco                  0.000124671   0.000825799    0.0146195    0.000309327   0.00175319       100    
[art]:TriggerResults:TriggerResultInserter             9.19e-06     1.44687e-05   3.8041e-05    1.3995e-05    3.51116e-06      100    
end_path:out1:RootOutput                               3.65e-06     8.60522e-06    2.293e-05     8.15e-06     2.9852e-06       100    
end_path:out1:RootOutput(write)                        0.0131702     0.223651      0.961993      0.242549      0.154048        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21543.7 MB
  Peak resident set size usage (VmHWM): 2096.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2_reco_2024-11-22T_233226Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_448_20231204T140345Z_gen_g4_detsim_hitreco__20240509T194650Z_reco2_reco_data_2024-11-22T_233226Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:17:46 UTC       justIN version: 01.01.09