justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 87069.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID87069.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3836
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-10-26 03:54:32
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2024-10-26 07:35:36
From worker nodeHostnamemff-magic17.farm.particle.cz
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-26 03:55:15
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2.root
JobscriptExit code0
Real time3h (13195s)
CPU time3h (13050s = 98%)
Outputting started2024-10-26 07:35:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2.root
Finished2024-10-26 07:35:36
Saved logsjustin-logs:87069.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3290 subRun: 1 event: 5600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
1st wire C:0 T:10 P:2 W:920 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
1st wire C:0 T:14 P:2 W:769 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:34:54 CEST run: 6413290 subRun: 1 event: 5600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 77, 271, 142
minwire 0: 1726
minwire 1: 1515
minwire 2: 1429
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0054933, 0.000813269, 0.993693, 
Output 1: 0.808371, 0.170373, 0.0157196, 0.00553608, 
Output 2: 0.861648, 0.138352, 

566
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2034!
26-Oct-2024 09:35:09 CEST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2_reco_data_2024-10-26T_035520Z.root"
26-Oct-2024 09:35:09 CEST  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/b7/88/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.121863       130.342       8156.42       14.1325       814.254        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00194037     0.0171669     0.0682789     0.0155962     0.0086012       100    
reco:linecluster:LineCluster                          0.00269958      1.54804       113.186      0.0463074      11.3663        100    
reco:trajcluster:TrajCluster                          0.00149978      7.86109       554.822      0.0149848      55.8017        100    
reco:pandora:StandardPandora                           0.0211625      51.2283       4675.13       2.37445       464.836        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000187519    0.0273851      1.61299     0.00236827     0.161747        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000327935    0.019808      0.414876     0.00456953     0.0522192       100    
reco:pandoracalo:Calorimetry                          0.00013102     0.177898       13.1691     0.00160694      1.31554        100    
reco:pandorapid:Chi2ParticleID                        5.0468e-05    0.000273477   0.00239384    0.000195345   0.000333062      100    
reco:trkshowersplit:TrackShowerHits                   0.000131023    0.125281       7.66258     0.000905911    0.778657        100    
reco:pmtrack:PMAlgTrackMaker                          0.00153721      9.6635        516.721      0.288894       52.7264        100    
reco:pmtrackcalo:Calorimetry                          0.000102072    0.0875669      6.88691     0.00147778     0.685504        100    
reco:pmtrackpid:Chi2ParticleID                        4.1472e-05    0.000676753    0.018677     0.000209401   0.00198099       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000371563     6.61667       277.712      0.417606       29.8988        100    
reco:pmtrajfitcalo:Calorimetry                        0.000138375    0.198827       15.0434      0.0021511      1.5016         100    
reco:pmtrajfitpid:Chi2ParticleID                      5.8712e-05    0.00032482    0.00212973    0.000226079   0.000345049      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00163776      12.9034       692.619      0.306535       71.0922        100    
reco:pmtracktccalo:Calorimetry                        0.000118011    0.029889       1.89944     0.00140756     0.189828        100    
reco:pmtracktcpid:Chi2ParticleID                       4.733e-05    0.000548562    0.0104665    0.000213841   0.00118832       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00034179      6.25238       367.347      0.406021       36.8633        100    
reco:pmtrajfittccalo:Calorimetry                      0.000130971    0.114303       8.76671     0.00160592     0.873553        100    
reco:pmtrajfittcpid:Chi2ParticleID                    5.8263e-05    0.000679334    0.0111121    0.000251868   0.00139155       100    
reco:blurredcluster:BlurredClustering                 0.00012416      1.82451       30.6313      0.770392       3.54458        100    
reco:emtrkmichelid:EmTrackMichelId                    0.00019901      26.7387       825.912       4.6495        89.3314        100    
reco:emshower:EMShower                                0.000307572    0.0857762      1.72284      0.0137124     0.205734        100    
reco:cvnmap:CVNMapper                                 3.0234e-05     0.0175088     0.105233       0.01861      0.0152784       100    
reco:cvneva:CVNEvaluator                              2.2013e-05      1.11732       2.61045       1.48261      0.719563        100    
reco:energyrecnumu:EnergyReco                         0.000406184    0.191276       10.8349     0.00702675      1.11426        100    
reco:energyrecnue:EnergyReco                          0.000188991    0.0110657     0.689993     0.000876511    0.0689251       100    
reco:energyrecnc:EnergyReco                           0.00265413     0.0139649     0.675821     0.00431368     0.0671681       100    
reco:energyrecnumurange:EnergyReco                    0.000383294    0.156756       8.22262     0.00379734     0.859229        100    
reco:energyrecnumumcs:EnergyReco                      0.00265225     0.156469       8.43963     0.00497549     0.871201        100    
reco:opdec:Deconvolution                               0.0189181     0.282053      0.594039      0.258184      0.125183        100    
reco:ophitspe:OpHitFinderDeco                         0.00378089      2.3771        5.64833       2.23969       1.14666        100    
reco:opflash:OpFlashFinder                            0.000183217   0.00221424    0.00547493    0.00197032    0.00117385       100    
reco:rns:RandomNumberSaver                            2.0729e-05    4.55358e-05   0.000466295   4.11165e-05   4.40392e-05      100    
reco:anglereconue:NuAngularReco                       0.000169011   0.00868198     0.596689     0.000523347    0.0595312       100    
reco:anglereconumu:NuAngularReco                      9.8959e-05    0.00843852     0.593784     0.000381467    0.0592531       100    
reco:anglereconuepfps:NuAngularReco                   0.000155742   0.00858429     0.589461     0.000504633    0.0588036       100    
reco:anglereconumupfps:NuAngularReco                  0.000145795   0.00863443     0.599206     0.000482871    0.0597779       100    
[art]:TriggerResults:TriggerResultInserter            1.3523e-05    2.18123e-05   9.0933e-05    1.9875e-05    9.59489e-06      100    
end_path:out1:RootOutput                               3.021e-06    7.50934e-06   2.2867e-05     7.77e-06     3.17052e-06      100    
end_path:out1:RootOutput(write)                        0.0168717     0.456522       4.90616      0.408364      0.540379        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 10149.2 MB
  Peak resident set size usage (VmHWM): 2952.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2_reco_2024-10-26T_035520Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6413290_55_20231202T195852Z_gen_g4_detsim_hitreco__20240508T062216Z_reco2_reco_data_2024-10-26T_035520Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 09:53:48 UTC       justIN version: 01.01.09