justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.99@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.99@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:19:02
From worker nodeHostnameb9p11p1596.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:21
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2.root
JobscriptExit code0
Real time49m (2947s)
CPU time40m (2431s = 82%)
Outputting started2024-11-23 00:12:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2.root
Finished2024-11-23 00:19:02
Saved logsjustin-logs:301491.99-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
1st wire C:0 T:0 P:2 W:565 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:12:20 CET run: 50579427 subRun: 1 event: 36700
Cannot attach back to inner node of other track.
%MSG
Boundary wire vector sizes: 195, 295, 182
minwire 0: 170
minwire 1: 2411
minwire 2: 6
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00420471, 0.00023387, 0.995561, 
Output 1: 0.0672974, 0.921159, 0.010668, 0.00087602, 
Output 2: 0.967853, 0.0321465, 

322
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 908!
23-Nov-2024 01:12:27 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2_reco_data_2024-11-22T_233221Z.root"
23-Nov-2024 01:12:27 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/c0/bc/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.56602       21.9431       235.394       9.47034       40.7594        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0180363     0.0428262     0.097978      0.0407677     0.0138718       100    
reco:linecluster:LineCluster                           0.0947997     0.349818       7.80415      0.180621      0.970945        100    
reco:trajcluster:TrajCluster                           0.0474164     0.538828       14.9487      0.0627801      2.0984         100    
reco:pandora:StandardPandora                           0.0572492      2.48253       87.7278       1.19284       8.78232        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000147331   0.00428521     0.0477271    0.00151825    0.00843366       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000204591   0.00881821     0.0938315    0.00356557     0.0150295       100    
reco:pandoracalo:Calorimetry                          0.000135451    0.0124949     0.301902     0.00110385     0.0438506       100    
reco:pandorapid:Chi2ParticleID                        4.3831e-05    0.000163512   0.000989226   0.000138781   0.000119105      100    
reco:trkshowersplit:TrackShowerHits                    8.795e-05     0.0189054      0.4545      0.000834315    0.0724361       100    
reco:pmtrack:PMAlgTrackMaker                          0.00116851      1.90195       37.3679      0.249678       5.9982         100    
reco:pmtrackcalo:Calorimetry                           6.82e-05     0.00560388     0.139006     0.000936641    0.0178934       100    
reco:pmtrackpid:Chi2ParticleID                         2.697e-05    0.000236082   0.00210424    0.000152691   0.000308748      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000222141     1.32411       22.8866      0.295085       3.25217        100    
reco:pmtrajfitcalo:Calorimetry                        6.8101e-05     0.0136229     0.324301     0.00153803     0.0487689       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.614e-05    0.000188882   0.000928675   0.000154151   0.000160362      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000893595     2.49085       50.9623      0.253474       8.01535        100    
reco:pmtracktccalo:Calorimetry                         6.521e-05    0.00418199     0.0602551    0.00107874    0.00971282       100    
reco:pmtracktcpid:Chi2ParticleID                      2.6691e-05    0.000237956   0.00122936    0.000159216   0.000257109      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000167321     1.10221       13.397       0.319034       2.49856        100    
reco:pmtrajfittccalo:Calorimetry                       5.696e-05    0.00962044     0.167499     0.00121082     0.0295545       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.518e-05    0.000321149   0.00295155    0.000163526   0.000491888      100    
reco:blurredcluster:BlurredClustering                 0.000122971    0.936131       7.42481      0.478241       1.32466        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000150511     7.55643       75.2691       2.93375       14.4603        100    
reco:emshower:EMShower                                0.000196192    0.0233979      0.21545     0.00343878     0.0386603       100    
reco:cvnmap:CVNMapper                                  2.603e-05     0.0112166     0.0417983     0.0127349    0.00869737       100    
reco:cvneva:CVNEvaluator                               1.721e-05     0.681389       1.15571      0.837826      0.393494        100    
reco:energyrecnumu:EnergyReco                         0.000417082    0.0238634      1.03778     0.00414275     0.110244        100    
reco:energyrecnue:EnergyReco                          0.000127391   0.00138411     0.0167727    0.000558193   0.00268409       100    
reco:energyrecnc:EnergyReco                           0.00155338    0.00352537     0.0196335    0.00307882    0.00276752       100    
reco:energyrecnumurange:EnergyReco                    0.00016262     0.022964       1.12992     0.00258097     0.120125        100    
reco:energyrecnumumcs:EnergyReco                      0.00144676     0.0219188     0.805612     0.00363792     0.0949047       100    
reco:opdec:Deconvolution                               0.0703766     0.286265      0.471941      0.295154      0.0865024       100    
reco:ophitspe:OpHitFinderDeco                          0.142428       1.82307       3.7334        1.80566      0.702846        100    
reco:opflash:OpFlashFinder                            9.5661e-05    0.00148184    0.00518169    0.00140651    0.00067886       100    
reco:rns:RandomNumberSaver                             2.002e-05    4.76623e-05   0.000411142   4.4235e-05    3.80517e-05      100    
reco:anglereconue:NuAngularReco                       0.000187031   0.00118089     0.0194559    0.000493888   0.00252505       100    
reco:anglereconumu:NuAngularReco                       8.086e-05    0.000921224    0.0186966    0.000269111   0.00242852       100    
reco:anglereconuepfps:NuAngularReco                   0.000125601   0.00107019     0.0189742    0.000424072    0.0024113       100    
reco:anglereconumupfps:NuAngularReco                  0.000101041   0.000990483    0.0188764    0.000311892   0.00247368       100    
[art]:TriggerResults:TriggerResultInserter             8.37e-06     1.37561e-05    4.609e-05     1.236e-05    5.62199e-06      100    
end_path:out1:RootOutput                               3.31e-06     7.76275e-06   3.2571e-05     7.68e-06     3.37539e-06      100    
end_path:out1:RootOutput(write)                        0.0118897     0.231984       0.86727      0.235222      0.145409        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21867.3 MB
  Peak resident set size usage (VmHWM): 2418.91 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2_reco_2024-11-22T_233221Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50579427_366_20231204T044142Z_gen_g4_detsim_hitreco__20240509T204129Z_reco2_reco_data_2024-11-22T_233221Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:53:45 UTC       justIN version: 01.01.09