justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 87044.79@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID87044.79@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3836
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-10-26 01:43:45
SiteCZ_FZU
EntryNova_CZ_FZU_osgce1
Last heartbeat2024-10-26 07:15:45
From worker nodeHostnamemikan17.farm.particle.cz
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-26 02:43:22
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2.root
JobscriptExit code0
Real time4h (16312s)
CPU time4h (16156s = 99%)
Outputting started2024-10-26 07:15:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2.root
Finished2024-10-26 07:15:45
Saved logsjustin-logs:87044.79-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

s in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 09:13:58 CEST run: 6171714 subRun: 1 event: 86200
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 1301, 1286, 1355
minwire 0: 1657
minwire 1: 1106
minwire 2: 1187
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0225267, 0.0865735, 0.8909, 
Output 1: 0.195278, 0.736987, 0.0638716, 0.00386344, 
Output 2: 0.0477818, 0.952218, 

751
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3229!
26-Oct-2024 09:15:12 CEST  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2_reco_data_2024-10-26T_024327Z.root"
26-Oct-2024 09:15:12 CEST  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/9f/c1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.108865       80.6389       2539.31       17.4854       233.606        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00217336     0.0317664     0.486825      0.0212603     0.0535523       200    
reco:linecluster:LineCluster                          0.00215236      1.2966        95.3205      0.052283       7.66416        200    
reco:trajcluster:TrajCluster                          0.00141909      4.67591       289.077      0.0253229      24.0609        200    
reco:pandora:StandardPandora                           0.0251358      6.38302       167.292       2.49996       17.6748        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000183811    0.0234334     0.652652     0.00340289     0.0705282       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000236515    0.0224352     0.225735     0.00537385     0.0408629       200    
reco:pandoracalo:Calorimetry                          0.000133592    0.0878375      2.7629      0.00195361     0.327588        200    
reco:pandorapid:Chi2ParticleID                        5.2451e-05    0.000393288    0.0104771    0.000262985   0.000791659      200    
reco:trkshowersplit:TrackShowerHits                   0.000122102    0.0834856      2.89669     0.00164332     0.315523        200    
reco:pmtrack:PMAlgTrackMaker                          0.00165986      7.92572       191.337      0.378227       25.3603        200    
reco:pmtrackcalo:Calorimetry                          0.000108748    0.0454619      1.56191     0.00181438     0.181229        200    
reco:pmtrackpid:Chi2ParticleID                        4.6881e-05    0.000754146   0.00914707    0.000297857   0.00127943       200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000305785     10.5384       1011.08      0.580744       72.8361        200    
reco:pmtrajfitcalo:Calorimetry                        0.000101345     0.08947       2.81221     0.00300486     0.331554        200    
reco:pmtrajfitpid:Chi2ParticleID                      4.7057e-05    0.000402935   0.00208931    0.000287942   0.000368188      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00135681       10.21        304.412      0.541758       35.5059        200    
reco:pmtracktccalo:Calorimetry                        0.000103856    0.0246168     0.707084     0.00212307     0.0782232       200    
reco:pmtracktcpid:Chi2ParticleID                      4.6701e-05    0.000851202    0.0332133    0.000302401   0.00275223       200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.00028616      4.30776       86.1847       0.6173        10.9713        200    
reco:pmtrajfittccalo:Calorimetry                      9.8503e-05     0.0643616      2.1243      0.00264131     0.220221        200    
reco:pmtrajfittcpid:Chi2ParticleID                    4.2577e-05    0.000913888   0.00953453    0.00035256    0.00143916       200    
reco:blurredcluster:BlurredClustering                 0.000134037     1.85425       13.1267      0.818974       2.41823        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000212781     27.908        371.106       6.50891       56.1689        200    
reco:emshower:EMShower                                0.000322247    0.0790464      1.07177      0.0210675     0.140734        200    
reco:cvnmap:CVNMapper                                 3.6364e-05     0.0248113     0.101637      0.0275487     0.0197552       200    
reco:cvneva:CVNEvaluator                              2.3617e-05      1.12917       2.41973       1.40171      0.754402        200    
reco:energyrecnumu:EnergyReco                         0.000438343    0.206535       11.2603      0.0100658      1.03707        200    
reco:energyrecnue:EnergyReco                          0.000205672   0.00709332     0.186524     0.00141916     0.019803        200    
reco:energyrecnc:EnergyReco                           0.00263807    0.00998786     0.194504     0.00440652     0.020008        200    
reco:energyrecnumurange:EnergyReco                    0.00034035     0.205504       12.7137     0.00394847      1.11203        200    
reco:energyrecnumumcs:EnergyReco                      0.00204656     0.206296       12.2942     0.00608281      1.0867         200    
reco:opdec:Deconvolution                              0.00766878     0.287699      0.721983      0.284066      0.128783        200    
reco:ophitspe:OpHitFinderDeco                         0.00336148      2.40526       4.89736       2.43125       1.15452        200    
reco:opflash:OpFlashFinder                            0.000208957   0.00267859     0.0090935    0.00250593    0.00143258       200    
reco:rns:RandomNumberSaver                            2.1627e-05    5.89149e-05   0.000418409   5.4573e-05    4.08546e-05      200    
reco:anglereconue:NuAngularReco                       0.000200627   0.00604825     0.176335     0.000787215    0.0180906       200    
reco:anglereconumu:NuAngularReco                      0.000121825   0.00547627     0.171433     0.000525245    0.0176662       200    
reco:anglereconuepfps:NuAngularReco                   0.000190585   0.00572902     0.180756     0.000754462    0.0179869       200    
reco:anglereconumupfps:NuAngularReco                  0.000171718   0.00565829     0.181192     0.000678632    0.0179365       200    
[art]:TriggerResults:TriggerResultInserter            1.2254e-05     2.369e-05    9.4635e-05    2.35255e-05   8.21102e-06      200    
end_path:out1:RootOutput                               2.704e-06    8.35173e-06   2.5027e-05     8.85e-06     3.27566e-06      200    
end_path:out1:RootOutput(write)                        0.0170718     0.472735       2.59578       0.43739      0.394459        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 10782.7 MB
  Peak resident set size usage (VmHWM): 2468.45 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2_reco_2024-10-26T_024327Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6171714_430_20231118T092506Z_gen_g4_detsim_hitreco__20240503T052047Z_reco2_reco_data_2024-10-26T_024327Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 09:30:24 UTC       justIN version: 01.01.09