justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108512.94@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108512.94@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:14:30
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2024-11-22 23:52:56
From worker nodeHostnametds408.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:34:09
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2.root
JobscriptExit code0
Real time1h (4187s)
CPU time1h (4131s = 98%)
Outputting started2024-11-22 23:43:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2.root
Finished2024-11-22 23:52:56
Saved logsjustin-logs:108512.94-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:43:43 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:43:43 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:43:43 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:43:43 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:43:44 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:43:45 CET run: 74481119 subRun: 1 event: 24300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 140, 201, 184
minwire 0: 2691
minwire 1: 743
minwire 2: 2520
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0363171, 0.000482375, 0.963201, 
Output 1: 0.054045, 0.553394, 0.379152, 0.0134097, 
Output 2: 0.829008, 0.170992, 

428
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1400!
23-Nov-2024 00:43:56 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2_reco_data_2024-11-22T_223415Z.root"
23-Nov-2024 00:43:56 CET  Closed input file "root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/fardet-hd/ff/c9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.714607       40.6456       762.666       10.1785       104.457        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00170446     0.0183311     0.0363996     0.020733     0.00872105       100    
reco:linecluster:LineCluster                          0.00244949     0.291798       13.4977      0.0267108      1.52437        100    
reco:trajcluster:TrajCluster                          0.00134544      2.13593       125.25       0.0123411      13.1006        100    
reco:pandora:StandardPandora                           0.0201105      3.75705       121.321       1.62025       12.976         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000136112   0.00925441     0.189616     0.00158563     0.0252725       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000181062    0.0230295     0.507432     0.00342348     0.0677086       100    
reco:pandoracalo:Calorimetry                          0.000104071    0.0209633     0.394989     0.00106822     0.0621898       100    
reco:pandorapid:Chi2ParticleID                         3.993e-05    0.000199134   0.000900682   0.000148572   0.000182199      100    
reco:trkshowersplit:TrackShowerHits                   0.000139492    0.0308361     0.882757     0.000796566    0.115086        100    
reco:pmtrack:PMAlgTrackMaker                           0.0013599      4.04734       98.2541       0.15164       13.1612        100    
reco:pmtrackcalo:Calorimetry                          7.3371e-05     0.0188306     0.577788     0.000968638    0.0720557       100    
reco:pmtrackpid:Chi2ParticleID                        2.8811e-05    0.000381068   0.00550131    0.000154312   0.000732969      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000225003     2.68369       42.4481      0.271684       6.85804        100    
reco:pmtrajfitcalo:Calorimetry                        7.0401e-05     0.025391       0.60593     0.00138854     0.0881671       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.09e-05     0.000242596   0.00200559    0.000158152   0.000286484      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00122359      5.18403       147.983      0.213158       18.4939        100    
reco:pmtracktccalo:Calorimetry                        6.9511e-05     0.0130432     0.296404     0.000950532    0.0387638       100    
reco:pmtracktcpid:Chi2ParticleID                       2.785e-05    0.000351663   0.00364565    0.000177097   0.00054542       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000236033     2.59531       54.4147      0.311391       7.73243        100    
reco:pmtrajfittccalo:Calorimetry                      8.7562e-05     0.0245753      0.76082     0.00113752     0.0989115       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.5651e-05    0.000453299   0.00570607    0.000183942   0.000810224      100    
reco:blurredcluster:BlurredClustering                 0.000132182     1.37311       13.0129      0.595013       2.10538        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000151592     14.8406       201.27        2.73117       32.4974        100    
reco:emshower:EMShower                                0.000236574    0.0456172      1.0346      0.00483028     0.128262        100    
reco:cvnmap:CVNMapper                                  2.499e-05     0.0105364     0.0532869    0.00860975     0.0108106       100    
reco:cvneva:CVNEvaluator                              1.7101e-05     0.751066       1.49412       1.08888      0.524233        100    
reco:energyrecnumu:EnergyReco                         0.000368585    0.0641074      2.8787      0.00476999      0.30062        100    
reco:energyrecnue:EnergyReco                          0.000150122   0.00352533     0.0954108    0.000729275    0.0110026       100    
reco:energyrecnc:EnergyReco                           0.00218856    0.00659761     0.102747     0.00379415     0.011736        100    
reco:energyrecnumurange:EnergyReco                    0.000253933    0.0612189      2.88197     0.00350056     0.299841        100    
reco:energyrecnumumcs:EnergyReco                      0.00131611     0.0615888      2.87484     0.00438526      0.29587        100    
reco:opdec:Deconvolution                              0.00690992     0.235885      0.524461      0.233485       0.10036        100    
reco:ophitspe:OpHitFinderDeco                          0.0302703      1.99097       4.26495       2.00031      0.905998        100    
reco:opflash:OpFlashFinder                            0.000462896   0.00163825     0.0041201    0.00160689    0.000712175      100    
reco:rns:RandomNumberSaver                             1.887e-05    3.60939e-05   0.000392495   2.80455e-05   3.87391e-05      100    
reco:anglereconue:NuAngularReco                       0.000148082   0.00240823     0.0822237    0.00037961    0.00898582       100    
reco:anglereconumu:NuAngularReco                      7.0191e-05    0.00225562     0.0825627    0.000227488   0.00905009       100    
reco:anglereconuepfps:NuAngularReco                   0.000121011   0.00242248     0.0823665    0.000351224   0.00904248       100    
reco:anglereconumupfps:NuAngularReco                  0.000103302   0.00236684     0.0829513    0.000313789   0.00911946       100    
[art]:TriggerResults:TriggerResultInserter             9.44e-06     1.4623e-05    5.5691e-05    1.3515e-05    5.50101e-06      100    
end_path:out1:RootOutput                               2.93e-06     5.72216e-06   2.4171e-05     3.99e-06     3.60492e-06      100    
end_path:out1:RootOutput(write)                        0.0199358      0.30627       1.3063        0.30574      0.231747        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21547.4 MB
  Peak resident set size usage (VmHWM): 2407.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2_reco_2024-11-22T_223415Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74481119_242_20231201T114656Z_gen_g4_detsim_hitreco__20240507T194416Z_reco2_reco_data_2024-11-22T_223415Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:51:04 UTC       justIN version: 01.01.09