justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301550.83@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301550.83@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:32:58
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:24
From worker nodeHostnamedune001-2995219.0-lcg2699.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:47:32
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2.root
JobscriptExit code0
Real time26m (1572s)
CPU time30m (1828s = 116%)
Outputting started2024-11-23 00:13:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2.root
Finished2024-11-23 00:26:24
Saved logsjustin-logs:301550.83-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

8700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
1st wire C:0 T:23 P:2 W:696 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:13:36 UTC run: 74506302 subRun: 1 event: 38700
1st wire C:0 T:23 P:2 W:570 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 232, 298, 197
minwire 0: 2603
minwire 1: 454
minwire 2: 2630
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.847671, 0.134977, 0.0173517, 
Output 1: 0.0487721, 0.938185, 0.0123776, 0.000665742, 
Output 2: 0.98264, 0.0173604, 

457
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1431!
23-Nov-2024 00:13:43 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2_reco_data_2024-11-22T_234735Z.root"
23-Nov-2024 00:13:43 UTC  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/cf/68/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.291657       15.1895       224.442       6.3821        30.2121        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00147908     0.0124063     0.0910785    0.00511038     0.0126775       100    
reco:linecluster:LineCluster                           0.0018291     0.0631408      2.47295      0.0140823     0.267247        100    
reco:trajcluster:TrajCluster                          0.000968207    0.332533       10.278      0.00919766       1.425         100    
reco:pandora:StandardPandora                           0.0192709      1.38288       13.2666       1.08534       1.50786        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000117837   0.00423549     0.0739633    0.00113474     0.010279        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000148944    0.012546       0.29735     0.00213747     0.0376725       100    
reco:pandoracalo:Calorimetry                          8.3336e-05    0.00849312     0.237168     0.000737114    0.0293737       100    
reco:pandorapid:Chi2ParticleID                        3.1698e-05    0.000144209   0.00170926    0.00010967    0.000182983      100    
reco:trkshowersplit:TrackShowerHits                   8.8413e-05     0.0126768      0.35255     0.000522837    0.0490129       100    
reco:pmtrack:PMAlgTrackMaker                          0.000814366     1.3063        28.1526      0.119547       3.96294        100    
reco:pmtrackcalo:Calorimetry                          4.7541e-05    0.00687307      0.25482     0.000702517    0.0275463       100    
reco:pmtrackpid:Chi2ParticleID                        1.8979e-05    0.000192265   0.00173266    0.00012326    0.000253807      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000129545    0.894269       23.7574       0.18364       2.72295        100    
reco:pmtrajfitcalo:Calorimetry                        4.0301e-05    0.00860453     0.239284     0.00101102     0.0298556       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8377e-05    0.000151855   0.000904461   0.000127622   0.000116007      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000790029     1.52718       30.8872      0.146569       4.87297        100    
reco:pmtracktccalo:Calorimetry                        4.7081e-05    0.00455588     0.181409     0.000745882    0.0187284       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8988e-05    0.000185979   0.00216797    0.000131718   0.000250818      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000112008    0.897411       22.0417      0.179604       2.55646        100    
reco:pmtrajfittccalo:Calorimetry                      4.0781e-05    0.00691174     0.222751     0.000929273    0.0255356       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6645e-05    0.000221849   0.00193433    0.000131048   0.000296595      100    
reco:blurredcluster:BlurredClustering                 0.000217287    0.720326       4.08863       0.38011      0.915909        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000110447     6.07139       83.3252       2.01577       12.2441        100    
reco:emshower:EMShower                                0.000169075    0.0156032     0.146788      0.0059493     0.024202        100    
reco:cvnmap:CVNMapper                                 1.8398e-05    0.00559631     0.0375005    0.00385755    0.00770712       100    
reco:cvneva:CVNEvaluator                              1.5934e-05     0.440534      0.918408      0.545775      0.313622        100    
reco:energyrecnumu:EnergyReco                         0.000326071    0.0234876     0.416839     0.00560418     0.0618724       100    
reco:energyrecnue:EnergyReco                          0.000103526   0.00131625     0.0242445    0.000382511   0.00332632       100    
reco:energyrecnc:EnergyReco                           0.00128313    0.00287349     0.0265401    0.00208168    0.00355129       100    
reco:energyrecnumurange:EnergyReco                     0.0001458     0.0209677     0.408169     0.00149685     0.0644349       100    
reco:energyrecnumumcs:EnergyReco                      0.00126779     0.021475       0.41348      0.0024163     0.062404        100    
reco:opdec:Deconvolution                               0.023867      0.120271      0.255019      0.119368      0.0457707       100    
reco:ophitspe:OpHitFinderDeco                          0.192732       1.08934       2.79168       1.02205      0.532213        100    
reco:opflash:OpFlashFinder                            0.000309976   0.00111339    0.00360351    0.00100124    0.000527605      100    
reco:rns:RandomNumberSaver                            1.7947e-05    2.83772e-05   0.000287743   2.4362e-05    2.70096e-05      100    
reco:anglereconue:NuAngularReco                       0.000148553    0.0011103     0.0299561    0.000294082   0.00331428       100    
reco:anglereconumu:NuAngularReco                      4.9355e-05    0.000933713    0.0285635    0.000152795   0.00328982       100    
reco:anglereconuepfps:NuAngularReco                    9.973e-05     0.001032      0.0295099    0.000267137    0.0032364       100    
reco:anglereconumupfps:NuAngularReco                  6.3776e-05    0.000974831    0.0299325    0.000196857   0.00334905       100    
[art]:TriggerResults:TriggerResultInserter             8.053e-06    1.0948e-05    3.8197e-05    1.0155e-05    4.00987e-06      100    
end_path:out1:RootOutput                               3.435e-06    4.46557e-06   1.8918e-05    4.1415e-06    1.72273e-06      100    
end_path:out1:RootOutput(write)                        0.0210937     0.167537      0.832997      0.164908      0.121874        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40213.5 MB
  Peak resident set size usage (VmHWM): 2436.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2_reco_2024-11-22T_234735Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_386_20231202T180519Z_gen_g4_detsim_hitreco__20240508T063707Z_reco2_reco_data_2024-11-22T_234735Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:03:41 UTC       justIN version: 01.01.09