justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301494.23@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301494.23@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:14:07
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:26:32
From worker nodeHostnamedune001-2993875.0-lcg2715.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:32:17
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2.root
JobscriptExit code0
Real time47m (2831s)
CPU time48m (2896s = 102%)
Outputting started2024-11-23 00:21:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2.root
Finished2024-11-23 00:26:32
Saved logsjustin-logs:301494.23-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

C run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:22 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:22 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:22 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 00:19:22 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:19:22 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:19:24 UTC run: 50574832 subRun: 1 event: 101000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 132, 105, 72
minwire 0: 1129
minwire 1: 1638
minwire 2: 1059
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.535266, 0.00224534, 0.462488, 
Output 1: 0.0955139, 0.493935, 0.377847, 0.0327041, 
Output 2: 0.483186, 0.516814, 

544
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1923!
23-Nov-2024 00:19:27 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2_reco_data_2024-11-22T_233222Z.root"
23-Nov-2024 00:19:27 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/48/fa/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.42767       27.0477       924.766       8.85554       96.4955        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0027404     0.113403      0.452874      0.0830645     0.088564        100    
reco:linecluster:LineCluster                           0.0328097     0.742842       35.5369      0.227966       3.66348        100    
reco:trajcluster:TrajCluster                          0.000850988     1.61683       114.246      0.103968       11.4871        100    
reco:pandora:StandardPandora                           0.0276953      2.58662       105.648       1.24286       10.4737        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000111527   0.00608534     0.173863     0.00146383     0.0183979       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000146981    0.0100745     0.183514     0.00215788     0.0236886       100    
reco:pandoracalo:Calorimetry                          8.3345e-05     0.026858       1.60875     0.000953452    0.164521        100    
reco:pandorapid:Chi2ParticleID                        3.1297e-05    0.000156596   0.00266126    0.000101443   0.000266877      100    
reco:trkshowersplit:TrackShowerHits                   5.4431e-05     0.0282098      1.30314     0.000548805    0.143935        100    
reco:pmtrack:PMAlgTrackMaker                          0.00100673      3.37111       167.859      0.178959       17.8879        100    
reco:pmtrackcalo:Calorimetry                          4.8633e-05     0.0115651     0.683015     0.000891889    0.0685131       100    
reco:pmtrackpid:Chi2ParticleID                         1.996e-05    0.000244534   0.00311413    0.000134422   0.000390207      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000125017     2.03586       66.2113      0.201646       7.97953        100    
reco:pmtrajfitcalo:Calorimetry                        4.2294e-05     0.024854       1.57169     0.00121851     0.157907        100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8077e-05    0.000166637   0.00073215    0.000132284   0.00013192       100    
reco:pmtracktc:PMAlgTrackMaker                        0.000835975     3.65974       202.643       0.21661       20.6689        100    
reco:pmtracktccalo:Calorimetry                        4.5278e-05    0.00569625     0.215003     0.000891954    0.0222558       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8478e-05    0.000217961   0.00219546    0.000138193   0.000272941      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000111037     1.36648       54.1783      0.226415       5.5743         100    
reco:pmtrajfittccalo:Calorimetry                      3.9469e-05     0.0164261      1.06067     0.00115337     0.106086        100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.7476e-05    0.000278448   0.00371556    0.000158388   0.000433998      100    
reco:blurredcluster:BlurredClustering                 0.000149845    0.845527       6.73637      0.392049       1.09717        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000102864     7.9286        160.349       2.25446       18.9766        100    
reco:emshower:EMShower                                0.000151137    0.0231567     0.288675     0.00395965     0.0417513       100    
reco:cvnmap:CVNMapper                                 1.7026e-05    0.00583745     0.0338917    0.00396564     0.0071772       100    
reco:cvneva:CVNEvaluator                              1.4071e-05     0.475303      0.979605      0.579977      0.322183        100    
reco:energyrecnumu:EnergyReco                         0.000341793    0.020217      0.504476     0.00745353     0.0579158       100    
reco:energyrecnue:EnergyReco                          0.000104487   0.00191857     0.0672771    0.000411693   0.00688993       100    
reco:energyrecnc:EnergyReco                           0.00126988    0.00358509     0.0678385    0.00231347    0.00685413       100    
reco:energyrecnumurange:EnergyReco                    0.000137627    0.0163925     0.489493     0.00183714     0.0569965       100    
reco:energyrecnumumcs:EnergyReco                      0.00106022     0.0175639     0.500463      0.0026469     0.0573082       100    
reco:opdec:Deconvolution                               0.0620338     0.316553      0.653021      0.300691      0.126102        100    
reco:ophitspe:OpHitFinderDeco                          0.145588       1.56207       3.5439        1.53499      0.683435        100    
reco:opflash:OpFlashFinder                            0.000119239    0.0012582    0.00408483    0.00121268    0.000571427      100    
reco:rns:RandomNumberSaver                            1.8668e-05    3.03047e-05   0.00027312    2.55985e-05   2.56159e-05      100    
reco:anglereconue:NuAngularReco                       0.000162224   0.00153851     0.0545995    0.000330351   0.00560816       100    
reco:anglereconumu:NuAngularReco                      5.4862e-05    0.00134109     0.0547381    0.000179059   0.00560667       100    
reco:anglereconuepfps:NuAngularReco                    9.981e-05    0.00149757     0.0578567    0.000277036   0.00592898       100    
reco:anglereconumupfps:NuAngularReco                  6.8954e-05    0.00141699     0.0552771    0.000220932   0.00567729       100    
[art]:TriggerResults:TriggerResultInserter             8.453e-06    1.24726e-05   7.0376e-05    1.14975e-05   6.58964e-06      100    
end_path:out1:RootOutput                               3.194e-06    4.32142e-06   2.3435e-05     4.101e-06    1.98003e-06      100    
end_path:out1:RootOutput(write)                        0.012638      0.198222      0.996447      0.192376      0.146952        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40484.7 MB
  Peak resident set size usage (VmHWM): 2684.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2_reco_2024-11-22T_233222Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574832_1009_20231203T134835Z_gen_g4_detsim_hitreco__20240508T042727Z_reco2_reco_data_2024-11-22T_233222Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 03:32:25 UTC       justIN version: 01.01.09