justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91726.152@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91726.152@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-06 04:14:48
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-11-06 07:28:42
From worker nodeHostnamewn1207081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 04:18:54
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2.root
JobscriptExit code0
Real time3h (11351s)
CPU time2h (10402s = 91%)
Outputting started2024-11-06 07:28:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03932/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2.root
Finished2024-11-06 07:28:42
Saved logsjustin-logs:91726.152-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

un: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Nov-2024 07:27:45 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Nov-2024 07:27:45 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:27:45 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:27:45 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:27:45 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:27:46 GMT run: 74251126 subRun: 1 event: 78400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 142, 325, 223
minwire 0: 1661
minwire 1: 1805
minwire 2: 1128
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0418665, 0.000735308, 0.957398, 
Output 1: 0.665685, 0.329471, 0.00441053, 0.000433934, 
Output 2: 0.896909, 0.103091, 

612
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2313!
06-Nov-2024 07:28:03 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2_reco_data_2024-11-06T_041908Z.root"
06-Nov-2024 07:28:03 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/47/6e/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.945334       53.5863       1030.21       16.0204       126.622        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0296733     0.0582491     0.114559      0.0609574     0.016003        200    
reco:linecluster:LineCluster                           0.159562      0.717609       28.911       0.285492       2.67808        200    
reco:trajcluster:TrajCluster                           0.0797493      1.53649       61.2282      0.100747       6.37417        200    
reco:pandora:StandardPandora                           0.0987762      4.32533       112.397       2.19858       11.7189        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000197651    0.0130881     0.338127     0.00258016     0.0356659       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000279104    0.0306005      1.75037     0.00487557     0.133735        200    
reco:pandoracalo:Calorimetry                          0.000157436    0.0384568      1.62067      0.0017116     0.155144        200    
reco:pandorapid:Chi2ParticleID                        6.1887e-05    0.000295938   0.00484105    0.000213195   0.000426596      200    
reco:trkshowersplit:TrackShowerHits                   9.2844e-05     0.0457346      1.38938      0.001178      0.166754        200    
reco:pmtrack:PMAlgTrackMaker                          0.00203274      5.11236       199.152      0.317493       19.6535        200    
reco:pmtrackcalo:Calorimetry                          0.000107973    0.0213171     0.905603     0.00138226     0.0826448       200    
reco:pmtrackpid:Chi2ParticleID                        4.3892e-05    0.000517674   0.00585325    0.000213166   0.000867579      200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000312407     3.9807        88.8873      0.413661       11.4364        200    
reco:pmtrajfitcalo:Calorimetry                        9.7524e-05     0.0382499      1.43776     0.00196202      0.14592        200    
reco:pmtrajfitpid:Chi2ParticleID                      4.3291e-05    0.000386696    0.0154854    0.000243638   0.00110855       200    
reco:pmtracktc:PMAlgTrackMaker                        0.00182674      5.72697       183.252      0.339463       19.7642        200    
reco:pmtracktccalo:Calorimetry                        0.00010628     0.014646      0.495503     0.00145788     0.048493        200    
reco:pmtracktcpid:Chi2ParticleID                       4.289e-05    0.000471135   0.00464957    0.000228494   0.000677604      200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000278163     3.50022       107.221      0.423439       10.6456        200    
reco:pmtrajfittccalo:Calorimetry                      0.000103725    0.0351573      1.12934     0.00160521     0.135395        200    
reco:pmtrajfittcpid:Chi2ParticleID                    4.4613e-05    0.000725405   0.00974617    0.00024731    0.00139696       200    
reco:blurredcluster:BlurredClustering                 0.000153008     1.7535        12.9783      0.756333       2.55884        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000170521     20.9733       290.236       4.62841       44.2208        200    
reco:emshower:EMShower                                0.000242216    0.0515651     0.805711     0.00765433     0.102988        200    
reco:cvnmap:CVNMapper                                  2.654e-05     0.0095916     0.0648929     0.0101873    0.00884771       200    
reco:cvneva:CVNEvaluator                               2.644e-05      1.38496       2.61647       1.81992      0.876293        200    
reco:energyrecnumu:EnergyReco                         0.000438514    0.138081       15.0885     0.00839733      1.07513        200    
reco:energyrecnue:EnergyReco                          0.000228349   0.00485026     0.0984314    0.00103351     0.0116008       200    
reco:energyrecnc:EnergyReco                           0.00252397    0.00869747     0.104965     0.00471694     0.0124733       200    
reco:energyrecnumurange:EnergyReco                    0.000362381    0.132897       15.4225     0.00445456      1.09853        200    
reco:energyrecnumumcs:EnergyReco                      0.00188109     0.141416       16.7613     0.00712605      1.19167        200    
reco:opdec:Deconvolution                               0.106629      0.463194       0.89153      0.469605       0.14396        200    
reco:ophitspe:OpHitFinderDeco                          0.237203       2.89852       6.25949       2.91913       1.17974        200    
reco:opflash:OpFlashFinder                            0.000234701   0.00225163     0.0108964    0.00204592     0.0013383       200    
reco:rns:RandomNumberSaver                            2.3865e-05    3.65179e-05   0.000530277   3.3383e-05    3.54391e-05      200    
reco:anglereconue:NuAngularReco                       0.000217799   0.00317173     0.099128     0.000565278    0.0100248       200    
reco:anglereconumu:NuAngularReco                      0.000104666   0.00304081     0.113671     0.000353063    0.0112448       200    
reco:anglereconuepfps:NuAngularReco                   0.000183756    0.0030427     0.0909875    0.000527641   0.00962844       200    
reco:anglereconumupfps:NuAngularReco                  0.000158959   0.00298933     0.090296     0.000475429   0.00958569       200    
[art]:TriggerResults:TriggerResultInserter            1.2173e-05    1.8849e-05    0.000114385   1.6982e-05    9.69215e-06      200    
end_path:out1:RootOutput                               3.637e-06    5.06209e-06   2.9716e-05     4.764e-06    2.57883e-06      200    
end_path:out1:RootOutput(write)                        0.0208299     0.410538       2.07433      0.390621      0.318237        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21839.4 MB
  Peak resident set size usage (VmHWM): 2384.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2_reco_2024-11-06T_041908Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_391_20231120T135412Z_gen_g4_detsim_hitreco__20240507T173448Z_reco2_reco_data_2024-11-06T_041908Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 11:00:06 UTC       justIN version: 01.01.09