justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91714.91@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91714.91@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-06 03:49:39
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2024-11-06 07:44:58
From worker nodeHostnamewn1205251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 03:51:45
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2.root
JobscriptExit code0
Real time3h (13957s)
CPU time3h (12939s = 92%)
Outputting started2024-11-06 07:44:23
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03932/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2.root
Finished2024-11-06 07:44:58
Saved logsjustin-logs:91714.91-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

MT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:44:13 GMT run: 74251126 subRun: 1 event: 52600
1st wire C:0 T:0 P:2 W:783 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 59, 57, 43
minwire 0: 519
minwire 1: 2767
minwire 2: 5
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0535365, 0.0191653, 0.927298, 
Output 1: 0.0393672, 0.952972, 0.00755081, 0.000110286, 
Output 2: 0.961102, 0.0388978, 

301
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 765!
06-Nov-2024 07:44:21 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2_reco_data_2024-11-06T_035151Z.root"
06-Nov-2024 07:44:21 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/a3/27/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.958982       66.9599       4798.74       17.5283       351.798        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0275098     0.0588061     0.110744      0.0600467     0.0159132       200    
reco:linecluster:LineCluster                           0.158114      0.591888       25.6172      0.284185       2.36212        200    
reco:trajcluster:TrajCluster                           0.0796295      1.49389       91.9878      0.102877       8.35568        200    
reco:pandora:StandardPandora                           0.095513       24.347        4220.83       2.1651        297.585        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000186652    0.0102876     0.348574     0.00248292     0.0308978       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000260251    0.0261663      0.70592      0.0045574     0.0873123       200    
reco:pandoracalo:Calorimetry                          0.000148861    0.0304136      1.4126      0.00169856     0.144409        200    
reco:pandorapid:Chi2ParticleID                        5.6777e-05    0.000290913   0.00810119    0.000188726   0.000611831      200    
reco:trkshowersplit:TrackShowerHits                   0.000118513    0.0334173      1.47501      0.0013233     0.156389        200    
reco:pmtrack:PMAlgTrackMaker                          0.00210254      4.52946       144.65        0.32378       16.0435        200    
reco:pmtrackcalo:Calorimetry                          0.000115478    0.0192466      1.20844     0.00150429     0.0954051       200    
reco:pmtrackpid:Chi2ParticleID                        4.8482e-05    0.000446213    0.0062907    0.000224574   0.000733391      200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000337847     3.58464       124.444      0.483852       12.6979        200    
reco:pmtrajfitcalo:Calorimetry                        9.8105e-05     0.0313021      1.53665     0.00222707     0.142646        200    
reco:pmtrajfitpid:Chi2ParticleID                      4.1899e-05    0.00030081     0.0020978    0.000229844   0.000267139      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00200481      5.11529       182.778      0.336391       19.1773        200    
reco:pmtracktccalo:Calorimetry                        0.000115728    0.0152249      0.85391     0.00172008     0.0685131       200    
reco:pmtracktcpid:Chi2ParticleID                       4.774e-05    0.000422748   0.00507122    0.00023308    0.000603837      200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000299034     2.83861       90.1069      0.550238       8.69316        200    
reco:pmtrajfittccalo:Calorimetry                      0.000109025    0.0261705      1.33806     0.00209018     0.116846        200    
reco:pmtrajfittcpid:Chi2ParticleID                    4.6508e-05    0.000584884   0.00801005    0.000252397   0.00107905       200    
reco:blurredcluster:BlurredClustering                 0.000174068     1.58467       16.6003      0.827679       2.22864        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000187073     17.3256       359.377       5.72407       38.5559        200    
reco:emshower:EMShower                                0.00024899     0.0425685     0.503031      0.0118826      0.07048        200    
reco:cvnmap:CVNMapper                                 2.8224e-05     0.0100314     0.108891     0.00979581     0.0121999       200    
reco:cvneva:CVNEvaluator                              2.5368e-05      1.33764       2.60808       1.77091      0.837906        200    
reco:energyrecnumu:EnergyReco                         0.00049801     0.0642427      3.52725     0.00870518      0.28319        200    
reco:energyrecnue:EnergyReco                          0.000245924   0.00363807     0.123175     0.000926058    0.0103606       200    
reco:energyrecnc:EnergyReco                           0.00329202    0.00811575     0.131618      0.0048101     0.0110483       200    
reco:energyrecnumurange:EnergyReco                    0.000409973    0.0582197      3.71666      0.0043609     0.290065        200    
reco:energyrecnumumcs:EnergyReco                      0.00137846     0.0633531      3.95022     0.00630477     0.308261        200    
reco:opdec:Deconvolution                               0.0927877     0.459101      0.837477      0.461122      0.133573        200    
reco:ophitspe:OpHitFinderDeco                          0.238199       2.84103       5.59229       2.78525       1.1163         200    
reco:opflash:OpFlashFinder                            0.000205798   0.00203082    0.00683483    0.00197963    0.000914623      200    
reco:rns:RandomNumberSaver                            2.3534e-05    3.45217e-05   0.000457934   3.06425e-05   3.0971e-05       200    
reco:anglereconue:NuAngularReco                       0.000220967   0.00261448     0.147102     0.000507678    0.0112204       200    
reco:anglereconumu:NuAngularReco                      0.000115618    0.0021781      0.10539     0.000324717   0.00860867       200    
reco:anglereconuepfps:NuAngularReco                   0.000197031    0.002364      0.108155     0.000485035   0.00877911       200    
reco:anglereconumupfps:NuAngularReco                  0.000171844   0.00232209     0.110563     0.000436729   0.00892468       200    
[art]:TriggerResults:TriggerResultInserter            1.1812e-05    1.84313e-05   9.1864e-05    1.67365e-05   8.24083e-06      200    
end_path:out1:RootOutput                               3.627e-06    4.63326e-06   2.7712e-05     4.418e-06    2.31924e-06      200    
end_path:out1:RootOutput(write)                        0.0245808     0.392963       2.4811       0.392248      0.297564        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21894.7 MB
  Peak resident set size usage (VmHWM): 2466.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2_reco_2024-11-06T_035151Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74251126_262_20231120T135047Z_gen_g4_detsim_hitreco__20240503T070701Z_reco2_reco_data_2024-11-06T_035151Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 11:04:40 UTC       justIN version: 01.01.09