justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108549.166@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108549.166@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:12:42
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-23 00:18:25
From worker nodeHostnamedune001-2993485.0-lcg2717.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:31:05
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2.root
JobscriptExit code0
Real time39m (2378s)
CPU time38m (2318s = 97%)
Outputting started2024-11-23 00:10:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2.root
Finished2024-11-23 00:18:25
Saved logsjustin-logs:108549.166-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
1st wire C:0 T:21 P:2 W:857 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:10:40 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:10:41 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:10:41 UTC run: 66006610 subRun: 1 event: 112100
Comparing two wires in the same plane: return failure
%MSG
374
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1126!
23-Nov-2024 00:10:43 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2_reco_data_2024-11-22T_233154Z.root"
23-Nov-2024 00:10:43 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/7b/62/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.97966       21.9751       219.246       9.34174       38.5465        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00133062     0.0979052     0.302819      0.0775561     0.0628195       100    
reco:linecluster:LineCluster                           0.0389181      0.36672       5.25602      0.233585       0.56187        100    
reco:trajcluster:TrajCluster                          0.00657324     0.623814       9.32681      0.103583       1.73619        100    
reco:pandora:StandardPandora                           0.964969       1.86673       12.067        1.34413       1.83832        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000135503   0.00529918     0.0640222    0.00190311     0.0097913       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000212028    0.0124734     0.310198     0.00265069     0.0357729       100    
reco:pandoracalo:Calorimetry                          9.2669e-05     0.0134386     0.179247      0.0011905     0.0372759       100    
reco:pandorapid:Chi2ParticleID                        3.6034e-05    0.000180502   0.00208246    0.000145453   0.000215826      100    
reco:trkshowersplit:TrackShowerHits                   0.000123355    0.0193656     0.298655     0.000647872    0.0599005       100    
reco:pmtrack:PMAlgTrackMaker                          0.00113128      1.88604       26.1977      0.197868       4.94278        100    
reco:pmtrackcalo:Calorimetry                          5.5403e-05    0.00777944     0.176461     0.000877706    0.0251959       100    
reco:pmtrackpid:Chi2ParticleID                        2.2033e-05    0.000247507   0.00190793    0.000162704   0.000300751      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000204396     1.55342       25.7591      0.269394       3.52524        100    
reco:pmtrajfitcalo:Calorimetry                        5.1507e-05     0.0136479     0.190721     0.00153454     0.0370202       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.1692e-05    0.000197913   0.000671036   0.000174627   0.000129467      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000956144     2.42477       40.8028      0.168166       6.90309        100    
reco:pmtracktccalo:Calorimetry                        5.1578e-05    0.00609886     0.176342     0.000930144    0.0209195       100    
reco:pmtracktcpid:Chi2ParticleID                      2.0711e-05    0.000249506   0.00189302    0.000168413   0.000299286      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000184887     1.33975       28.5792      0.266255       3.54978        100    
reco:pmtrajfittccalo:Calorimetry                      5.4091e-05     0.0108856     0.227143     0.00122823     0.0333159       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.3705e-05    0.000333025    0.0024321    0.000184827   0.000471445      100    
reco:blurredcluster:BlurredClustering                 0.00432894     0.905872       8.41855       0.38874       1.28332        100    
reco:emtrkmichelid:EmTrackMichelId                     0.212535       7.95966       77.8828       2.76641       14.5893        100    
reco:emshower:EMShower                                0.000303916    0.0221762     0.304683     0.00620064     0.040464        100    
reco:cvnmap:CVNMapper                                 2.5788e-05     0.0064335     0.0372974    0.00420151    0.00740339       100    
reco:cvneva:CVNEvaluator                              1.7206e-05     0.584853       1.20932      0.723606      0.376218        100    
reco:energyrecnumu:EnergyReco                         0.00030067     0.0217517     0.412265     0.00732206     0.0567393       100    
reco:energyrecnue:EnergyReco                          0.000140741   0.00156509     0.0188941    0.000568693   0.00309126       100    
reco:energyrecnc:EnergyReco                           0.00147741    0.00352169     0.0223179    0.00257916    0.00317179       100    
reco:energyrecnumurange:EnergyReco                    0.000162955    0.0168915     0.373638     0.00239402     0.053478        100    
reco:energyrecnumumcs:EnergyReco                      0.00128946     0.0188017     0.399064     0.00298746     0.0567437       100    
reco:opdec:Deconvolution                               0.0943903     0.333585      0.834911      0.321745      0.142122        100    
reco:ophitspe:OpHitFinderDeco                          0.423617       1.62395       3.36274       1.56376       0.6569         100    
reco:opflash:OpFlashFinder                            0.000464277    0.0013455    0.00379899    0.00127916    0.000556013      100    
reco:rns:RandomNumberSaver                            1.8277e-05    3.55442e-05   0.000350997   2.77465e-05   3.41552e-05      100    
reco:anglereconue:NuAngularReco                       0.000156344   0.00134554     0.0175118    0.000453395   0.00290099       100    
reco:anglereconumu:NuAngularReco                       5.292e-05    0.00109684     0.0166716    0.000255593   0.00280501       100    
reco:anglereconuepfps:NuAngularReco                   0.000103094   0.00123049     0.0169159    0.000361597   0.00283336       100    
reco:anglereconumupfps:NuAngularReco                  7.2258e-05    0.00119517     0.0186542    0.000309705   0.00303522       100    
[art]:TriggerResults:TriggerResultInserter             8.713e-06    1.31141e-05   4.6119e-05    1.1773e-05    5.58075e-06      100    
end_path:out1:RootOutput                               3.154e-06    4.7092e-06    1.8358e-05    4.0515e-06    1.97548e-06      100    
end_path:out1:RootOutput(write)                        0.0382726     0.218454      0.915642      0.223548      0.149818        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40188.5 MB
  Peak resident set size usage (VmHWM): 2367.46 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2_reco_2024-11-22T_233154Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66006610_1120_20231203T025649Z_gen_g4_detsim_hitreco__20240508T065810Z_reco2_reco_data_2024-11-22T_233154Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:02:08 UTC       justIN version: 01.01.09