justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297880.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID297880.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4158
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 14:03:02
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-11-20 14:05:13
From worker nodeHostnamedunegli-4220223-0-fnpc22004.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 14:04:33
Input filesfardet-hd:prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco.root
JobscriptExit code0
Real time0m (30s)
CPU time0m (25s = 83%)
Outputting started2024-11-20 14:05:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/04158/1/Pandora_Events_2024-11-20T_140436Z.pndr
Finished2024-11-20 14:05:13
Saved logsjustin-logs:297880.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d.so
=== Start last 100 lines of lar log file ===
GeoApaChannelGroupService::ctor: Group 4 (apa04) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 5 (apa05) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 6 (apa06) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 7 (apa07) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 8 (apa08) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 9 (apa09) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 10 (apa10) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 11 (apa11) has 2560 channels from 4/4 readout planes.
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c reco2_pndr_matt_pandora_hd.fcl -n 10 -o prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco_matt_2024-11-20T_140436Z.root root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e2/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0xb9c44e0
StandardRawDigitPrepService::ctor:   Extract service: @0xd279800
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0xb9c1e80
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0xb9c1980
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0xb9c04d0
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
*************************************************************************************************************************************
Unique Ptrs that are added to the event
*************************************************************************************************************************************
* Data Product Name: InitialTrack             * Instance Name:  * Type: std::vector<recob::Track, std::allocator<recob::Track> >*   *
* Data Product Name: ShowerPCA                * Instance Name:  * Type: std::vector<recob::PCAxis, std::allocator<recob::PCAxis> >* *
* Data Product Name: shower                   * Instance Name:  * Type: std::vector<recob::Shower, std::allocator<recob::Shower> >* *
* Association Name:  PFParticlePCAxisAssn     * Instance Name:  * Type: art::Assns<recob::PFParticle, recob::PCAxis, void>*         *
* Association Name:  ShowerPCAxisAssn         * Instance Name:  * Type: art::Assns<recob::Shower, recob::PCAxis, void>*             *
* Association Name:  ShowerTrackAssn          * Instance Name:  * Type: art::Assns<recob::Shower, recob::Track, void>*              *
* Association Name:  ShowerTrackHitAssn       * Instance Name:  * Type: art::Assns<recob::Track, recob::Hit, void>*                 *
* Association Name:  clusterAssociationsbase  * Instance Name:  * Type: art::Assns<recob::Shower, recob::Cluster, void>*            *
* Association Name:  hitAssociationsbase      * Instance Name:  * Type: art::Assns<recob::Shower, recob::Hit, void>*                *
* Association Name:  pfShowerAssociationsbase * Instance Name:  * Type: art::Assns<recob::Shower, recob::PFParticle, void>*         *
* Association Name:  spShowerAssociationsbase * Instance Name:  * Type: art::Assns<recob::Shower, recob::SpacePoint, void>*         *
*************************************************************************************************************************************
20-Nov-2024 14:05:00 UTC  Initiating request to open input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e2/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco.root"
20-Nov-2024 14:05:00 UTC  Opened input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e2/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco.root"
Begin processing the 1st record. run: 3786 subRun: 0 event: 43401 at 20-Nov-2024 14:05:01 UTC
20-Nov-2024 14:05:01 UTC  Opened output file with pattern "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco_matt_2024-11-20T_140436Z.root"
Begin processing the 2nd record. run: 3786 subRun: 0 event: 43402 at 20-Nov-2024 14:05:01 UTC
Begin processing the 3rd record. run: 3786 subRun: 0 event: 43403 at 20-Nov-2024 14:05:01 UTC
Begin processing the 4th record. run: 3786 subRun: 0 event: 43404 at 20-Nov-2024 14:05:01 UTC
Begin processing the 5th record. run: 3786 subRun: 0 event: 43405 at 20-Nov-2024 14:05:02 UTC
Begin processing the 6th record. run: 3786 subRun: 0 event: 43406 at 20-Nov-2024 14:05:02 UTC
Begin processing the 7th record. run: 3786 subRun: 0 event: 43407 at 20-Nov-2024 14:05:02 UTC
Begin processing the 8th record. run: 3786 subRun: 0 event: 43408 at 20-Nov-2024 14:05:02 UTC
Begin processing the 9th record. run: 3786 subRun: 0 event: 43409 at 20-Nov-2024 14:05:02 UTC
Begin processing the 10th record. run: 3786 subRun: 0 event: 43410 at 20-Nov-2024 14:05:02 UTC
20-Nov-2024 14:05:03 UTC  Closed output file "prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco_matt_2024-11-20T_140436Z.root"
20-Nov-2024 14:05:03 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e2/prodmarley_nue_cc_flat_dune10kt_1x2x6_20241023T133302Z_gen_000435_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0802741     0.096466      0.117299      0.0971838    0.00947296       10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000691022   0.000929647   0.00173374    0.000851482   0.000299613      10     
reco:pandora:StandardPandora                          0.00550315    0.00813251     0.0229654    0.00663699    0.00496522       10     
reco:pandoraTrack:LArPandoraTrackCreation             5.9663e-05    0.000176196   0.00110759    7.09995e-05   0.000310619      10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00010004    0.00025908    0.00157525    0.00011076    0.000438833      10     
reco:pandoracalo:Calorimetry                          5.6277e-05    0.000147826   0.000877586   6.74335e-05   0.000243364      10     
reco:pandorapid:Chi2ParticleID                        1.9196e-05    6.36457e-05   0.000435307   2.2688e-05    0.000123898      10     
[art]:TriggerResults:TriggerResultInserter             6.262e-06    1.09638e-05   4.5987e-05     7.154e-06    1.16952e-05      10     
end_path:out1:RootOutput                               1.823e-06    3.9194e-06    1.8465e-05     2.369e-06    4.86227e-06      10     
end_path:out1:RootOutput(write)                        0.0737015     0.0865441     0.0942091     0.088383     0.00606132       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19118.8 MB
  Peak resident set size usage (VmHWM): 999.678 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-21 20:52:46 UTC       justIN version: 01.01.09