justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 359717.13@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID359717.13@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5846
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 14:55:31
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-04-01 14:59:34
From worker nodeHostnamehnode70.pic.es
cpuinfoAMD EPYC 7443P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 14:56:47
Input filesusertests:000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z.root
JobscriptExit code0
Real time1m (105s)
CPU time0m (31s = 29%)
Max RSS bytes1172959232 (1118 MiB)
Outputting started2025-04-01 14:58:33
Output filesusertests:000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_data_2025-04-01T_145649Z.root
Finished2025-04-01 14:59:34
Saved logsjustin-logs:359717.13-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco2 jobscript.
Input PFN = root://xrootd-archive.cr.cnaf.infn.it:1096//dune/usertests/bb/76/000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 16:58:30 CEST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
01-Apr-2025 16:58:31 CEST  Closed output file "000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_data_2025-04-01T_145649Z.root"
01-Apr-2025 16:58:31 CEST  Closed input file "root://xrootd-archive.cr.cnaf.infn.it:1096//dune/usertests/bb/76/000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.376156       0.73807       1.92749      0.414332      0.475801        20     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0373258     0.0431733     0.0749761     0.037552      0.0132642       20     
reco:linecluster:LineCluster                           0.223042      0.310424      0.444233       0.2286       0.0951071       20     
reco:trajcluster:TrajCluster                           0.111658      0.185757      0.402537      0.112586      0.105456        20     
reco:pandora:StandardPandora                          0.000564274    0.098549      0.592204     0.000964894    0.157377        20     
reco:pandoraTrack:LArPandoraTrackCreation             7.2422e-05     0.0147556     0.0778509    8.62825e-05    0.0231448       20     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000101792    0.0500702     0.256859     0.000114468    0.0742805       20     
reco:pandoracalo:Calorimetry                          0.000147693    0.0124853     0.047005     0.000171439    0.0177735       20     
reco:pandorapid:Chi2ParticleID                         2.106e-05    0.000159513   0.000530593   2.7836e-05    0.000179399      20     
reco:trkshowersplit:TrackShowerHits                   0.000142494   0.00435905     0.0168606    0.000226206   0.00607795       20     
reco:rns:RandomNumberSaver                             9.94e-06     1.71258e-05   0.000127543   1.08655e-05   2.5371e-05       20     
[art]:TriggerResults:TriggerResultInserter             5.991e-06    7.8691e-06     2.738e-05     6.45e-06     4.63022e-06      20     
end_path:out1:RootOutput                               1.61e-06     2.4601e-06     1.038e-05    1.9905e-06    1.83992e-06      20     
end_path:out1:RootOutput(write)                       0.00173079     0.0180439     0.0586342    0.00201264     0.0223773       20     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2270.94 MB
  Peak resident set size usage (VmHWM): 1172.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5846s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "Reco2",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1743519511.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743519442.0
    },
    "parents": [
        {
            "did": "usertests:000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z.root"
        }
    ]
}
===================
.:
total 162688
-rw-r--r-- 1 dune001 dune 166446710 Apr  1 16:58 000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_data_2025-04-01T_145649Z.root
-rw-r--r-- 1 dune001 dune     98378 Apr  1 16:58 000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_2025-04-01T_145649Z.log
-rw-r--r-- 1 dune001 dune      7560 Apr  1 16:58 reco2_hist.root
-rw-r--r-- 1 dune001 dune      6923 Apr  1 16:58 jobscript.log
-rw-r--r-- 1 dune001 dune      1168 Apr  1 16:58 000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_data_2025-04-01T_145649Z.root.json
-rw-r--r-- 1 dune001 dune      1042 Apr  1 16:58 000019_reco_data_2025-03-31T_142857Z_reco_data_2025-03-31T_150011Z_reco_data_2025-04-01T_083008Z_reco_data_2025-04-01T_101318Z_reco_data_2025-04-01T_145649Z.root.ext.json
-rw-r--r-- 1 dune001 dune       284 Apr  1 16:56 all-input-dids.txt
-rw-r--r-- 1 dune001 dune       197 Apr  1 16:58 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune         0 Apr  1 16:56 debugprod.log
justIN time: 2025-04-03 08:24:24 UTC       justIN version: 01.03.00