Jobsub ID 359717.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	359717.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	5846
Stage ID	1
User name	amoor@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	6291456000 (6000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-04-01 14:55:31
Site	UK_Brunel
Entry	CMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat	2025-04-01 14:59:16
From worker node	Hostname	wn-a2-26-01.brunel.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	6291456000 (6000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-04-01 14:56:32
Input files	usertests:000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z.root
Jobscript	Exit code	0
	Real time	1m (96s)
	CPU time	1m (76s = 79%)
	Max RSS bytes	1173098496 (1118 MiB)
Outputting started	2025-04-01 14:58:08
Output files	usertests:000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_data_2025-04-01T_145635Z.root
Finished	2025-04-01 14:59:16
Saved logs	justin-logs:359717.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco2 jobscript.
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/8d/2d/000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  01-Apr-2025 15:58:05 BST run: 20000031 subRun: 0 event: 20
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
01-Apr-2025 15:58:05 BST  Closed output file "000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_data_2025-04-01T_145635Z.root"
01-Apr-2025 15:58:05 BST  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/8d/2d/000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0408915      1.10479       8.72574      0.0464341      2.01784        20     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00358168     0.0107809     0.0929675    0.00435987     0.0200882       20     
reco:linecluster:LineCluster                           0.0205872     0.128741      0.679028      0.0223073     0.163802        20     
reco:trajcluster:TrajCluster                           0.0101848     0.397543       3.78382      0.0110832     0.851748        20     
reco:pandora:StandardPandora                          0.000938823     0.34736       3.34874     0.00112573     0.770651        20     
reco:pandoraTrack:LArPandoraTrackCreation             0.000117191    0.0396811     0.304711     0.000141792    0.0782029       20     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000161034    0.107731      0.356459     0.000181192     0.13623        20     
reco:pandoracalo:Calorimetry                          0.000231382    0.0278688     0.138883     0.000286133    0.0410139       20     
reco:pandorapid:Chi2ParticleID                        3.5973e-05    0.000322551   0.00208193    3.81125e-05   0.000532427      20     
reco:trkshowersplit:TrackShowerHits                   0.000240633    0.0118774     0.105658     0.000345228    0.0238665       20     
reco:rns:RandomNumberSaver                            1.6524e-05    3.35514e-05   0.000263944   2.04035e-05   5.30659e-05      20     
[art]:TriggerResults:TriggerResultInserter             9.598e-06    1.28563e-05    4.278e-05    1.02845e-05   7.47592e-06      20     
end_path:out1:RootOutput                               2.51e-06     3.54885e-06   1.7779e-05      2.8e-06     3.26793e-06      20     
end_path:out1:RootOutput(write)                       0.00267498     0.0323821     0.127374     0.00302557     0.0398725       20     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2271.02 MB
  Peak resident set size usage (VmHWM): 1173.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5846s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "Reco2",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1743519485.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743519449.0
    },
    "parents": [
        {
            "did": "usertests:000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z.root"
        }
    ]
}
===================
.:
total 191048
-rw-r--r--. 1 pildune000 dunepil 195491337 Apr  1 15:58 000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_data_2025-04-01T_145635Z.root
-rw-r--r--. 1 pildune000 dunepil    105837 Apr  1 15:58 000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_2025-04-01T_145635Z.log
-rw-r--r--. 1 pildune000 dunepil      7560 Apr  1 15:58 reco2_hist.root
-rw-r--r--. 1 pildune000 dunepil      6906 Apr  1 15:58 jobscript.log
-rw-r--r--. 1 pildune000 dunepil      1168 Apr  1 15:58 000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_data_2025-04-01T_145635Z.root.json
-rw-r--r--. 1 pildune000 dunepil      1042 Apr  1 15:58 000018_reco_data_2025-03-31T_142848Z_reco_data_2025-03-31T_150018Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101337Z_reco_data_2025-04-01T_145635Z.root.ext.json
-rw-r--r--. 1 pildune000 dunepil       284 Apr  1 15:56 all-input-dids.txt
-rw-r--r--. 1 pildune000 dunepil       193 Apr  1 15:58 justin-processed-pfns.txt
-rw-r--r--. 1 pildune000 dunepil         0 Apr  1 15:56 debugprod.log