justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 168802.33@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID168802.33@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5898
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-02 12:53:44
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2025-04-02 17:50:35
From worker nodeHostnamer22-n01.ph.liv.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5620 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-02 13:08:40
Input filesusertests:000593_reco_data_2025-04-02T_083600Z.root
JobscriptExit code0
Real time4h (16764s)
CPU time4h (16727s = 99%)
Max RSS bytes5497716736 (5243 MiB)
Outputting started2025-04-02 17:48:05
Output filesusertests:000593_reco_data_2025-04-02T_083600Z_reco_data_2025-04-02T_130845Z.root
Finished2025-04-02 17:50:35
Saved logsjustin-logs:168802.33-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM g4 jobscript.
Input PFN = root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/44/07/000593_reco_data_2025-04-02T_083600Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
%MSG
%MSG-i generatePrimaries:  larg4Main:largeant@BeginModule  02-Apr-2025 18:47:50 BST run: 20000031 subRun: 0 event: 1000 MCTruthEventAction.cc:112
Generating 1 particles
%MSG
%MSG-i ParticleListActionService:  larg4Main:largeant@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000
Not Stored Process summary:
	Pair : 56
	conv : 538
	compt : 17218
	phot : 4743
	annihil : 594
	Brem : 4400
	Ion : 3724
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000 ParticleListAction.cc:817
MCTruth Handles Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000 ParticleListAction.cc:827
mclistHandle Size: 1
%MSG
%MSG-i endOfEventAction:  larg4Main:largeant@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000 ParticleListAction.cc:830
Found 1 particles
%MSG
%MSG-i NuRandomService:  IonAndScint:IonAndScint@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000
Random seed for this event, engine 'IonAndScint.ISCalcAlg': 468538422
%MSG
IonAndScint Module Producer
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneVInner0
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneZInner0
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCInner1
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCInner0
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCPlaneZOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneZInner1
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneVInner1
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCPlaneVOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner0
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveInner1
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneUInner0
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCPlaneUInner1
Skip SimEnergyDeposit in: LArG4DetectorServicevolTPCPlaneUOuter
SimEnergyDeposit input module: largeant, instance name: LArG4DetectorServicevolTPCActiveOuter
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000
Random seed for this event, engine 'PDFastSim.photon': 576874370
%MSG
%MSG-i NuRandomService:  PDFastSimPAR:PDFastSim@BeginModule  02-Apr-2025 18:47:51 BST run: 20000031 subRun: 0 event: 1000
Random seed for this event, engine 'PDFastSim.scinttime': 482811772
%MSG
02-Apr-2025 18:47:56 BST  Closed output file "000593_reco_data_2025-04-02T_083600Z_reco_data_2025-04-02T_130845Z.root"
02-Apr-2025 18:47:56 BST  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/44/07/000593_reco_data_2025-04-02T_083600Z.root"
IonAndScint endJob.

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.110341       16.2292       2921.98       1.31653       101.705       1000    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000129332   0.000523044    0.0124055    0.000193395   0.00142491      1000    
simulate:rns:RandomNumberSaver                2.4146e-05    3.60974e-05   0.000404405   2.99495e-05   1.60293e-05     1000    
simulate:largeant:larg4Main                    0.107057       1.60961       193.701      0.885731       6.65004       1000    
simulate:IonAndScint:IonAndScint              0.000408565    0.0533857      6.53363     0.000599258    0.295427       1000    
simulate:PDFastSim:PDFastSimPAR               0.000271551     14.2363       2812.11     0.000367508     97.5423       1000    
[art]:TriggerResults:TriggerResultInserter    1.5074e-05    1.91721e-05   5.9958e-05    1.67855e-05   4.64334e-06     1000    
end_path:out1:RootOutput                       3.195e-06    4.83789e-06   3.7305e-05    3.8835e-06    2.26462e-06     1000    
end_path:out1:RootOutput(write)               0.00136086     0.328665       53.6146      0.0109804      1.8829        1000    
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 02-Apr-2025 18:47:57 BST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           468538422   IonAndScint.ISCalcAlg
        (per event)           576874370   PDFastSim.photon
        (per event)           482811772   PDFastSim.scinttime
        (per event)           325571391   largeant

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7254.27 MB
  Peak resident set size usage (VmHWM): 5497.72 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 1000 passed = 1000 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport       1000       1000          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 16264.329488 Real = 16283.282551

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 7254.27 VmHWM = 5497.72

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5898s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 1000,
        "art.process_name": "G4",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "simulated",
        "core.end_time": 1743616076.0,
        "core.event_count": 1000,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 1000,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743599840.0
    },
    "parents": [
        {
            "did": "usertests:000593_reco_data_2025-04-02T_083600Z.root"
        }
    ]
}
===================
.:
total 4338124
-rw-r--r-- 1 pildun13 dunepil 4438089660 Apr  2 18:47 000593_reco_data_2025-04-02T_083600Z_reco_data_2025-04-02T_130845Z.root
-rw-r--r-- 1 pildun13 dunepil    4108722 Apr  2 18:47 000593_reco_data_2025-04-02T_083600Z_reco_2025-04-02T_130845Z.log
-rw-r--r-- 1 pildun13 dunepil       7982 Apr  2 18:48 jobscript.log
-rw-r--r-- 1 pildun13 dunepil       1072 Apr  2 18:48 000593_reco_data_2025-04-02T_083600Z_reco_data_2025-04-02T_130845Z.root.json
-rw-r--r-- 1 pildun13 dunepil        857 Apr  2 18:48 000593_reco_data_2025-04-02T_083600Z_reco_data_2025-04-02T_130845Z.root.ext.json
-rw-r--r-- 1 pildun13 dunepil        519 Apr  2 18:47 g4_hist.root
-rw-r--r-- 1 pildun13 dunepil        115 Apr  2 18:48 justin-processed-pfns.txt
-rw-r--r-- 1 pildun13 dunepil        104 Apr  2 14:08 all-input-dids.txt
justIN time: 2025-04-03 13:00:32 UTC       justIN version: 01.03.00