justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 170056.11@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID170056.11@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5965
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-04 15:52:54
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod00
Last heartbeat2025-04-05 03:07:35
From worker nodeHostnamewj08.grid.hep.ph.ic.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-04 16:00:49
Input filesusertests:000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z.root
JobscriptExit code0
Real time11h (39768s)
CPU time10h (38834s = 97%)
Max RSS bytes6497927168 (6196 MiB)
Outputting started2025-04-05 03:03:38
Output filesusertests:000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root
Finished2025-04-05 03:07:35
Saved logsjustin-logs:170056.11-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM detsim jobscript.
Input PFN = root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/ec/f9/000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
wclsFrameSaver: saving 8289 traces tagged "gauss"
FrameSaver: q=1.58379e+06 n=161193 tag=gauss
wclsFrameSaver: saving 9009 traces tagged "wiener"
FrameSaver: q=1.63875e+06 n=151366 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 999th record. run: 20000031 subRun: 0 event: 999 at 05-Apr-2025 04:00:42 BST
SimDepoSource got 44606 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 44606 depos spanning: [0.0420003, 0.0865175]us
Retagger: tagging trace set: wiener with 11355 traces, 11355 summary
Retagger: tagging trace set: gauss with 6799 traces, 0 summary
wclsFrameSaver: saving 6799 traces tagged "gauss"
FrameSaver: q=1.2313e+06 n=107751 tag=gauss
wclsFrameSaver: saving 11355 traces tagged "wiener"
FrameSaver: q=1.35048e+06 n=86199 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 1000th record. run: 20000031 subRun: 0 event: 1000 at 05-Apr-2025 04:02:26 BST
SimDepoSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
05-Apr-2025 04:02:58 BST  Closed output file "000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root"
05-Apr-2025 04:02:58 BST  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/usertests/ec/f9/000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.00037       38.9183       794.915       1.92325       70.8327       1000    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000242048   0.00698443     0.456047     0.000465541    0.0256838      1000    
simulate:tpcrawdecoder:WireCellToolkit         0.341205       37.7663       789.541      0.852432       70.1529       1000    
simulate:opdigi:OpDetDigitizerDUNE            5.6116e-05     0.209765        7.185      0.000124121    0.434924       1000    
simulate:rns:RandomNumberSaver                1.8117e-05    0.000100772   0.00114885    2.7921e-05    0.000245718     1000    
[art]:TriggerResults:TriggerResultInserter    1.1719e-05    4.07204e-05   0.00213914    1.71775e-05   0.000138471     1000    
end_path:out1:RootOutput                       2.642e-06    3.85768e-06   2.4832e-05    3.6685e-06    1.74208e-06     1000    
end_path:out1:RootOutput(write)                0.529042      0.929711       11.8117      0.963069      0.501931       1000    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8225.39 MB
  Peak resident set size usage (VmHWM): 6497.93 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5965s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 1000,
        "art.process_name": "detsim",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "detector-simulated",
        "core.end_time": 1743822177.0,
        "core.event_count": 1000,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 1000,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743782914.0
    },
    "parents": [
        {
            "did": "usertests:000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z.root"
        }
    ]
}
===================
.:
total 7735344
-rw-r--r--. 1 job0002 job0002 7473691178 Apr  5 04:02 000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root
-rw-r--r--. 1 job0002 job0002  446681453 Apr  5 04:03 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r--. 1 job0002 job0002     571527 Apr  5 04:03 000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_2025-04-04T_160056Z.log
-rw-r--r--. 1 job0002 job0002       5705 Apr  5 04:03 jobscript.log
-rw-r--r--. 1 job0002 job0002       1115 Apr  5 04:03 000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root.json
-rw-r--r--. 1 job0002 job0002        930 Apr  5 04:03 000944_reco_data_2025-04-02T_084400Z_reco_data_2025-04-02T_135229Z_reco_data_2025-04-04T_160056Z.root.ext.json
-rw-r--r--. 1 job0002 job0002        164 Apr  4 17:00 all-input-dids.txt
-rw-r--r--. 1 job0002 job0002        145 Apr  5 04:03 justin-processed-pfns.txt
-rw-r--r--. 1 job0002 job0002          0 Apr  4 17:01 debugprod.log
justIN time: 2025-08-21 07:24:50 UTC       justIN version: 01.03.02