justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 168152.25@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID168152.25@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5838
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 08:28:56
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-04-01 08:45:35
From worker nodeHostnamecomp11-14
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 08:30:11
Input filesusertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z.root
JobscriptExit code0
Real time14m (847s)
CPU time14m (857s = 101%)
Max RSS bytes6467764224 (6168 MiB)
Outputting started2025-04-01 08:44:19
Output filesusertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root
Finished2025-04-01 08:45:35
Saved logsjustin-logs:168152.25-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM detsim jobscript.
Input PFN = root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/60/ea/000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 20000031 subRun: 0 event: 19 at 01-Apr-2025 09:42:09 BST
SimDepoSource got 11809 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 11809 depos spanning: [0.0527076, 0.0776513]us
Retagger: tagging trace set: wiener with 2554 traces, 2554 summary
Retagger: tagging trace set: gauss with 2122 traces, 0 summary
wclsFrameSaver: saving 2122 traces tagged "gauss"
FrameSaver: q=373170 n=34978 tag=gauss
wclsFrameSaver: saving 2554 traces tagged "wiener"
FrameSaver: q=387248 n=31231 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 20000031 subRun: 0 event: 20 at 01-Apr-2025 09:42:46 BST
SimDepoSource got 69201 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 69201 depos spanning: [0.0432874, 0.0896147]us
Retagger: tagging trace set: wiener with 10295 traces, 10295 summary
Retagger: tagging trace set: gauss with 9158 traces, 0 summary
wclsFrameSaver: saving 9158 traces tagged "gauss"
FrameSaver: q=1.83668e+06 n=176831 tag=gauss
wclsFrameSaver: saving 10295 traces tagged "wiener"
FrameSaver: q=1.92869e+06 n=164584 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
01-Apr-2025 09:44:14 BST  Closed output file "000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root"
01-Apr-2025 09:44:14 BST  Closed input file "root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/60/ea/000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.678013       29.072        95.7521       5.93348       33.8836        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000233372   0.00463434     0.0398996    0.000475976   0.00868505       20     
simulate:tpcrawdecoder:WireCellToolkit         0.314559       28.371        94.7367       5.54364       33.5269        20     
simulate:opdigi:OpDetDigitizerDUNE            4.8986e-05     0.238433      0.812715     0.00511283     0.284377        20     
simulate:rns:RandomNumberSaver                 1.39e-05     3.32519e-05   0.000158944   2.1785e-05    3.1166e-05       20     
[art]:TriggerResults:TriggerResultInserter     9.027e-06    1.1893e-05    3.1466e-05    1.10205e-05   4.67093e-06      20     
end_path:out1:RootOutput                       2.354e-06    3.7619e-06    1.2383e-05    2.8425e-06    2.15195e-06      20     
end_path:out1:RootOutput(write)                0.362219       0.45689      0.702864      0.396864      0.107906        20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8237.41 MB
  Peak resident set size usage (VmHWM): 6467.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5838s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "detsim",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "detector-simulated",
        "core.end_time": 1743497054.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743496469.0
    },
    "parents": [
        {
            "did": "usertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z.root"
        }
    ]
}
===================
.:
total 162172
-rw-r--r-- 1 pltdune002 pltdune 156281220 Apr  1 09:44 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root
-rw-r--r-- 1 pltdune002 pltdune   9709794 Apr  1 09:44 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r-- 1 pltdune002 pltdune     43053 Apr  1 09:44 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_2025-04-01T_083018Z.log
-rw-r--r-- 1 pltdune002 pltdune      5756 Apr  1 09:44 jobscript.log
-rw-r--r-- 1 pltdune002 pltdune      1109 Apr  1 09:44 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root.json
-rw-r--r-- 1 pltdune002 pltdune       923 Apr  1 09:44 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root.ext.json
-rw-r--r-- 1 pltdune002 pltdune       164 Apr  1 09:30 all-input-dids.txt
-rw-r--r-- 1 pltdune002 pltdune       140 Apr  1 09:44 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune002 pltdune         0 Apr  1 09:30 debugprod.log
justIN time: 2025-04-03 08:22:46 UTC       justIN version: 01.03.00