justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 168152.5@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID168152.5@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5838
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 08:28:56
SiteUK_Brunel
EntryCMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat2025-04-01 08:47:52
From worker nodeHostnamewn-a2-26-01.brunel.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 08:30:40
Input filesusertests:000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z.root
JobscriptExit code0
Real time16m (963s)
CPU time16m (981s = 101%)
Max RSS bytes6471262208 (6171 MiB)
Outputting started2025-04-01 08:46:43
Output filesusertests:000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root
Finished2025-04-01 08:47:52
Saved logsjustin-logs:168152.5-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM detsim jobscript.
Input PFN = root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/cc/62/000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 19th record. run: 20000031 subRun: 0 event: 19 at 01-Apr-2025 09:45:04 BST
SimDepoSource got 30880 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 30880 depos spanning: [0.0628165, 0.0869575]us
Retagger: tagging trace set: wiener with 6201 traces, 6201 summary
Retagger: tagging trace set: gauss with 4834 traces, 0 summary
wclsFrameSaver: saving 4834 traces tagged "gauss"
FrameSaver: q=826351 n=82211 tag=gauss
wclsFrameSaver: saving 6201 traces tagged "wiener"
FrameSaver: q=894294 n=72396 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 20th record. run: 20000031 subRun: 0 event: 20 at 01-Apr-2025 09:45:47 BST
SimDepoSource got 21396 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 21396 depos spanning: [0.0424851, 0.0661473]us
Retagger: tagging trace set: wiener with 5936 traces, 5936 summary
Retagger: tagging trace set: gauss with 3808 traces, 0 summary
wclsFrameSaver: saving 3808 traces tagged "gauss"
FrameSaver: q=696629 n=55806 tag=gauss
wclsFrameSaver: saving 5936 traces tagged "wiener"
FrameSaver: q=756775 n=46505 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
01-Apr-2025 09:46:38 BST  Closed output file "000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root"
01-Apr-2025 09:46:38 BST  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/usertests/cc/62/000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.645169       33.5681       115.814       15.4882       38.9995        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000266958    0.0031034     0.0255213    0.000382265   0.00600546       20     
simulate:tpcrawdecoder:WireCellToolkit         0.220638       32.8776       114.586       15.0029       38.691         20     
simulate:opdigi:OpDetDigitizerDUNE            5.3041e-05     0.155548       0.56848     0.00835541     0.205102        20     
simulate:rns:RandomNumberSaver                1.6237e-05    3.56018e-05   0.00018724    2.9605e-05    3.60158e-05      20     
[art]:TriggerResults:TriggerResultInserter    1.0574e-05    1.5119e-05    4.3535e-05    1.36265e-05   6.92328e-06      20     
end_path:out1:RootOutput                       2.828e-06    4.9872e-06    1.7517e-05    4.0385e-06    3.39307e-06      20     
end_path:out1:RootOutput(write)                0.420431      0.531299       1.1021       0.463648      0.157551        20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8284.15 MB
  Peak resident set size usage (VmHWM): 6471.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5838s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "detsim",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "detector-simulated",
        "core.end_time": 1743497198.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743496532.0
    },
    "parents": [
        {
            "did": "usertests:000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z.root"
        }
    ]
}
===================
.:
total 137940
-rw-r--r--. 1 pildune000 dunepil 131473346 Apr  1 09:46 000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root
-rw-r--r--. 1 pildune000 dunepil   9707298 Apr  1 09:46 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r--. 1 pildune000 dunepil     43243 Apr  1 09:46 000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_2025-04-01T_083043Z.log
-rw-r--r--. 1 pildune000 dunepil      5783 Apr  1 09:46 jobscript.log
-rw-r--r--. 1 pildune000 dunepil      1109 Apr  1 09:46 000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root.json
-rw-r--r--. 1 pildune000 dunepil       923 Apr  1 09:46 000007_reco_data_2025-03-31T_142619Z_reco_data_2025-03-31T_155318Z_reco_data_2025-04-01T_083043Z.root.ext.json
-rw-r--r--. 1 pildune000 dunepil       164 Apr  1 09:30 all-input-dids.txt
-rw-r--r--. 1 pildune000 dunepil       161 Apr  1 09:46 justin-processed-pfns.txt
-rw-r--r--. 1 pildune000 dunepil         0 Apr  1 09:31 debugprod.log
justIN time: 2025-04-03 07:37:57 UTC       justIN version: 01.03.00