21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 169803.118@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 169803.118@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5965 | |
| Stage ID | 1 | |
| User name | amoor@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6291456000 (6000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-04 09:05:29 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2025-04-05 01:06:21 | |
| From worker node | Hostname | dunegli-4406549-0-fnpc7016.fnal.gov |
| cpuinfo | AMD Opteron(tm) Processor 6376 | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6291456000 (6000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-04 10:52:18 | |
| Input files | usertests:000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 14h (50990s) | |
| CPU time | 13h (48025s = 94%) | |
| Max RSS bytes | 6354616320 (6060 MiB) | |
| Outputting started | 2025-04-05 01:02:08 | |
| Output files | usertests:000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root | |
| Finished | 2025-04-05 01:06:21 | |
| Saved logs | justin-logs:169803.118-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
AFM detsim jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/23/f5/000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
SimDepoSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 999th record. run: 20000031 subRun: 0 event: 999 at 05-Apr-2025 01:01:00 UTC
SimDepoSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 1000th record. run: 20000031 subRun: 0 event: 1000 at 05-Apr-2025 01:01:01 UTC
SimDepoSource got 0 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 1 depos spanning: [0, 0]us
wclsFrameSaver: no traces tagged "gauss"
FrameSaver: q=0 n=0 tag=gauss
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
05-Apr-2025 01:01:15 UTC Closed output file "000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root"
05-Apr-2025 01:01:15 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/23/f5/000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 1.08953 49.1768 1086.04 1.81333 88.8187 1000
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000360101 0.00642372 1.67626 0.000594597 0.0546938 1000
simulate:tpcrawdecoder:WireCellToolkit 0.387456 46.9806 1076.76 0.778305 86.8512 1000
simulate:opdigi:OpDetDigitizerDUNE 7.7633e-05 0.309025 10.9282 0.00190881 0.641818 1000
simulate:rns:RandomNumberSaver 2.1834e-05 0.000277084 0.00155809 4.1878e-05 0.000399044 1000
[art]:TriggerResults:TriggerResultInserter 1.4371e-05 0.00023506 0.00154338 2.0951e-05 0.000382211 1000
end_path:out1:RootOutput 3.04e-06 4.93019e-06 2.5389e-05 4.5745e-06 1.77471e-06 1000
end_path:out1:RootOutput(write) 0.671183 1.87665 49.5864 0.730864 4.19109 1000
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8260.72 MB
Peak resident set size usage (VmHWM): 6354.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
"metadata": {
"DUNE.campaign": "justIN.w5965s1",
"art.file_format_era": "ART_2011a",
"art.file_format_version": 15,
"art.first_event": 1,
"art.last_event": 1000,
"art.process_name": "detsim",
"art.run_type": "physics",
"core.application": "art.reco",
"core.application.family": "art",
"core.application.name": "reco",
"core.application.version": "v10_04_06d00",
"core.data_stream": "out1",
"core.data_tier": "detector-simulated",
"core.end_time": 1743814864.0,
"core.event_count": 1000,
"core.file_format": "artroot",
"core.file_type": "mc",
"core.first_event_number": 1,
"core.last_event_number": 1000,
"core.run_type": "physics",
"core.runs": [
20000031
],
"core.runs_subruns": [
2000003100000
],
"core.start_time": 1743764511.0
},
"parents": [
{
"did": "usertests:000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z.root"
}
]
}
===================
.:
total 8089864
-rw-r--r-- 1 dunegli fnalgrid 7835647287 Apr 5 01:01 000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root
-rw-r--r-- 1 dunegli fnalgrid 447756416 Apr 5 01:01 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r-- 1 dunegli fnalgrid 576530 Apr 5 01:01 000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_2025-04-04T_105319Z.log
-rw-r--r-- 1 dunegli fnalgrid 5635 Apr 5 01:01 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 1115 Apr 5 01:01 000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root.json
-rw-r--r-- 1 dunegli fnalgrid 930 Apr 5 01:01 000668_reco_data_2025-04-02T_083741Z_reco_data_2025-04-02T_231100Z_reco_data_2025-04-04T_105319Z.root.ext.json
-rw-r--r-- 1 dunegli fnalgrid 164 Apr 4 10:52 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 158 Apr 5 01:01 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Apr 4 10:53 debugprod.log