21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 170140.6@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 170140.6@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 5965 | |
| Stage ID | 1 | |
| User name | amoor@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6291456000 (6000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-04 16:50:38 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly | |
| Last heartbeat | 2025-04-05 01:31:48 | |
| From worker node | Hostname | dunegli-4406005-0-fnpc9027.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6291456000 (6000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-04 17:07:12 | |
| Input files | usertests:000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 8h (30120s) | |
| CPU time | 8h (29957s = 99%) | |
| Max RSS bytes | 6499278848 (6198 MiB) | |
| Outputting started | 2025-04-05 01:29:13 | |
| Output files | usertests:000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root | |
| Finished | 2025-04-05 01:31:48 | |
| Saved logs | justin-logs:170140.6-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
AFM detsim jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/ca/04/000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
wclsFrameSaver: no traces tagged "wiener"
FrameSaver: q=0 n=0 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 999th record. run: 20000031 subRun: 0 event: 999 at 05-Apr-2025 01:27:17 UTC
SimDepoSource got 42157 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 42157 depos spanning: [0.0382525, 0.0834781]us
Retagger: tagging trace set: wiener with 9844 traces, 9844 summary
Retagger: tagging trace set: gauss with 6237 traces, 0 summary
wclsFrameSaver: saving 6237 traces tagged "gauss"
FrameSaver: q=1.24557e+06 n=94912 tag=gauss
wclsFrameSaver: saving 9844 traces tagged "wiener"
FrameSaver: q=1.35439e+06 n=79605 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
Begin processing the 1000th record. run: 20000031 subRun: 0 event: 1000 at 05-Apr-2025 01:28:07 UTC
SimDepoSource got 41370 depos from art tag "InputTag: label = 'IonAndScint', instance = ''" returns: okay
SimDepoSource: ready with 41370 depos spanning: [0.0383878, 0.0791154]us
Retagger: tagging trace set: wiener with 10059 traces, 10059 summary
Retagger: tagging trace set: gauss with 5966 traces, 0 summary
wclsFrameSaver: saving 5966 traces tagged "gauss"
FrameSaver: q=1.1402e+06 n=95394 tag=gauss
wclsFrameSaver: saving 10059 traces tagged "wiener"
FrameSaver: q=1.23257e+06 n=78826 tag=wiener
wclsFrameSaver: no traces tagged "dnnsp"
FrameSaver: q=0 n=0 tag=dnnsp
05-Apr-2025 01:29:01 UTC Closed output file "000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root"
05-Apr-2025 01:29:01 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/ca/04/000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 0.731236 29.6802 1834.09 1.02872 75.2439 1000
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000218383 0.0049543 0.763137 0.000363178 0.0287524 1000
simulate:tpcrawdecoder:WireCellToolkit 0.303795 28.9948 1825.98 0.592304 74.8272 1000
simulate:opdigi:OpDetDigitizerDUNE 5.0762e-05 0.157262 5.25745 0.00150677 0.301339 1000
simulate:rns:RandomNumberSaver 1.5382e-05 0.000340675 0.00128058 0.00031613 0.000343446 1000
[art]:TriggerResults:TriggerResultInserter 8.814e-06 0.000278431 0.00103427 5.74885e-05 0.000297487 1000
end_path:out1:RootOutput 2.476e-06 3.38068e-06 2.6221e-05 3.1955e-06 1.37004e-06 1000
end_path:out1:RootOutput(write) 0.367837 0.520929 2.85485 0.428028 0.194771 1000
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 8454.2 MB
Peak resident set size usage (VmHWM): 6499.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
outfile is 000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
"metadata": {
"DUNE.campaign": "justIN.w5965s1",
"art.file_format_era": "ART_2011a",
"art.file_format_version": 15,
"art.first_event": 1,
"art.last_event": 1000,
"art.process_name": "detsim",
"art.run_type": "physics",
"core.application": "art.reco",
"core.application.family": "art",
"core.application.name": "reco",
"core.application.version": "v10_04_06d00",
"core.data_stream": "out1",
"core.data_tier": "detector-simulated",
"core.end_time": 1743816541.0,
"core.event_count": 1000,
"core.file_format": "artroot",
"core.file_type": "mc",
"core.first_event_number": 1,
"core.last_event_number": 1000,
"core.run_type": "physics",
"core.runs": [
20000031
],
"core.runs_subruns": [
2000003100000
],
"core.start_time": 1743786758.0
},
"parents": [
{
"did": "usertests:000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z.root"
}
]
}
===================
.:
total 8464328
-rw-r--r-- 1 dunegli fnalgrid 8219320537 Apr 5 01:29 000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root
-rw-r--r-- 1 dunegli fnalgrid 447529501 Apr 5 01:29 wcls-sim-drift-simchannel-nf-sp.log
-rw-r--r-- 1 dunegli fnalgrid 574399 Apr 5 01:29 000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_2025-04-04T_170716Z.log
-rw-r--r-- 1 dunegli fnalgrid 5810 Apr 5 01:29 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 1115 Apr 5 01:29 000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root.json
-rw-r--r-- 1 dunegli fnalgrid 930 Apr 5 01:29 000352_reco_data_2025-04-02T_082844Z_reco_data_2025-04-02T_195659Z_reco_data_2025-04-04T_170716Z.root.ext.json
-rw-r--r-- 1 dunegli fnalgrid 164 Apr 4 17:07 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 158 Apr 5 01:29 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Apr 4 17:07 debugprod.log