justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 359655.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID359655.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5839
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 10:11:52
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-04-01 10:17:42
From worker nodeHostnametd822.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 10:13:41
Input filesusertests:000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z.root
JobscriptExit code0
Real time2m (123s)
CPU time1m (79s = 64%)
Max RSS bytes1048694784 (1000 MiB)
Outputting started2025-04-01 10:15:46
Output filesusertests:000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_data_2025-04-01T_101349Z.root
Finished2025-04-01 10:17:42
Saved logsjustin-logs:359655.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco1 jobscript.
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/54/cc/000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Begin processing the 16th record. run: 20000031 subRun: 0 event: 16 at 01-Apr-2025 12:15:32 CEST
Begin processing the 17th record. run: 20000031 subRun: 0 event: 17 at 01-Apr-2025 12:15:34 CEST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:6 180 XUs and 136 XVs -> 36 XUVs
C:0 T:7 335 XUs and 298 XVs -> 87 XUVs
C:0 T:13 1990 XUs and 861 XVs -> 571 XUVs
C:0 T:19 99 XUs and 40 XVs -> 23 XUVs
C:0 T:25 58 XUs and 20 XVs -> 18 XUVs
735 XUVs total
599 collection wire objects
735 potential space points
Neighbour search...
12023 tests to find 6400 neighbours
Iterating with no regularization...
Begin: 6.4253e+07
0 5.81995e+07
1 5.79913e+07
2 5.79786e+07
Now with regularization...
Begin: 4.2667e+07
0 4.26633e+07
Begin processing the 18th record. run: 20000031 subRun: 0 event: 18 at 01-Apr-2025 12:15:35 CEST
Begin processing the 19th record. run: 20000031 subRun: 0 event: 19 at 01-Apr-2025 12:15:36 CEST
Begin processing the 20th record. run: 20000031 subRun: 0 event: 20 at 01-Apr-2025 12:15:38 CEST
01-Apr-2025 12:15:40 CEST  Closed output file "000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_data_2025-04-01T_101349Z.root"
01-Apr-2025 12:15:40 CEST  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/54/cc/000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.599212      0.741633       1.23804      0.686723      0.163412        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000315004   0.00764764     0.0542955    0.000367014    0.0159644       20     
reco:gaushit:GausHitFinder                     0.594397      0.685347      0.987181      0.668804      0.0896919       20     
reco:spsolve:SpacePointSolver                 0.000115811    0.0193426     0.128538     0.000140752    0.0364846       20     
reco:hitfd:DisambigFromSpacePoints            0.000488546     0.0107       0.0558943    0.000613617    0.0177977       20     
reco:rns:RandomNumberSaver                     2.424e-05    4.11269e-05   0.000264173   2.93155e-05   5.12902e-05      20     
[art]:TriggerResults:TriggerResultInserter     1.123e-05    1.63668e-05    5.319e-05     1.402e-05    8.8357e-06       20     
end_path:out1:RootOutput                        3.6e-06      5.238e-06     2.147e-05    4.2445e-06    3.83522e-06      20     
end_path:out1:RootOutput(write)               0.00113845     0.0182015     0.0865623    0.00265171     0.0273126       20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1980.06 MB
  Peak resident set size usage (VmHWM): 1048.69 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5839s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "Reco1",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "hit-reconstructed",
        "core.end_time": 1743502540.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743502498.0
    },
    "parents": [
        {
            "did": "usertests:000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z.root"
        }
    ]
}
===================
.:
total 115092
-rw-r--r-- 1 dune001 dune 117790990 Apr  1 12:15 000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_data_2025-04-01T_101349Z.root
-rw-r--r-- 1 dune001 dune     27389 Apr  1 12:15 000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_2025-04-01T_101349Z.log
-rw-r--r-- 1 dune001 dune      5421 Apr  1 12:15 jobscript.log
-rw-r--r-- 1 dune001 dune      1137 Apr  1 12:15 000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_data_2025-04-01T_101349Z.root.json
-rw-r--r-- 1 dune001 dune       981 Apr  1 12:15 000008_reco_data_2025-03-31T_142624Z_reco_data_2025-03-31T_145956Z_reco_data_2025-04-01T_083014Z_reco_data_2025-04-01T_101349Z.root.ext.json
-rw-r--r-- 1 dune001 dune       519 Apr  1 12:15 reco1_hist.root
-rw-r--r-- 1 dune001 dune       224 Apr  1 12:13 all-input-dids.txt
-rw-r--r-- 1 dune001 dune       163 Apr  1 12:15 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune         0 Apr  1 12:14 debugprod.log
justIN time: 2025-04-03 08:17:49 UTC       justIN version: 01.03.00