justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 359655.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID359655.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5839
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 10:11:52
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-04-01 10:15:52
From worker nodeHostnametd810.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 10:13:09
Input filesusertests:000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z.root
JobscriptExit code0
Real time1m (90s)
CPU time0m (38s = 42%)
Max RSS bytes1061994496 (1012 MiB)
Outputting started2025-04-01 10:14:39
Output filesusertests:000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_data_2025-04-01T_101318Z.root
Finished2025-04-01 10:15:52
Saved logsjustin-logs:359655.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco1 jobscript.
Input PFN = root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/92/68/000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Begin processing the 17th record. run: 20000031 subRun: 0 event: 17 at 01-Apr-2025 12:14:29 CEST
Begin processing the 18th record. run: 20000031 subRun: 0 event: 18 at 01-Apr-2025 12:14:30 CEST
Begin processing the 19th record. run: 20000031 subRun: 0 event: 19 at 01-Apr-2025 12:14:31 CEST
Begin processing the 20th record. run: 20000031 subRun: 0 event: 20 at 01-Apr-2025 12:14:32 CEST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:224 916 XUs and 2745 XVs -> 518 XUVs
C:0 T:231 3353 XUs and 1886 XVs -> 613 XUVs
C:0 T:236 522 XUs and 504 XVs -> 94 XUVs
C:0 T:237 672 XUs and 429 XVs -> 131 XUVs
C:0 T:243 3943 XUs and 1214 XVs -> 644 XUVs
C:0 T:255 112 XUs and 37 XVs -> 29 XUVs
2029 XUVs total
1136 collection wire objects
2029 potential space points
Neighbour search...
94271 tests to find 45386 neighbours
Iterating with no regularization...
Begin: 3.70309e+08
0 3.08155e+08
1 3.05334e+08
2 3.05143e+08
Now with regularization...
Begin: 2.71678e+08
0 2.71559e+08
01-Apr-2025 12:14:34 CEST  Closed output file "000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_data_2025-04-01T_101318Z.root"
01-Apr-2025 12:14:34 CEST  Closed input file "root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/92/68/000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.344369       0.45385      0.756877      0.391814      0.124051        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000212871    0.0104422     0.112534     0.000232642    0.0271525       20     
reco:gaushit:GausHitFinder                     0.342599      0.384949      0.511467      0.349468      0.050892        20     
reco:spsolve:SpacePointSolver                  7.081e-05     0.0388761     0.298267     0.000213467    0.0749776       20     
reco:hitfd:DisambigFromSpacePoints            0.000332452   0.00615477     0.0225701    0.000583339   0.00793025       20     
reco:rns:RandomNumberSaver                     1.318e-05    2.11066e-05   0.000120201    1.552e-05    2.27826e-05      20     
[art]:TriggerResults:TriggerResultInserter     7.09e-06     9.83515e-06    2.724e-05    8.2105e-06    5.17683e-06      20     
end_path:out1:RootOutput                       2.769e-06    3.57595e-06    1.201e-05     3.04e-06     1.97672e-06      20     
end_path:out1:RootOutput(write)               0.000674675    0.0132146     0.0440105    0.000940361    0.015868        20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1979.94 MB
  Peak resident set size usage (VmHWM): 1061.99 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5839s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "Reco1",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "hit-reconstructed",
        "core.end_time": 1743502474.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743502437.0
    },
    "parents": [
        {
            "did": "usertests:000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z.root"
        }
    ]
}
===================
.:
total 153760
-rw-r--r-- 1 dune001 dune 157381578 Apr  1 12:14 000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_data_2025-04-01T_101318Z.root
-rw-r--r-- 1 dune001 dune     29358 Apr  1 12:14 000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_2025-04-01T_101318Z.log
-rw-r--r-- 1 dune001 dune      5402 Apr  1 12:14 jobscript.log
-rw-r--r-- 1 dune001 dune      1137 Apr  1 12:14 000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_data_2025-04-01T_101318Z.root.json
-rw-r--r-- 1 dune001 dune       981 Apr  1 12:14 000001_reco_data_2025-03-31T_142544Z_reco_data_2025-03-31T_145944Z_reco_data_2025-04-01T_083034Z_reco_data_2025-04-01T_101318Z.root.ext.json
-rw-r--r-- 1 dune001 dune       519 Apr  1 12:14 reco1_hist.root
-rw-r--r-- 1 dune001 dune       224 Apr  1 12:13 all-input-dids.txt
-rw-r--r-- 1 dune001 dune       170 Apr  1 12:14 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune         0 Apr  1 12:13 debugprod.log
justIN time: 2025-04-03 08:25:36 UTC       justIN version: 01.03.00