justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 359655.12@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID359655.12@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5839
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-01 10:11:52
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-04-01 10:15:43
From worker nodeHostnamehnode63.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-01 10:13:25
Input filesusertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root
JobscriptExit code0
Real time1m (72s)
CPU time0m (37s = 51%)
Max RSS bytes1067819008 (1018 MiB)
Outputting started2025-04-01 10:14:37
Output filesusertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101328Z.root
Finished2025-04-01 10:15:43
Saved logsjustin-logs:359655.12-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco1 jobscript.
Input PFN = root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/6e/29/000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Now with regularization...
Begin: 8.59129e+07
0 8.59128e+07
Begin processing the 20th record. run: 20000031 subRun: 0 event: 20 at 01-Apr-2025 12:14:33 CEST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:62 4 XUs and 6 XVs -> 4 XUVs
C:0 T:63 1132 XUs and 978 XVs -> 358 XUVs
C:0 T:64 493 XUs and 533 XVs -> 195 XUVs
C:0 T:70 1769 XUs and 2142 XVs -> 669 XUVs
C:0 T:71 52 XUs and 42 XVs -> 16 XUVs
C:0 T:75 306 XUs and 333 XVs -> 157 XUVs
1399 XUVs total
735 collection wire objects
1399 potential space points
Neighbour search...
37413 tests to find 21496 neighbours
Iterating with no regularization...
Begin: 7.30085e+08
0 7.06899e+08
1 7.05472e+08
2 7.05321e+08
Now with regularization...
Begin: 6.6141e+08
0 6.61359e+08
01-Apr-2025 12:14:35 CEST  Closed output file "000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101328Z.root"
01-Apr-2025 12:14:35 CEST  Closed input file "root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/usertests/6e/29/000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.335669      0.432241       0.6326       0.367769       0.10936        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000195136    0.0124457     0.158865     0.000212431    0.0359749       20     
reco:gaushit:GausHitFinder                     0.334137      0.382588      0.525452      0.353328      0.0572464       20     
reco:spsolve:SpacePointSolver                 6.9112e-05     0.0176339     0.0891271    0.000204182    0.0264133       20     
reco:hitfd:DisambigFromSpacePoints            0.00031377    0.00685598     0.0298541    0.000841956   0.00927739       20     
reco:rns:RandomNumberSaver                    1.3081e-05    2.01263e-05   0.000124714   1.47355e-05   2.4002e-05       20     
[art]:TriggerResults:TriggerResultInserter      6.9e-06     8.70965e-06   2.8311e-05     7.695e-06    4.51573e-06      20     
end_path:out1:RootOutput                       2.26e-06     3.0681e-06     1.177e-05     2.62e-06     2.00526e-06      20     
end_path:out1:RootOutput(write)               0.00065155     0.0125073     0.0416218    0.00147189     0.0152384       20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1979.94 MB
  Peak resident set size usage (VmHWM): 1067.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 50 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w5839s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 20,
        "art.process_name": "Reco1",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v10_04_06d00",
        "core.data_stream": "out1",
        "core.data_tier": "hit-reconstructed",
        "core.end_time": 1743502475.0,
        "core.event_count": 20,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 20,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1743502439.0
    },
    "parents": [
        {
            "did": "usertests:000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z.root"
        }
    ]
}
===================
.:
total 156620
-rw-r--r-- 1 dune001 dune 160310416 Apr  1 12:14 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101328Z.root
-rw-r--r-- 1 dune001 dune     29113 Apr  1 12:14 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_2025-04-01T_101328Z.log
-rw-r--r-- 1 dune001 dune      5155 Apr  1 12:14 jobscript.log
-rw-r--r-- 1 dune001 dune      1137 Apr  1 12:14 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101328Z.root.json
-rw-r--r-- 1 dune001 dune       981 Apr  1 12:14 000012_reco_data_2025-03-31T_142801Z_reco_data_2025-03-31T_150020Z_reco_data_2025-04-01T_083018Z_reco_data_2025-04-01T_101328Z.root.ext.json
-rw-r--r-- 1 dune001 dune       519 Apr  1 12:14 reco1_hist.root
-rw-r--r-- 1 dune001 dune       224 Apr  1 12:13 all-input-dids.txt
-rw-r--r-- 1 dune001 dune       170 Apr  1 12:14 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune         0 Apr  1 12:13 debugprod.log
justIN time: 2025-04-03 08:25:39 UTC       justIN version: 01.03.00