Jobsub ID 260105.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	260105.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	3317
Stage ID	1
User name	amoor@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-09-20 12:28:27
Site	US_NotreDame
Entry	CMSHTPC_T3_US_NotreDame_deepthought
Last heartbeat	2024-09-20 12:32:57
From worker node	Hostname	d12chas582.crc.nd.edu
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	Inner Apptainer?	True
Job state	aborted
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-09-20 12:29:04
Input files	usertests:000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z.root
Outputting started	2024-09-20 12:32:42
Output files
Finished	2024-09-20 12:32:57
List job events Wrapper job log
Jobscript log (last 10,000 characters)

with ID 194
Warning: there was no shower found for shower-like PFParticle with ID 195
Warning: there was no shower found for shower-like PFParticle with ID 196
Warning: there was no shower found for shower-like PFParticle with ID 197
Warning: there was no shower found for shower-like PFParticle with ID 198
Warning: there was no shower found for shower-like PFParticle with ID 199
Warning: there was no shower found for shower-like PFParticle with ID 200
Warning: there was no shower found for shower-like PFParticle with ID 201
Warning: there was no shower found for shower-like PFParticle with ID 202
Warning: there was no shower found for shower-like PFParticle with ID 203
Warning: there was no shower found for shower-like PFParticle with ID 204
Warning: there was no shower found for shower-like PFParticle with ID 205
Warning: there was no shower found for shower-like PFParticle with ID 206
Warning: there was no shower found for shower-like PFParticle with ID 207
Warning: there was no shower found for shower-like PFParticle with ID 208
Warning: there was no shower found for shower-like PFParticle with ID 209
Warning: there was no shower found for shower-like PFParticle with ID 210
Warning: there was no shower found for shower-like PFParticle with ID 211
Warning: there was no shower found for shower-like PFParticle with ID 212
Warning: there was no shower found for shower-like PFParticle with ID 213
Warning: there was no shower found for shower-like PFParticle with ID 214
Warning: there was no shower found for shower-like PFParticle with ID 215
Warning: there was no shower found for shower-like PFParticle with ID 216
Warning: there was no shower found for shower-like PFParticle with ID 217
Warning: there was no shower found for shower-like PFParticle with ID 218
Warning: there was no shower found for shower-like PFParticle with ID 219
Warning: there was no shower found for shower-like PFParticle with ID 220
Warning: there was no shower found for shower-like PFParticle with ID 221
Warning: there was no shower found for shower-like PFParticle with ID 222
Warning: there was no shower found for shower-like PFParticle with ID 223
Warning: there was no shower found for shower-like PFParticle with ID 224
Warning: there was no shower found for shower-like PFParticle with ID 225
Warning: there was no shower found for shower-like PFParticle with ID 226
Warning: there was no shower found for shower-like PFParticle with ID 227
Warning: there was no shower found for shower-like PFParticle with ID 228
Warning: there was no shower found for shower-like PFParticle with ID 229
Warning: there was no shower found for shower-like PFParticle with ID 230
Warning: there was no shower found for shower-like PFParticle with ID 231
Warning: there was no shower found for shower-like PFParticle with ID 232
Warning: there was no shower found for shower-like PFParticle with ID 233
Warning: there was no shower found for shower-like PFParticle with ID 234
Warning: there was no shower found for shower-like PFParticle with ID 235
Warning: there was no shower found for shower-like PFParticle with ID 236
Warning: there was no shower found for shower-like PFParticle with ID 237
Warning: there was no shower found for shower-like PFParticle with ID 238
Warning: there was no shower found for shower-like PFParticle with ID 239
Warning: there was no shower found for shower-like PFParticle with ID 240
Warning: there was no shower found for shower-like PFParticle with ID 241
Warning: there was no shower found for shower-like PFParticle with ID 242
Warning: there was no shower found for shower-like PFParticle with ID 243
Warning: there was no shower found for shower-like PFParticle with ID 244
Warning: there was no shower found for shower-like PFParticle with ID 245
Warning: there was no shower found for shower-like PFParticle with ID 246
Warning: there was no shower found for shower-like PFParticle with ID 247
Warning: there was no shower found for shower-like PFParticle with ID 248
Warning: there was no shower found for shower-like PFParticle with ID 249
Warning: there was no shower found for shower-like PFParticle with ID 250
Warning: there was no shower found for shower-like PFParticle with ID 251
Warning: there was no shower found for shower-like PFParticle with ID 252
Warning: there was no shower found for shower-like PFParticle with ID 253
Warning: there was no shower found for shower-like PFParticle with ID 254
Warning: there was no shower found for shower-like PFParticle with ID 255
Warning: there was no shower found for shower-like PFParticle with ID 256
20-Sep-2024 08:32:34 EDT  Closed output file "000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z_reco_data_2024-09-20T_122918Z.root"
20-Sep-2024 08:32:34 EDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/43/b2/000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z.root"

==============================================================================================================================
TimeTracker printout (sec)                      Min           Avg           Max         Median          RMS         nEvts   
==============================================================================================================================
Full event                                    5.07104       11.5914       18.1117       11.5914       6.52031         2     
------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                       0.0116698     0.012003      0.0123363     0.012003     0.000333254       2     
end_path:out1:RootOutput                     5.691e-06    2.64745e-05   4.7258e-05    2.64745e-05   2.07835e-05       2     
end_path:analysistree:AnalysisTree           0.952228       5.36327       9.77431       5.36327       4.41104         2     
end_path:pandoraeff:NeutrinoTrackingEff     0.000349178   0.000416423   0.000483669   0.000416423   6.72455e-05       2     
end_path:pandorashweff:NeutrinoShowerEff    0.000355158   0.000543752   0.000732346   0.000543752   0.000188594       2     
end_path:runcheckereco:CheckRecoEnergy       1.885e-05    0.000117075   0.000215301   0.000117075   9.82255e-05       2     
end_path:flashmatchAna:FlashMatchAna         0.114336      0.311352      0.508369      0.311352      0.197017         2     
end_path:out1:RootOutput(write)               3.99086       5.90315       7.81543       5.90315       1.91229         2     
==============================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2837.97 MB
  Peak resident set size usage (VmHWM): 1635.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3317s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 4,
        "art.last_event": 128,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726835553.0,
        "core.event_count": 2,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 4,
        "core.last_event_number": 128,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726835529.0
    },
    "parents": [
        {
            "did": "usertests:000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z.root"
        }
    ]
}
===================
.:
total 86476
-rw-r--r-- 1 dune osgusers 86685530 Sep 20 08:32 000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z_reco_data_2024-09-20T_122918Z.root
-rw-r--r-- 1 dune osgusers  1796260 Sep 20 08:32 ana_hist.root
-rw-r--r-- 1 dune osgusers    27435 Sep 20 08:32 000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z_reco_2024-09-20T_122918Z.log
-rw-r--r-- 1 dune osgusers    19937 Sep 20 08:32 jobscript.log
-rw-r--r-- 1 dune osgusers     1202 Sep 20 08:32 000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z_reco_data_2024-09-20T_122918Z.root.json
-rw-r--r-- 1 dune osgusers     1105 Sep 20 08:32 000343_reco_data_2024-08-16T_162142Z_reco_data_2024-08-19T_110647Z_reco_data_2024-08-20T_095436Z_reco_data_2024-08-22T_091530Z_reco_data_2024-09-16T_135837Z_reco_data_2024-09-20T_122918Z.root.ext.json
-rw-r--r-- 1 dune osgusers      344 Sep 20 08:29 all-input-dids.txt
-rw-r--r-- 1 dune osgusers      248 Sep 20 08:32 justin-processed-pfns.txt
-rw-r--r-- 1 dune osgusers        0 Sep 20 08:29 debugprod.log