justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260220.164@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID260220.164@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3322
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-20 16:01:25
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-09-20 17:51:21
From worker nodeHostnamelnxfarm232.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 17:49:04
Input filesusertests:000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z.root
JobscriptExit code0
Real time2m (121s)
CPU time0m (35s = 28%)
Outputting started2024-09-20 17:51:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/03322/1/000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_20240920T175103_ana_hist.root
Finished2024-09-20 17:51:21
Saved logsjustin-logs:260220.164-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ticle with ID 265
Warning: there was no vertex found for PFParticle with ID 266
Warning: there was no shower found for shower-like PFParticle with ID 266
Warning: there was no vertex found for PFParticle with ID 267
Warning: there was no shower found for shower-like PFParticle with ID 267
Warning: there was no vertex found for PFParticle with ID 268
Warning: there was no shower found for shower-like PFParticle with ID 268
Warning: there was no vertex found for PFParticle with ID 269
Warning: there was no shower found for shower-like PFParticle with ID 269
Warning: there was no vertex found for PFParticle with ID 270
Warning: there was no shower found for shower-like PFParticle with ID 270
Warning: there was no vertex found for PFParticle with ID 271
Warning: there was no shower found for shower-like PFParticle with ID 271
Warning: there was no shower found for shower-like PFParticle with ID 272
Warning: there was no shower found for shower-like PFParticle with ID 273
Warning: there was no shower found for shower-like PFParticle with ID 274
Warning: there was no shower found for shower-like PFParticle with ID 275
Warning: there was no shower found for shower-like PFParticle with ID 276
Warning: there was no shower found for shower-like PFParticle with ID 277
Warning: there was no shower found for shower-like PFParticle with ID 278
Warning: there was no shower found for shower-like PFParticle with ID 279
Warning: there was no shower found for shower-like PFParticle with ID 280
Warning: there was no shower found for shower-like PFParticle with ID 281
Warning: there was no shower found for shower-like PFParticle with ID 282
Warning: there was no shower found for shower-like PFParticle with ID 283
Warning: there was no shower found for shower-like PFParticle with ID 284
Warning: there was no shower found for shower-like PFParticle with ID 285
Begin processing the 6th record. run: 20000031 subRun: 0 event: 645 at 20-Sep-2024 11:50:59 MDT
Analysing.

Begin processing the 7th record. run: 20000031 subRun: 0 event: 795 at 20-Sep-2024 11:51:00 MDT
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no shower found for shower-like PFParticle with ID 4
Warning: there was no shower found for shower-like PFParticle with ID 5
Warning: there was no shower found for shower-like PFParticle with ID 6
Warning: there was no shower found for shower-like PFParticle with ID 7
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no shower found for shower-like PFParticle with ID 9
Warning: there was no track found for track-like PFParticle with ID 10
Warning: there was no shower found for shower-like PFParticle with ID 11
Warning: there was no shower found for shower-like PFParticle with ID 12
Warning: there was no shower found for shower-like PFParticle with ID 13
Warning: there was no shower found for shower-like PFParticle with ID 14
Warning: there was no shower found for shower-like PFParticle with ID 15
Warning: there was no shower found for shower-like PFParticle with ID 16
Warning: there was no shower found for shower-like PFParticle with ID 17
Warning: there was no shower found for shower-like PFParticle with ID 18
Warning: there was no shower found for shower-like PFParticle with ID 19
20-Sep-2024 11:51:02 MDT  Closed output file "000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_reco_data_2024-09-20T_174908Z.root"
20-Sep-2024 11:51:02 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/53/33/000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        1.15807       4.06923       13.8052       1.73231       4.4272          7     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0246591     0.0354149     0.049981      0.0251369     0.0121191        7     
end_path:out1:RootOutput                         4.026e-06    9.55543e-06   3.9923e-05     4.642e-06    1.24022e-05       7     
end_path:analysistree:AnalysisTree               0.867704       3.31729        11.33        1.44892       3.61875         7     
end_path:pmtrackeff:NeutrinoTrackingEff         5.0213e-05    0.000176888    0.0005003    9.4315e-05    0.000155836       7     
end_path:pmtracktceff:NeutrinoTrackingEff       3.3093e-05    4.54396e-05   0.000107444   3.3827e-05    2.54897e-05       7     
end_path:pandoraeff:NeutrinoTrackingEff         3.1695e-05    4.37916e-05   0.00010388     3.264e-05    2.46751e-05       7     
end_path:pmtrajfiteff:NeutrinoTrackingEff       3.1297e-05    4.28304e-05   0.000103262   3.1746e-05    2.47598e-05       7     
end_path:pmtrajfittceff:NeutrinoTrackingEff     3.1233e-05    4.27461e-05   0.00010307    3.1631e-05    2.47069e-05       7     
end_path:pandorashweff:NeutrinoShowerEff        4.0167e-05    9.85581e-05   0.000356345   4.2872e-05    0.000108153       7     
end_path:emshowershweff:NeutrinoShowerEff       3.8179e-05    6.1343e-05    0.000116418   4.0127e-05    3.25892e-05       7     
end_path:trajclustershweff:NeutrinoShowerEff    3.6242e-05    6.07687e-05   0.000113461    3.947e-05    3.27446e-05       7     
end_path:runcheckereco:CheckRecoEnergy          1.0311e-05    3.44643e-05   0.00017687    1.0537e-05    5.8138e-05        7     
end_path:flashmatchAna:FlashMatchAna             0.0810871     0.640274       2.34999      0.191132      0.809508         7     
end_path:out1:RootOutput(write)                  0.0734295     0.0752397     0.0808093     0.073678     0.00273235        7     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2726.31 MB
  Peak resident set size usage (VmHWM): 1367.88 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3322s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 153,
        "art.last_event": 795,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726854662.0,
        "core.event_count": 7,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 153,
        "core.last_event_number": 795,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726854566.0
    },
    "parents": [
        {
            "did": "usertests:000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z.root"
        }
    ]
}
===================
.:
total 252232
-rw-r--r-- 1 dunepilot gridusers 254433737 Sep 20 11:51 000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_reco_data_2024-09-20T_174908Z.root
-rw-r--r-- 1 dunepilot gridusers   3759479 Sep 20 11:51 000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_20240920T175103_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     52738 Sep 20 11:51 000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_reco_2024-09-20T_174908Z.log
-rw-r--r-- 1 dunepilot gridusers     19857 Sep 20 11:51 jobscript.log
-rw-r--r-- 1 dunepilot gridusers      1206 Sep 20 11:51 000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_reco_data_2024-09-20T_174908Z.root.json
-rw-r--r-- 1 dunepilot gridusers      1110 Sep 20 11:51 000577_reco_data_2024-08-16T_162527Z_reco_data_2024-08-19T_113053Z_reco_data_2024-08-20T_120704Z_reco_data_2024-08-22T_092215Z_reco_data_2024-09-16T_140125Z_reco_data_2024-09-20T_174908Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers       344 Sep 20 11:49 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers       248 Sep 20 11:51 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers         0 Sep 20 11:49 debugprod.log
justIN time: 2024-09-29 15:39:29 UTC       justIN version: 01.01.08