justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260220.161@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID260220.161@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3322
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-20 16:01:25
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-09-20 17:48:15
From worker nodeHostnamelnxfarm232.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 17:45:42
Input filesusertests:000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z.root
JobscriptExit code0
Real time2m (135s)
CPU time0m (22s = 16%)
Outputting started2024-09-20 17:47:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/03322/1/000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_20240920T174754_ana_hist.root
Finished2024-09-20 17:48:15
Saved logsjustin-logs:260220.161-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

with ID 18
Warning: there was no track found for track-like PFParticle with ID 19
Warning: there was no shower found for shower-like PFParticle with ID 20
Warning: there was no track found for track-like PFParticle with ID 21
Warning: there was no shower found for shower-like PFParticle with ID 22
Warning: there was no track found for track-like PFParticle with ID 23
Warning: there was no shower found for shower-like PFParticle with ID 24
Warning: there was no track found for track-like PFParticle with ID 25
Warning: there was no track found for track-like PFParticle with ID 26
Warning: there was no shower found for shower-like PFParticle with ID 27
Warning: there was no shower found for shower-like PFParticle with ID 28
Warning: there was no track found for track-like PFParticle with ID 29
Warning: there was no shower found for shower-like PFParticle with ID 30
Warning: there was no track found for track-like PFParticle with ID 31
Warning: there was no shower found for shower-like PFParticle with ID 32
Warning: there was no track found for track-like PFParticle with ID 33
Warning: there was no track found for track-like PFParticle with ID 34
Warning: there was no track found for track-like PFParticle with ID 35
Warning: there was no track found for track-like PFParticle with ID 36
Warning: there was no track found for track-like PFParticle with ID 37
Warning: there was no track found for track-like PFParticle with ID 38
Warning: there was no shower found for shower-like PFParticle with ID 39
Warning: there was no shower found for shower-like PFParticle with ID 40
Warning: there was no shower found for shower-like PFParticle with ID 41
Warning: there was no shower found for shower-like PFParticle with ID 42
Warning: there was no shower found for shower-like PFParticle with ID 43
Warning: there was no shower found for shower-like PFParticle with ID 44
Warning: there was no shower found for shower-like PFParticle with ID 45
Warning: there was no shower found for shower-like PFParticle with ID 46
Warning: there was no shower found for shower-like PFParticle with ID 47
Warning: there was no shower found for shower-like PFParticle with ID 48
Begin processing the 6th record. run: 20000031 subRun: 0 event: 841 at 20-Sep-2024 11:47:49 MDT
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no track found for track-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no shower found for shower-like PFParticle with ID 4
Warning: there was no shower found for shower-like PFParticle with ID 5
Warning: there was no shower found for shower-like PFParticle with ID 6
Warning: there was no shower found for shower-like PFParticle with ID 7
Warning: there was no shower found for shower-like PFParticle with ID 8
Warning: there was no shower found for shower-like PFParticle with ID 9
Warning: there was no shower found for shower-like PFParticle with ID 10
Warning: there was no shower found for shower-like PFParticle with ID 11
Warning: there was no shower found for shower-like PFParticle with ID 12
Warning: there was no shower found for shower-like PFParticle with ID 13
Begin processing the 7th record. run: 20000031 subRun: 0 event: 962 at 20-Sep-2024 11:47:52 MDT
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 1
20-Sep-2024 11:47:53 MDT  Closed output file "000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_reco_data_2024-09-20T_174545Z.root"
20-Sep-2024 11:47:53 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/43/4a/000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        1.06129       1.5375        2.31699       1.48652      0.362085         7     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0326708     0.0470525     0.0496453     0.0494846    0.00587434        7     
end_path:out1:RootOutput                         3.938e-06    1.02297e-05   3.9192e-05     5.777e-06    1.18634e-05       7     
end_path:analysistree:AnalysisTree               0.837616       1.22294       1.79762       1.19753      0.271591         7     
end_path:pmtrackeff:NeutrinoTrackingEff          6.645e-05    0.000136199   0.000297774   8.9006e-05    7.70568e-05       7     
end_path:pmtracktceff:NeutrinoTrackingEff       3.2775e-05    3.77893e-05   4.4022e-05    3.6948e-05    3.85262e-06       7     
end_path:pandoraeff:NeutrinoTrackingEff         3.2019e-05    3.63999e-05   4.3772e-05    3.4382e-05    4.54041e-06       7     
end_path:pmtrajfiteff:NeutrinoTrackingEff        3.163e-05    3.41699e-05   4.2844e-05    3.2688e-05    3.63518e-06       7     
end_path:pmtrajfittceff:NeutrinoTrackingEff     3.1496e-05    3.41531e-05   4.4905e-05    3.2441e-05    4.41613e-06       7     
end_path:pandorashweff:NeutrinoShowerEff        4.0506e-05    8.88129e-05   0.00032209    4.2759e-05    9.58281e-05       7     
end_path:emshowershweff:NeutrinoShowerEff       3.8379e-05    5.20877e-05   7.7183e-05     4.239e-05    1.51709e-05       7     
end_path:trajclustershweff:NeutrinoShowerEff    3.7446e-05    5.05196e-05   8.5494e-05    4.1277e-05    1.58517e-05       7     
end_path:runcheckereco:CheckRecoEnergy          1.2591e-05    3.54304e-05   0.000162654   1.3489e-05    5.19591e-05       7     
end_path:flashmatchAna:FlashMatchAna             0.0985365     0.192335      0.394908      0.164421      0.094598         7     
end_path:out1:RootOutput(write)                  0.0735375     0.0742276     0.074833      0.0742455    0.000377473       7     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2132.46 MB
  Peak resident set size usage (VmHWM): 978.211 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3322s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 102,
        "art.last_event": 962,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726854473.0,
        "core.event_count": 7,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 102,
        "core.last_event_number": 962,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726854364.0
    },
    "parents": [
        {
            "did": "usertests:000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z.root"
        }
    ]
}
===================
.:
total 58844
-rw-r--r-- 1 dunepilot gridusers 58945131 Sep 20 11:47 000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_reco_data_2024-09-20T_174545Z.root
-rw-r--r-- 1 dunepilot gridusers  1255605 Sep 20 11:47 000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_20240920T174754_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers    17884 Sep 20 11:47 jobscript.log
-rw-r--r-- 1 dunepilot gridusers    15008 Sep 20 11:47 000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_reco_2024-09-20T_174545Z.log
-rw-r--r-- 1 dunepilot gridusers     1206 Sep 20 11:47 000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_reco_data_2024-09-20T_174545Z.root.json
-rw-r--r-- 1 dunepilot gridusers     1109 Sep 20 11:47 000508_reco_data_2024-08-16T_162424Z_reco_data_2024-08-19T_111820Z_reco_data_2024-08-20T_122520Z_reco_data_2024-08-22T_091633Z_reco_data_2024-08-23T_095937Z_reco_data_2024-09-20T_174545Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers      344 Sep 20 11:45 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers      248 Sep 20 11:47 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers        0 Sep 20 11:45 debugprod.log
justIN time: 2024-09-29 15:27:53 UTC       justIN version: 01.01.08