justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260220.162@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID260220.162@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3322
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-20 16:01:25
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-09-20 17:49:37
From worker nodeHostnamelnxfarm232.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 17:46:13
Input filesusertests:000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z.root
JobscriptExit code0
Real time3m (189s)
CPU time0m (44s = 23%)
Outputting started2024-09-20 17:49:23
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/03322/1/000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_20240920T174919_ana_hist.root
Finished2024-09-20 17:49:37
Saved logsjustin-logs:260220.162-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ack found for track-like PFParticle with ID 27
Warning: there was no track found for track-like PFParticle with ID 28
Warning: there was no track found for track-like PFParticle with ID 29
Warning: there was no shower found for shower-like PFParticle with ID 30
Warning: there was no shower found for shower-like PFParticle with ID 31
Warning: there was no track found for track-like PFParticle with ID 32
Warning: there was no shower found for shower-like PFParticle with ID 33
Warning: there was no shower found for shower-like PFParticle with ID 34
Warning: there was no shower found for shower-like PFParticle with ID 35
Warning: there was no shower found for shower-like PFParticle with ID 36
Warning: there was no track found for track-like PFParticle with ID 37
Warning: there was no shower found for shower-like PFParticle with ID 38
Warning: there was no track found for track-like PFParticle with ID 39
Warning: there was no track found for track-like PFParticle with ID 40
Warning: there was no track found for track-like PFParticle with ID 41
Warning: there was no track found for track-like PFParticle with ID 42
Warning: there was no shower found for shower-like PFParticle with ID 43
Warning: there was no shower found for shower-like PFParticle with ID 44
Warning: there was no shower found for shower-like PFParticle with ID 45
Warning: there was no track found for track-like PFParticle with ID 46
Warning: there was no track found for track-like PFParticle with ID 47
Warning: there was no track found for track-like PFParticle with ID 48
Warning: there was no vertex found for PFParticle with ID 49
Warning: there was no shower found for shower-like PFParticle with ID 49
Warning: there was no track found for track-like PFParticle with ID 50
Warning: there was no shower found for shower-like PFParticle with ID 51
Warning: there was no track found for track-like PFParticle with ID 52
Warning: there was no shower found for shower-like PFParticle with ID 53
Warning: there was no track found for track-like PFParticle with ID 54
Warning: there was no track found for track-like PFParticle with ID 55
Warning: there was no track found for track-like PFParticle with ID 56
Warning: there was no shower found for shower-like PFParticle with ID 57
Warning: there was no track found for track-like PFParticle with ID 58
Warning: there was no track found for track-like PFParticle with ID 59
Warning: there was no shower found for shower-like PFParticle with ID 60
Warning: there was no shower found for shower-like PFParticle with ID 61
Warning: there was no shower found for shower-like PFParticle with ID 62
Warning: there was no shower found for shower-like PFParticle with ID 63
Warning: there was no shower found for shower-like PFParticle with ID 64
Warning: there was no shower found for shower-like PFParticle with ID 65
Warning: there was no shower found for shower-like PFParticle with ID 66
Warning: there was no shower found for shower-like PFParticle with ID 67
Begin processing the 13th record. run: 20000031 subRun: 0 event: 902 at 20-Sep-2024 11:49:17 MDT
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no track found for track-like PFParticle with ID 3
Warning: there was no shower found for shower-like PFParticle with ID 4
Warning: there was no shower found for shower-like PFParticle with ID 5
20-Sep-2024 11:49:19 MDT  Closed output file "000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_reco_data_2024-09-20T_174617Z.root"
20-Sep-2024 11:49:19 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/8b/7f/000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.975821       3.3909        8.80331       2.3461        2.26494        13     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0245355     0.0394574     0.0593234     0.0486839     0.0129089       13     
end_path:out1:RootOutput                         2.866e-06    7.22638e-06   3.9321e-05     4.524e-06    9.29084e-06      13     
end_path:analysistree:AnalysisTree               0.804673       2.49974       5.30603       2.09153       1.51307        13     
end_path:pmtrackeff:NeutrinoTrackingEff         6.8435e-05    0.000113238   0.000312401   9.7869e-05    6.08457e-05      13     
end_path:pmtracktceff:NeutrinoTrackingEff       3.3516e-05    4.02462e-05    8.789e-05    3.5624e-05    1.40073e-05      13     
end_path:pandoraeff:NeutrinoTrackingEff         3.0967e-05    3.65125e-05   6.2385e-05    3.4139e-05    7.90501e-06      13     
end_path:pmtrajfiteff:NeutrinoTrackingEff       3.1031e-05    3.72672e-05   6.2376e-05    3.3188e-05    8.75794e-06      13     
end_path:pmtrajfittceff:NeutrinoTrackingEff     3.0611e-05    3.60367e-05   6.1739e-05    3.3451e-05    7.82698e-06      13     
end_path:pandorashweff:NeutrinoShowerEff        4.1019e-05    6.7632e-05    0.000341014   4.3865e-05    7.90014e-05      13     
end_path:emshowershweff:NeutrinoShowerEff       3.6691e-05    4.61536e-05   7.6795e-05    4.1594e-05    1.08859e-05      13     
end_path:trajclustershweff:NeutrinoShowerEff    3.6984e-05    4.64714e-05   9.4254e-05    4.1387e-05    1.44874e-05      13     
end_path:runcheckereco:CheckRecoEnergy          1.0367e-05    2.28997e-05   0.000164742   1.1079e-05    4.09487e-05      13     
end_path:flashmatchAna:FlashMatchAna             0.0730002     0.774985       3.3744       0.597993       0.85177        13     
end_path:out1:RootOutput(write)                  0.0728994     0.075883      0.0825959     0.0736242    0.00345586       13     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2479.71 MB
  Peak resident set size usage (VmHWM): 1320.94 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3322s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 166,
        "art.last_event": 902,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726854559.0,
        "core.event_count": 13,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 166,
        "core.last_event_number": 902,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726854398.0
    },
    "parents": [
        {
            "did": "usertests:000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z.root"
        }
    ]
}
===================
.:
total 417220
-rw-r--r-- 1 dunepilot gridusers 422274036 Sep 20 11:49 000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_reco_data_2024-09-20T_174617Z.root
-rw-r--r-- 1 dunepilot gridusers   4839642 Sep 20 11:49 000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_20240920T174919_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     74950 Sep 20 11:49 000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_reco_2024-09-20T_174617Z.log
-rw-r--r-- 1 dunepilot gridusers     19875 Sep 20 11:49 jobscript.log
-rw-r--r-- 1 dunepilot gridusers      1207 Sep 20 11:49 000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_reco_data_2024-09-20T_174617Z.root.json
-rw-r--r-- 1 dunepilot gridusers      1111 Sep 20 11:49 000037_reco_data_2024-08-16T_161602Z_reco_data_2024-08-19T_121711Z_reco_data_2024-08-20T_113424Z_reco_data_2024-08-22T_092855Z_reco_data_2024-09-16T_140722Z_reco_data_2024-09-20T_174617Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers       344 Sep 20 11:46 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers       248 Sep 20 11:49 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers         0 Sep 20 11:46 debugprod.log
justIN time: 2024-09-29 15:38:55 UTC       justIN version: 01.01.08