justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 306539.128@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID306539.128@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4348
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes5242880000 (5000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-12-03 09:06:43
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-12-03 11:33:35
From worker nodeHostnamelnxfarm142.colorado.edu
cpuinfoIntel(R) Core(TM) i7-4771 CPU @ 3.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes5242880000 (5000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-12-03 09:20:56
Input filesusertests:000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z.root
JobscriptExit code0
Real time2h (7947s)
CPU time2m (179s = 2%)
Outputting started2024-12-03 11:33:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/04348/1/000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_20241203T113320_ana_hist.root
Finished2024-12-03 11:33:35
Saved logsjustin-logs:306539.128-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

was no track found for track-like PFParticle with ID 40
Warning: there was no shower found for shower-like PFParticle with ID 41
Warning: there was no track found for track-like PFParticle with ID 42
Warning: there was no track found for track-like PFParticle with ID 43
Warning: there was no track found for track-like PFParticle with ID 44
Warning: there was no track found for track-like PFParticle with ID 45
Warning: there was no shower found for shower-like PFParticle with ID 46
Warning: there was no shower found for shower-like PFParticle with ID 47
Warning: there was no shower found for shower-like PFParticle with ID 48
Warning: there was no track found for track-like PFParticle with ID 49
Warning: there was no shower found for shower-like PFParticle with ID 50
Warning: there was no track found for track-like PFParticle with ID 51
Warning: there was no shower found for shower-like PFParticle with ID 52
Warning: there was no shower found for shower-like PFParticle with ID 53
Warning: there was no track found for track-like PFParticle with ID 54
Warning: there was no track found for track-like PFParticle with ID 55
Warning: there was no track found for track-like PFParticle with ID 56
Warning: there was no shower found for shower-like PFParticle with ID 57
Warning: there was no track found for track-like PFParticle with ID 58
Warning: there was no track found for track-like PFParticle with ID 59
Warning: there was no vertex found for PFParticle with ID 60
Warning: there was no shower found for shower-like PFParticle with ID 60
Warning: there was no vertex found for PFParticle with ID 61
Warning: there was no shower found for shower-like PFParticle with ID 61
Warning: there was no shower found for shower-like PFParticle with ID 62
Warning: there was no shower found for shower-like PFParticle with ID 63
Warning: there was no shower found for shower-like PFParticle with ID 64
Warning: there was no shower found for shower-like PFParticle with ID 65
Warning: there was no shower found for shower-like PFParticle with ID 66
Warning: there was no shower found for shower-like PFParticle with ID 67
Warning: there was no shower found for shower-like PFParticle with ID 68
Warning: there was no shower found for shower-like PFParticle with ID 69
Warning: there was no shower found for shower-like PFParticle with ID 70
Warning: there was no shower found for shower-like PFParticle with ID 71
Warning: there was no shower found for shower-like PFParticle with ID 72
Warning: there was no shower found for shower-like PFParticle with ID 73
Warning: there was no shower found for shower-like PFParticle with ID 74
Warning: there was no shower found for shower-like PFParticle with ID 75
Warning: there was no shower found for shower-like PFParticle with ID 76
Warning: there was no shower found for shower-like PFParticle with ID 77
Warning: there was no shower found for shower-like PFParticle with ID 78
Warning: there was no shower found for shower-like PFParticle with ID 79
Warning: there was no shower found for shower-like PFParticle with ID 80
Warning: there was no shower found for shower-like PFParticle with ID 81
Warning: there was no shower found for shower-like PFParticle with ID 82
Warning: there was no shower found for shower-like PFParticle with ID 83
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  03-Dec-2024 04:33:18 MST run: 20000031 subRun: 0 event: 1000
the pandoraTrack track #0 has 2683 hits on calorimetry plane #1, only 2000 stored in tree
%MSG
03-Dec-2024 04:33:19 MST  Closed output file "000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_reco_data_2024-12-03T_092058Z.root"
03-Dec-2024 04:33:19 MST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/e3/e6/000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        0.97286       1.1637        43.7403       1.00055       1.38554       1000    
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0243354     0.0371056     0.0808046     0.0452532     0.0124275      1000    
end_path:out1:RootOutput                         1.884e-06    3.4895e-06    3.3949e-05    3.3865e-06    1.60024e-06     1000    
end_path:analysistree:AnalysisTree               0.801138       0.94698       39.1199      0.806697       1.24264       1000    
end_path:pmtrackeff:NeutrinoTrackingEff         3.7122e-05    6.58236e-05   0.00195801     5.319e-05    9.26627e-05     1000    
end_path:pmtracktceff:NeutrinoTrackingEff       2.1631e-05    3.21671e-05   0.00175828    2.47665e-05   6.40141e-05     1000    
end_path:pandoraeff:NeutrinoTrackingEff         1.9745e-05    2.93877e-05   0.00167344    2.22735e-05    5.998e-05      1000    
end_path:pmtrajfiteff:NeutrinoTrackingEff       1.9149e-05    2.71618e-05   0.00071071    2.12515e-05   3.49651e-05     1000    
end_path:pmtrajfittceff:NeutrinoTrackingEff     1.9003e-05    2.6592e-05    0.000697335   2.09625e-05   3.06839e-05     1000    
end_path:pandorashweff:NeutrinoShowerEff        3.3786e-05    4.25186e-05   0.00062571    3.7302e-05    3.00599e-05     1000    
end_path:emshowershweff:NeutrinoShowerEff       3.1539e-05    3.89936e-05   0.00042132    3.4165e-05    2.40303e-05     1000    
end_path:trajclustershweff:NeutrinoShowerEff    3.1308e-05    3.80927e-05   0.000437127   3.39655e-05   2.15232e-05     1000    
end_path:runcheckereco:CheckRecoEnergy           6.827e-06    8.96312e-06   0.000142975    8.179e-06    4.82159e-06     1000    
end_path:flashmatchAna:FlashMatchAna             0.0725753     0.105413       4.50781      0.0731429     0.168669       1000    
end_path:out1:RootOutput(write)                  0.0727456     0.073586      0.123209      0.0731945    0.00248944      1000    
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3727.68 MB
  Peak resident set size usage (VmHWM): 2545.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w4348s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 1000,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1733225599.0,
        "core.event_count": 1000,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 1000,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1733217674.0
    },
    "parents": [
        {
            "did": "usertests:000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z.root"
        }
    ]
}
===================
.:
total 3027804
-rw-r--r-- 1 dunepilot gridusers 3053635922 Dec  3 04:33 000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_reco_data_2024-12-03T_092058Z.root
-rw-r--r-- 1 dunepilot gridusers   46265856 Dec  3 04:33 000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_20241203T113320_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     526145 Dec  3 04:33 000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_reco_2024-12-03T_092058Z.log
-rw-r--r-- 1 dunepilot gridusers      18685 Dec  3 04:33 jobscript.log
-rw-r--r-- 1 dunepilot gridusers       1207 Dec  3 04:33 000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_reco_data_2024-12-03T_092058Z.root.json
-rw-r--r-- 1 dunepilot gridusers       1112 Dec  3 04:33 000648_reco_data_2024-11-14T_093300Z_reco_data_2024-11-14T_145633Z_reco_data_2024-11-27T_112345Z_reco_data_2024-12-02T_122839Z_reco_data_2024-12-02T_155856Z_reco_data_2024-12-03T_092058Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers        344 Dec  3 02:20 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers        248 Dec  3 04:33 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers          0 Dec  3 02:21 debugprod.log
justIN time: 2024-12-05 02:13:21 UTC       justIN version: 01.01.09