justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260220.144@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID260220.144@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3322
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-20 16:01:25
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-09-20 17:49:08
From worker nodeHostnamelnxfarm232.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 17:39:59
Input filesusertests:000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z.root
JobscriptExit code0
Real time8m (534s)
CPU time2m (170s = 31%)
Outputting started2024-09-20 17:48:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/03322/1/000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_20240920T174849_ana_hist.root
Finished2024-09-20 17:49:08
Saved logsjustin-logs:260220.144-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

for track-like PFParticle with ID 93
Warning: there was no shower found for shower-like PFParticle with ID 94
Warning: there was no shower found for shower-like PFParticle with ID 95
Warning: there was no shower found for shower-like PFParticle with ID 96
Warning: there was no shower found for shower-like PFParticle with ID 97
Warning: there was no shower found for shower-like PFParticle with ID 98
Warning: there was no shower found for shower-like PFParticle with ID 99
Warning: there was no shower found for shower-like PFParticle with ID 100
Warning: there was no shower found for shower-like PFParticle with ID 101
Warning: there was no shower found for shower-like PFParticle with ID 102
Warning: there was no shower found for shower-like PFParticle with ID 103
Warning: there was no shower found for shower-like PFParticle with ID 104
Warning: there was no shower found for shower-like PFParticle with ID 105
Warning: there was no shower found for shower-like PFParticle with ID 106
Warning: there was no shower found for shower-like PFParticle with ID 107
Warning: there was no shower found for shower-like PFParticle with ID 108
Warning: there was no shower found for shower-like PFParticle with ID 109
Warning: there was no shower found for shower-like PFParticle with ID 110
Warning: there was no shower found for shower-like PFParticle with ID 111
Warning: there was no shower found for shower-like PFParticle with ID 112
Warning: there was no shower found for shower-like PFParticle with ID 113
Warning: there was no shower found for shower-like PFParticle with ID 114
Warning: there was no shower found for shower-like PFParticle with ID 115
Warning: there was no shower found for shower-like PFParticle with ID 116
Warning: there was no shower found for shower-like PFParticle with ID 117
Warning: there was no shower found for shower-like PFParticle with ID 118
Warning: there was no shower found for shower-like PFParticle with ID 119
Warning: there was no shower found for shower-like PFParticle with ID 120
Warning: there was no shower found for shower-like PFParticle with ID 121
Warning: there was no shower found for shower-like PFParticle with ID 122
Warning: there was no shower found for shower-like PFParticle with ID 123
Warning: there was no shower found for shower-like PFParticle with ID 124
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  20-Sep-2024 11:48:41 MDT run: 20000031 subRun: 0 event: 688
the pandoraTrack track #0 has 2034 hits on calorimetry plane #2, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  20-Sep-2024 11:48:41 MDT run: 20000031 subRun: 0 event: 688
the pandoraTrack track #0 has 2955 hits on calorimetry plane #1, only 2000 stored in tree
%MSG
Begin processing the 16th record. run: 20000031 subRun: 0 event: 954 at 20-Sep-2024 11:48:45 MDT
Analysing.

Begin processing the 17th record. run: 20000031 subRun: 0 event: 961 at 20-Sep-2024 11:48:46 MDT
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 1
Warning: there was no track found for track-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 4
Warning: there was no track found for track-like PFParticle with ID 5
Begin processing the 18th record. run: 20000031 subRun: 0 event: 984 at 20-Sep-2024 11:48:48 MDT
Analysing.

20-Sep-2024 11:48:49 MDT  Closed output file "000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_reco_data_2024-09-20T_174002Z.root"
20-Sep-2024 11:48:49 MDT  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/b2/58/000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        1.05812       10.422        127.53        1.63192       28.928         18     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0425682     0.0562473     0.0799087     0.0505696    0.00973061       18     
end_path:out1:RootOutput                         4.054e-06    6.50689e-06   3.8767e-05    4.4695e-06    7.84027e-06      18     
end_path:analysistree:AnalysisTree               0.834544       8.84106       120.233       1.29929       27.1497        18     
end_path:pmtrackeff:NeutrinoTrackingEff         7.4983e-05    0.000220535   0.00163871    0.000101573   0.000352069      18     
end_path:pmtracktceff:NeutrinoTrackingEff       3.2726e-05    8.52452e-05   0.000785031   3.79335e-05   0.000170404      18     
end_path:pandoraeff:NeutrinoTrackingEff         3.1308e-05    6.81288e-05   0.000512715   3.5882e-05    0.000108744      18     
end_path:pmtrajfiteff:NeutrinoTrackingEff       3.0945e-05    7.42109e-05   0.000623888   3.4692e-05     0.0001342       18     
end_path:pmtrajfittceff:NeutrinoTrackingEff     3.0768e-05    6.99501e-05   0.000567466   3.39255e-05   0.000121513      18     
end_path:pandorashweff:NeutrinoShowerEff         3.889e-05    9.38468e-05   0.000534824   4.6267e-05    0.00012229       18     
end_path:emshowershweff:NeutrinoShowerEff       3.5745e-05    7.46012e-05   0.000484216   4.52465e-05   0.000100501      18     
end_path:trajclustershweff:NeutrinoShowerEff    3.4947e-05    7.30863e-05   0.000436621   4.55695e-05   8.98146e-05      18     
end_path:runcheckereco:CheckRecoEnergy          1.2901e-05    2.20768e-05   0.00014348    1.3942e-05    2.95267e-05      18     
end_path:flashmatchAna:FlashMatchAna             0.0795012      1.44239       12.6826      0.268074       3.15929        18     
end_path:out1:RootOutput(write)                  0.0735058     0.0810904     0.113485      0.076106     0.00991113       18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4437.9 MB
  Peak resident set size usage (VmHWM): 3266.9 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3322s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 107,
        "art.last_event": 984,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726854529.0,
        "core.event_count": 18,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 107,
        "core.last_event_number": 984,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726854019.0
    },
    "parents": [
        {
            "did": "usertests:000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z.root"
        }
    ]
}
===================
.:
total 1234552
-rw-r--r-- 1 dunepilot gridusers 1251805791 Sep 20 11:48 000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_reco_data_2024-09-20T_174002Z.root
-rw-r--r-- 1 dunepilot gridusers   12186961 Sep 20 11:48 000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_20240920T174849_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     146050 Sep 20 11:48 000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_reco_2024-09-20T_174002Z.log
-rw-r--r-- 1 dunepilot gridusers      19722 Sep 20 11:48 jobscript.log
-rw-r--r-- 1 dunepilot gridusers       1207 Sep 20 11:48 000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_reco_data_2024-09-20T_174002Z.root.json
-rw-r--r-- 1 dunepilot gridusers       1112 Sep 20 11:48 000066_reco_data_2024-08-16T_161646Z_reco_data_2024-08-19T_112044Z_reco_data_2024-08-20T_114144Z_reco_data_2024-08-22T_091719Z_reco_data_2024-08-23T_100719Z_reco_data_2024-09-20T_174002Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers        344 Sep 20 11:40 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers        248 Sep 20 11:48 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers          0 Sep 20 11:40 debugprod.log
justIN time: 2024-09-29 15:30:54 UTC       justIN version: 01.01.08