justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260220.151@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID260220.151@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3322
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-09-20 16:01:25
SiteUS_PuertoRico
EntryCMSHTPC_T3_US_PuertoRico_UPRM
Last heartbeat2024-09-20 16:41:31
From worker nodeHostnamecompute-1-3.local
cpuinfoIntel(R) Xeon(R) CPU W3550 @ 3.07GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-20 16:35:01
Input filesusertests:000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z.root
JobscriptExit code0
Real time6m (361s)
CPU time1m (65s = 18%)
Outputting started2024-09-20 16:41:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/03322/1/000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_20240920T164057_ana_hist.root
Finished2024-09-20 16:41:31
Saved logsjustin-logs:260220.151-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

un: 0 event: 770 at 20-Sep-2024 12:40:46 AST
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 4
Warning: there was no shower found for shower-like PFParticle with ID 5
Warning: there was no shower found for shower-like PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 7
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no shower found for shower-like PFParticle with ID 9
Warning: there was no shower found for shower-like PFParticle with ID 10
Warning: there was no shower found for shower-like PFParticle with ID 11
Warning: there was no shower found for shower-like PFParticle with ID 12
Warning: there was no shower found for shower-like PFParticle with ID 13
Warning: there was no shower found for shower-like PFParticle with ID 14
Warning: there was no shower found for shower-like PFParticle with ID 15
Warning: there was no shower found for shower-like PFParticle with ID 16
Warning: there was no track found for track-like PFParticle with ID 17
Warning: there was no track found for track-like PFParticle with ID 18
Warning: there was no track found for track-like PFParticle with ID 19
Warning: there was no shower found for shower-like PFParticle with ID 20
Warning: there was no track found for track-like PFParticle with ID 21
Warning: there was no track found for track-like PFParticle with ID 22
Warning: there was no track found for track-like PFParticle with ID 23
Warning: there was no shower found for shower-like PFParticle with ID 24
Warning: there was no track found for track-like PFParticle with ID 25
Warning: there was no shower found for shower-like PFParticle with ID 26
Warning: there was no track found for track-like PFParticle with ID 27
Warning: there was no shower found for shower-like PFParticle with ID 28
Warning: there was no shower found for shower-like PFParticle with ID 29
Warning: there was no shower found for shower-like PFParticle with ID 30
Warning: there was no shower found for shower-like PFParticle with ID 31
Warning: there was no shower found for shower-like PFParticle with ID 32
Warning: there was no shower found for shower-like PFParticle with ID 33
Begin processing the 11th record. run: 20000031 subRun: 0 event: 951 at 20-Sep-2024 12:40:51 AST
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no track found for track-like PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 4
Warning: there was no track found for track-like PFParticle with ID 5
Warning: there was no track found for track-like PFParticle with ID 6
Warning: there was no shower found for shower-like PFParticle with ID 7
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no track found for track-like PFParticle with ID 9
Warning: there was no track found for track-like PFParticle with ID 10
Warning: there was no track found for track-like PFParticle with ID 11
Warning: there was no shower found for shower-like PFParticle with ID 12
20-Sep-2024 12:40:56 AST  Closed output file "000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_reco_data_2024-09-20T_163505Z.root"
20-Sep-2024 12:40:57 AST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/a4/a3/000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        3.74292       7.51999       40.1799       4.21332       10.3377        11     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0733069     0.106848      0.146466      0.0759827     0.0360647       11     
end_path:out1:RootOutput                         5.69e-06     1.34582e-05   7.9603e-05     7.094e-06    2.09228e-05      11     
end_path:analysistree:AnalysisTree                3.15559       6.13456       32.5307       3.48986       8.35301        11     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000105999   0.000175453   0.000545287   0.000129356   0.000121085      11     
end_path:pmtracktceff:NeutrinoTrackingEff       4.3788e-05    6.82083e-05   0.000102555   6.6915e-05    1.96025e-05      11     
end_path:pandoraeff:NeutrinoTrackingEff         4.2712e-05    6.88918e-05   0.000103211   6.6421e-05    2.16052e-05      11     
end_path:pmtrajfiteff:NeutrinoTrackingEff       4.2069e-05    6.88833e-05   0.000130784   6.5315e-05    2.54644e-05      11     
end_path:pmtrajfittceff:NeutrinoTrackingEff     4.1964e-05    6.60518e-05   0.00010094    6.6011e-05    1.97041e-05      11     
end_path:pandorashweff:NeutrinoShowerEff        6.6159e-05    0.000178462   0.000967919   9.4271e-05    0.000250898      11     
end_path:emshowershweff:NeutrinoShowerEff       5.8338e-05    9.60445e-05   0.000283457    8.191e-05    6.08013e-05      11     
end_path:trajclustershweff:NeutrinoShowerEff    5.6435e-05    9.54948e-05   0.000286924   8.0071e-05    6.21833e-05      11     
end_path:runcheckereco:CheckRecoEnergy          1.3547e-05    4.65481e-05   0.00033066    1.8722e-05    8.99276e-05      11     
end_path:flashmatchAna:FlashMatchAna             0.293464       1.05793       7.28275      0.429695       1.97359        11     
end_path:out1:RootOutput(write)                  0.218646      0.219102      0.220376      0.219014     0.000449865      11     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3076.36 MB
  Peak resident set size usage (VmHWM): 1665.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w3322s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 6,
        "art.last_event": 951,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1726850456.0,
        "core.event_count": 11,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 6,
        "core.last_event_number": 951,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1726850133.0
    },
    "parents": [
        {
            "did": "usertests:000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z.root"
        }
    ]
}
===================
.:
total 386716
-rw-r--r-- 1 dunepilot gridusers 392430574 Sep 20 12:40 000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_reco_data_2024-09-20T_163505Z.root
-rw-r--r-- 1 dunepilot gridusers   3468343 Sep 20 12:40 000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_20240920T164057_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     50049 Sep 20 12:40 000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_reco_2024-09-20T_163505Z.log
-rw-r--r-- 1 dunepilot gridusers     19503 Sep 20 12:41 jobscript.log
-rw-r--r-- 1 dunepilot gridusers      1203 Sep 20 12:41 000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_reco_data_2024-09-20T_163505Z.root.json
-rw-r--r-- 1 dunepilot gridusers      1107 Sep 20 12:41 000173_reco_data_2024-08-16T_161855Z_reco_data_2024-08-19T_134856Z_reco_data_2024-08-20T_114757Z_reco_data_2024-08-22T_092306Z_reco_data_2024-09-16T_135808Z_reco_data_2024-09-20T_163505Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers       344 Sep 20 12:35 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers       248 Sep 20 12:41 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers         0 Sep 20 12:35 debugprod.log
justIN time: 2024-09-29 11:15:04 UTC       justIN version: 01.01.08