justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 113851.55@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID113851.55@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4348
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes5242880000 (5000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-12-03 09:08:55
SiteUS_Colorado
EntryCMSHTPC_T3_US_Colorado_heposg01-colorado
Last heartbeat2024-12-03 11:37:08
From worker nodeHostnamelnxfarm230.colorado.edu
cpuinfoIntel(R) Core(TM) i7-2600K CPU @ 3.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes5242880000 (5000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-12-03 09:23:51
Input filesusertests:000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z.root
JobscriptExit code0
Real time2h (7985s)
CPU time3m (190s = 2%)
Outputting started2024-12-03 11:36:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/04348/1/000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_20241203T113653_ana_hist.root
Finished2024-12-03 11:37:08
Saved logsjustin-logs:113851.55-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

rning: there was no shower found for shower-like PFParticle with ID 52
Warning: there was no shower found for shower-like PFParticle with ID 53
Warning: there was no shower found for shower-like PFParticle with ID 54
Warning: there was no shower found for shower-like PFParticle with ID 55
Warning: there was no shower found for shower-like PFParticle with ID 56
Begin processing the 988th record. run: 20000031 subRun: 0 event: 988 at 03-Dec-2024 04:36:34 MST
Analysing.

Begin processing the 989th record. run: 20000031 subRun: 0 event: 989 at 03-Dec-2024 04:36:36 MST
Analysing.

Begin processing the 990th record. run: 20000031 subRun: 0 event: 990 at 03-Dec-2024 04:36:37 MST
Analysing.

Begin processing the 991st record. run: 20000031 subRun: 0 event: 991 at 03-Dec-2024 04:36:38 MST
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no shower found for shower-like PFParticle with ID 4
Warning: there was no shower found for shower-like PFParticle with ID 5
Warning: there was no shower found for shower-like PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 7
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no shower found for shower-like PFParticle with ID 9
Warning: there was no shower found for shower-like PFParticle with ID 10
Warning: there was no shower found for shower-like PFParticle with ID 11
Warning: there was no shower found for shower-like PFParticle with ID 12
Warning: there was no shower found for shower-like PFParticle with ID 13
Warning: there was no shower found for shower-like PFParticle with ID 14
Warning: there was no shower found for shower-like PFParticle with ID 15
Begin processing the 992nd record. run: 20000031 subRun: 0 event: 992 at 03-Dec-2024 04:36:40 MST
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Begin processing the 993rd record. run: 20000031 subRun: 0 event: 993 at 03-Dec-2024 04:36:42 MST
Analysing.

Begin processing the 994th record. run: 20000031 subRun: 0 event: 994 at 03-Dec-2024 04:36:43 MST
Analysing.

Begin processing the 995th record. run: 20000031 subRun: 0 event: 995 at 03-Dec-2024 04:36:44 MST
Analysing.

Begin processing the 996th record. run: 20000031 subRun: 0 event: 996 at 03-Dec-2024 04:36:45 MST
Analysing.

Begin processing the 997th record. run: 20000031 subRun: 0 event: 997 at 03-Dec-2024 04:36:47 MST
Analysing.

Begin processing the 998th record. run: 20000031 subRun: 0 event: 998 at 03-Dec-2024 04:36:48 MST
Analysing.

Begin processing the 999th record. run: 20000031 subRun: 0 event: 999 at 03-Dec-2024 04:36:49 MST
Analysing.

Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no shower found for shower-like PFParticle with ID 1
Warning: there was no shower found for shower-like PFParticle with ID 2
Warning: there was no shower found for shower-like PFParticle with ID 3
Warning: there was no shower found for shower-like PFParticle with ID 4
Begin processing the 1000th record. run: 20000031 subRun: 0 event: 1000 at 03-Dec-2024 04:36:51 MST
Analysing.

03-Dec-2024 04:36:53 MST  Closed output file "000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_reco_data_2024-12-03T_092353Z.root"
03-Dec-2024 04:36:53 MST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/f5/84/000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.971395       1.17925       25.1332       1.0033       0.885183       1000    
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0243498     0.0371631     0.0710308     0.0415146     0.0124253      1000    
end_path:out1:RootOutput                         2.17e-06     3.90695e-06   3.9514e-05     3.861e-06    1.62847e-06     1000    
end_path:analysistree:AnalysisTree               0.800362      0.951396       24.4132      0.809256      0.825996       1000    
end_path:pmtrackeff:NeutrinoTrackingEff         4.3705e-05    7.49452e-05    0.0061761    5.85805e-05   0.000204634     1000    
end_path:pmtracktceff:NeutrinoTrackingEff       3.1049e-05    4.39867e-05   0.00603866    3.3178e-05    0.000194193     1000    
end_path:pandoraeff:NeutrinoTrackingEff         2.9795e-05    4.27012e-05   0.00597887    3.1847e-05    0.000194515     1000    
end_path:pmtrajfiteff:NeutrinoTrackingEff       2.9592e-05    4.22843e-05    0.0060146    3.14105e-05   0.000194401     1000    
end_path:pmtrajfittceff:NeutrinoTrackingEff     2.9629e-05    4.14609e-05   0.00601762    3.1361e-05    0.00019166      1000    
end_path:pandorashweff:NeutrinoShowerEff         3.747e-05    5.13418e-05   0.00595994    4.15505e-05   0.000188586     1000    
end_path:emshowershweff:NeutrinoShowerEff       3.5437e-05    4.8587e-05    0.00597103    3.83735e-05   0.000193346     1000    
end_path:trajclustershweff:NeutrinoShowerEff    3.5987e-05    4.90297e-05   0.00592501    3.8526e-05    0.000193077     1000    
end_path:runcheckereco:CheckRecoEnergy           9.161e-06    1.09663e-05   0.000147018   1.02745e-05   4.82314e-06     1000    
end_path:flashmatchAna:FlashMatchAna             0.0726022     0.116222       5.60328      0.0733138     0.216814       1000    
end_path:out1:RootOutput(write)                  0.0726577     0.0737092     0.105611      0.0733015    0.00216791      1000    
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3431.83 MB
  Peak resident set size usage (VmHWM): 2305.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
    "metadata": {
        "DUNE.campaign": "justIN.w4348s1",
        "art.file_format_era": "ART_2011a",
        "art.file_format_version": 15,
        "art.first_event": 1,
        "art.last_event": 1000,
        "art.process_name": "Mergeana",
        "art.run_type": "physics",
        "core.application": "art.reco",
        "core.application.family": "art",
        "core.application.name": "reco",
        "core.application.version": "v09_75_03d00",
        "core.data_stream": "out1",
        "core.data_tier": "full-reconstructed",
        "core.end_time": 1733225812.0,
        "core.event_count": 1000,
        "core.file_format": "artroot",
        "core.file_type": "mc",
        "core.first_event_number": 1,
        "core.last_event_number": 1000,
        "core.run_type": "physics",
        "core.runs": [
            20000031
        ],
        "core.runs_subruns": [
            2000003100000
        ],
        "core.start_time": 1733217850.0
    },
    "parents": [
        {
            "did": "usertests:000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z.root"
        }
    ]
}
===================
.:
total 2921228
-rw-r--r-- 1 dunepilot gridusers 2943468684 Dec  3 04:36 000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_reco_data_2024-12-03T_092353Z.root
-rw-r--r-- 1 dunepilot gridusers   47295119 Dec  3 04:36 000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_20241203T113653_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers     530897 Dec  3 04:36 000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_reco_2024-12-03T_092353Z.log
-rw-r--r-- 1 dunepilot gridusers      18022 Dec  3 04:36 jobscript.log
-rw-r--r-- 1 dunepilot gridusers       1207 Dec  3 04:36 000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_reco_data_2024-12-03T_092353Z.root.json
-rw-r--r-- 1 dunepilot gridusers       1112 Dec  3 04:36 000960_reco_data_2024-11-14T_093607Z_reco_data_2024-11-14T_152727Z_reco_data_2024-11-28T_133841Z_reco_data_2024-12-02T_125218Z_reco_data_2024-12-02T_160323Z_reco_data_2024-12-03T_092353Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers        344 Dec  3 02:23 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers        248 Dec  3 04:36 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers          0 Dec  3 02:23 debugprod.log
justIN time: 2024-12-05 02:07:04 UTC       justIN version: 01.01.09