21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 370865.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 370865.0@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 6304 | |
| Stage ID | 1 | |
| User name | amoor@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 5242880000 (5000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-04-18 01:15:34 | |
| Site | US_Colorado | |
| Entry | CMSHTPC_T3_US_Colorado_heposg01-colorado | |
| Last heartbeat | 2025-04-18 06:19:18 | |
| From worker node | Hostname | lnxfarm313.colorado.edu |
| cpuinfo | Intel(R) Core(TM) i7-7820X CPU @ 3.60GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 5242880000 (5000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-04-18 01:17:46 | |
| Input files | usertests:000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z.root | |
| Jobscript | Exit code | 0 |
| Real time | 5h (18058s) | |
| CPU time | 1h (4616s = 25%) | |
| Max RSS bytes | 3114950656 (2970 MiB) | |
| Outputting started | 2025-04-18 06:18:45 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/amoor/06304/1/001/Mergeana-20250418T061841_ana_hist.root | |
| Finished | 2025-04-18 06:19:18 | |
| Saved logs | justin-logs:370865.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
992nd record. run: 20000031 subRun: 0 event: 992 at 18-Apr-2025 00:17:14 MDT
Analysing.
Begin processing the 993rd record. run: 20000031 subRun: 0 event: 993 at 18-Apr-2025 00:17:20 MDT
Analysing.
Begin processing the 994th record. run: 20000031 subRun: 0 event: 994 at 18-Apr-2025 00:17:27 MDT
Analysing.
Begin processing the 995th record. run: 20000031 subRun: 0 event: 995 at 18-Apr-2025 00:17:28 MDT
Analysing.
Begin processing the 996th record. run: 20000031 subRun: 0 event: 996 at 18-Apr-2025 00:17:29 MDT
Analysing.
Begin processing the 997th record. run: 20000031 subRun: 0 event: 997 at 18-Apr-2025 00:17:31 MDT
Analysing.
Begin processing the 998th record. run: 20000031 subRun: 0 event: 998 at 18-Apr-2025 00:17:33 MDT
Analysing.
Warning: there were 56 reconstructed PFParticle daughters; only the first 10 being stored in tree
Warning: there was no vertex found for PFParticle with ID 35
Warning: there was no track found for track-like PFParticle with ID 35
Warning: there was no vertex found for PFParticle with ID 68
Warning: there was no track found for track-like PFParticle with ID 68
Warning: there was no track found for track-like PFParticle with ID 85
Warning: there was no vertex found for PFParticle with ID 145
Warning: there was no track found for track-like PFParticle with ID 145
Warning: there was no vertex found for PFParticle with ID 146
Warning: there was no track found for track-like PFParticle with ID 146
Warning: there was no vertex found for PFParticle with ID 159
Warning: there was no track found for track-like PFParticle with ID 159
Warning: there was no track found for track-like PFParticle with ID 168
Warning: there was no vertex found for PFParticle with ID 169
Warning: there was no track found for track-like PFParticle with ID 169
Warning: there was no vertex found for PFParticle with ID 170
Warning: there was no track found for track-like PFParticle with ID 170
Warning: there was no vertex found for PFParticle with ID 171
Warning: there was no track found for track-like PFParticle with ID 171
Warning: there was no vertex found for PFParticle with ID 187
Warning: there was no track found for track-like PFParticle with ID 187
Warning: there was no track found for track-like PFParticle with ID 198
Warning: there was no vertex found for PFParticle with ID 199
Warning: there was no track found for track-like PFParticle with ID 199
Warning: there was no vertex found for PFParticle with ID 200
Warning: there was no track found for track-like PFParticle with ID 200
Warning: there was no track found for track-like PFParticle with ID 202
Warning: there was no vertex found for PFParticle with ID 210
Warning: there was no track found for track-like PFParticle with ID 210
Warning: there was no vertex found for PFParticle with ID 211
Warning: there was no track found for track-like PFParticle with ID 211
Warning: there was no vertex found for PFParticle with ID 224
Warning: there was no track found for track-like PFParticle with ID 224
Warning: there was no vertex found for PFParticle with ID 225
Warning: there was no track found for track-like PFParticle with ID 225
Warning: there was no vertex found for PFParticle with ID 233
Warning: there was no track found for track-like PFParticle with ID 233
Warning: there was no track found for track-like PFParticle with ID 248
Begin processing the 999th record. run: 20000031 subRun: 0 event: 999 at 18-Apr-2025 00:18:21 MDT
Analysing.
Begin processing the 1000th record. run: 20000031 subRun: 0 event: 1000 at 18-Apr-2025 00:18:26 MDT
Analysing.
Warning: there were 25 reconstructed PFParticle daughters; only the first 10 being stored in tree
18-Apr-2025 00:18:41 MDT Closed output file "000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z_reco_data_2025-04-18T_011749Z.root"
18-Apr-2025 00:18:41 MDT Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/aa/67/000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z.root"
==================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
==================================================================================================================================
Full event 1.1322 5.9493 130.549 1.46896 9.28801 1000
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0247379 0.0374424 0.0603041 0.0466553 0.0123393 1000
end_path:out1:RootOutput 3.262e-06 4.38852e-06 7.461e-05 4.232e-06 2.43981e-06 1000
end_path:analysistree:AnalysisTree 1.02667 5.5827 128.753 1.04088 9.10365 1000
end_path:pmtrackeff:NeutrinoTrackingEff 0.000289011 0.000373261 0.000794121 0.000365636 4.24082e-05 1000
end_path:pmtracktceff:NeutrinoTrackingEff 0.000126582 0.000220042 0.000641652 0.000215326 3.57689e-05 1000
end_path:pandoraeff:NeutrinoTrackingEff 0.000120982 0.000192166 0.00061052 0.000190338 2.00148e-05 1000
end_path:pmtrajfiteff:NeutrinoTrackingEff 0.000119777 0.000189078 0.000561542 0.000187513 1.80788e-05 1000
end_path:pmtrajfittceff:NeutrinoTrackingEff 0.000127812 0.000188156 0.00060816 0.000185773 1.90586e-05 1000
end_path:pandorashweff:NeutrinoShowerEff 2.9758e-05 4.51031e-05 0.000575456 4.36945e-05 1.82775e-05 1000
end_path:emshowershweff:NeutrinoShowerEff 2.4645e-05 3.52676e-05 0.00011758 3.4233e-05 5.64855e-06 1000
end_path:trajclustershweff:NeutrinoShowerEff 2.3829e-05 3.46964e-05 0.000122221 3.3829e-05 5.57245e-06 1000
end_path:runcheckereco:CheckRecoEnergy 7.951e-06 1.11904e-05 0.000193118 1.09325e-05 5.88412e-06 1000
end_path:flashmatchAna:FlashMatchAna 0.000104992 0.253113 17.8619 0.0113225 0.830255 1000
end_path:out1:RootOutput(write) 0.0734654 0.0742914 0.0941187 0.0740358 0.00147766 1000
==================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4421.46 MB
Peak resident set size usage (VmHWM): 3114.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 200 lines of lar log file ===
lar exit code 0
extractor_prod.py exit code 0
pdjson2metadata exit code 0
Metadata extraction succeeds
===Metadata JSON===
{
"metadata": {
"DUNE.campaign": "justIN.w6304s1",
"art.file_format_era": "ART_2011a",
"art.file_format_version": 15,
"art.first_event": 1,
"art.last_event": 1000,
"art.process_name": "Mergeana",
"art.run_type": "physics",
"core.application": "art.reco",
"core.application.family": "art",
"core.application.name": "reco",
"core.application.version": "v10_04_06d00",
"core.data_stream": "out1",
"core.data_tier": "full-reconstructed",
"core.end_time": 1744957120.0,
"core.event_count": 1000,
"core.file_format": "artroot",
"core.file_type": "mc",
"core.first_event_number": 1,
"core.last_event_number": 1000,
"core.run_type": "physics",
"core.runs": [
20000031
],
"core.runs_subruns": [
2000003100000
],
"core.start_time": 1744939107.0
},
"parents": [
{
"did": "usertests:000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z.root"
}
]
}
===================
.:
total 8505104
-rw-r--r-- 1 dunepilot gridusers 8603614990 Apr 18 00:18 000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z_reco_data_2025-04-18T_011749Z.root
-rw-r--r-- 1 dunepilot gridusers 105330158 Apr 18 00:18 Mergeana-20250418T061841_ana_hist.root
-rw-r--r-- 1 dunepilot gridusers 235275 Apr 18 00:18 000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z_reco_2025-04-18T_011749Z.log
-rw-r--r-- 1 dunepilot gridusers 17256 Apr 18 00:18 jobscript.log
-rw-r--r-- 1 dunepilot gridusers 1207 Apr 18 00:18 000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z_reco_data_2025-04-18T_011749Z.root.json
-rw-r--r-- 1 dunepilot gridusers 1112 Apr 18 00:18 000366_reco_data_2025-04-02T_082911Z_reco_data_2025-04-02T_215021Z_reco_data_2025-04-04T_110910Z_reco_data_2025-04-07T_110818Z_reco_data_2025-04-08T_105007Z_reco_data_2025-04-18T_011749Z.root.ext.json
-rw-r--r-- 1 dunepilot gridusers 344 Apr 17 19:17 all-input-dids.txt
-rw-r--r-- 1 dunepilot gridusers 248 Apr 18 00:18 justin-processed-pfns.txt
-rw-r--r-- 1 dunepilot gridusers 0 Apr 17 19:17 debugprod.log