Jobsub ID 79533.37@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79533.37@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3512 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 19:26:43 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:52:43 |
| From worker node | Hostname | mh-7662-13.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 00:29:42 |
| Input files | hd-protodune:np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 15h (56467s) |
| CPU time | 1h (5062s = 8%) |
| Outputting started | 2024-09-27 16:10:50 |
| Output files | |
| Finished | 2024-09-27 16:52:43 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
-value for these numbers
----view 0: 2.90871e-05 2.91467e-05 2.91467e-05 2.90871e-05 2.91467e-05 2.90871e-05 2.91467e-05 2.90871e-05 2.91467e-05 2.91467e-05 2.90871e-05 2.91467e-05 0.000179708
----view 1: 1.06096e-05 1.055e-05 1.06096e-05 1.055e-05 1.06096e-05 1.055e-05 1.06096e-05 1.055e-05 0.000446737 7.37906e-05 0.000115812 3.49283e-05 3.49879e-05
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 66924 TrkackID 0 startx, y, z 344.172 445.511 153.902 wireno, peakt tpcno 460 4039.79 5 dist 0min T, max_T1468 5854.57
no of hits closeby 35 event 66924 TrkackID 5 startx, y, z 215.141 405.319 230.44 wireno, peakt tpcno 411 2568 2 dist 127.348min T, max_T5 3127.92
no of hits closeby 0 event 66924 TrkackID 0 startx, y, z 344.172 445.511 153.902 wireno, peakt tpcno 460 4039.79 5 dist 0min T, max_T1468 5854.57
no of hits closeby 35 event 66924 TrkackID 5 startx, y, z 215.141 405.319 230.44 wireno, peakt tpcno 411 2568 2 dist 127.348min T, max_T5 3127.92
27-Sep-2024 09:10:42 PDT Closed output file "np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup.root"
27-Sep-2024 09:10:42 PDT Closed input file "np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 56.2986 119.032 332.296 111.094 51.864 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000414127 0.00179513 0.00471882 0.00118834 0.00125446 35
produce:fembfilter:PDHDFEMBFilter 0.564964 0.59378 0.664725 0.593064 0.0208638 35
produce:wclsdatahd:WireCellToolkit 27.5267 29.6186 32.0235 29.5731 0.945117 35
produce:gaushit:GausHitFinder 0.445136 0.808405 1.34541 0.805942 0.228939 35
produce:nhitsfilter:NumberOfHitsFilter 0.000250964 0.000390239 0.000631321 0.000368506 9.18987e-05 35
produce:reco3d:SpacePointSolver 0.18016 1.43058 4.60737 1.07704 1.11961 35
produce:hitpdune:DisambigFromSpacePoints 0.203951 0.749997 1.78804 0.628249 0.419219 35
produce:pandora:StandardPandora 7.12284 46.3224 230.898 37.5384 40.763 35
produce:pandoraWriter:StandardPandora 0.0827243 0.169302 0.2574 0.166761 0.0449464 35
produce:pandoraTrack:LArPandoraTrackCreation 0.581686 2.0741 5.71058 1.8508 1.08856 35
produce:pandoraShower:LArPandoraShowerCreation 0.45518 1.98113 5.27401 1.7671 1.13704 35
produce:pandoracalo:Calorimetry 0.30631 0.960049 2.56854 0.931023 0.462646 35
produce:pandoracalonosce:Calorimetry 0.276144 0.897494 2.2144 0.879469 0.42659 35
produce:pandorapid:Chi2ParticleID 0.00115251 0.00211273 0.00350909 0.00214615 0.000517782 35
produce:pandoraShowercalo:ShowerCalorimetry 0.383664 1.72801 4.47739 1.48717 0.960801 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.366353 1.66002 4.16682 1.45405 0.928211 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0674475 0.124541 0.176973 0.124191 0.0245914 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0222015 0.0435575 0.0630397 0.0423383 0.00893147 35
produce:emtrkmichelid:EmTrackMichelId 16.131 27.9989 42.8408 27.4909 7.03694 35
[art]:TriggerResults:TriggerResultInserter 1.457e-05 2.42475e-05 6.7561e-05 2.3e-05 8.82849e-06 35
end_path:out1:RootOutput 4.57e-06 7.95386e-06 2.313e-05 7.71e-06 3.44103e-06 35
end_path:michelremoving:michelremoving 0.0130399 0.0632108 0.3011 0.0278703 0.0722894 35
end_path:michelremovinggnocchi:michelremoving 0.0125991 0.0604406 0.298544 0.0242855 0.0714839 35
end_path:calibanagnocchi:CalibAnaTree 0.219309 0.733155 1.85987 0.708262 0.361505 35
end_path:out1:RootOutput(write) 0.483051 0.887366 1.40537 0.870914 0.23042 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5102.75 MB
Peak resident set size usage (VmHWM): 2732.45 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup.root
\tHists: np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449243.0,
"core.end_time": 1727453443.0,
"core.events": [
66788,
66792,
66796,
66800,
66804,
66808,
66812,
66816,
66820,
66824,
66828,
66832,
66836,
66840,
66844,
66848,
66852,
66856,
66860,
66864,
66868,
66872,
66876,
66880,
66884,
66888,
66892,
66896,
66900,
66904,
66908,
66912,
66916,
66920,
66924
],
"core.event_count": 35,
"core.first_event_number": 66788,
"core.last_event_number": 66924,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058_reco_stage1_reco_stage2_20240927T161042_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449243.0,
"core.end_time": 1727453443.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0477_dataflow0_datawriter_0_20240621T081058.hdf5"
}
]
} 