Jobsub ID 264944.166@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 264944.166@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3511 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-27 13:03:33 | |
| Site | CA_SFU | |
| Entry | DUNE_CA_SFU_lcg-ce3 | |
| Last heartbeat | 2024-09-27 17:08:26 | |
| From worker node | Hostname | cdr143.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 84598 (23 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-27 13:14:26 | |
| Input files | hd-protodune:np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 3h (11636s) | |
| CPU time | 2h (8720s = 74%) | |
| Outputting started | 2024-09-27 16:28:23 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup.root hd-protodune-det-reco:np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup_hists.root | |
| Finished | 2024-09-27 17:08:26 | |
| Saved logs | justin-logs:264944.166-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
0 T:5 33980 XUs and 25962 XVs -> 657 XUVs
C:0 T:6 21988 XUs and 31993 XVs -> 1012 XUVs
C:0 T:7 294 XUs and 481 XVs -> 9 XUVs
2088 XUVs total
1533 collection wire objects
2088 potential space points
Neighbour search...
23748 tests to find 12638 neighbours
Iterating with no regularization...
Begin: 2.21127e+07
0 2.13725e+07
1 2.13341e+07
2 2.13331e+07
Now with regularization...
Begin: 1.98651e+07
0 1.98643e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 22143 TrkackID 8 startx, y, z 45.9759 370.823 449.989 wireno, peakt tpcno 292 3062.46 5 dist 0min T, max_T3062.31 4893.59
no of hits closeby 0 event 22143 TrkackID 10 startx, y, z 29.9038 597.681 60.09 wireno, peakt tpcno 166 1554.02 2 dist 374.285min T, max_T5.98189 1589.22
no of hits closeby 0 event 22143 TrkackID 8 startx, y, z 45.9759 370.823 449.989 wireno, peakt tpcno 292 3062.46 5 dist 0min T, max_T3062.31 4893.59
no of hits closeby 0 event 22143 TrkackID 10 startx, y, z 29.9038 597.681 60.09 wireno, peakt tpcno 166 1554.02 2 dist 374.285min T, max_T5.98189 1589.22
27-Sep-2024 09:28:13 PDT Closed output file "np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup.root"
27-Sep-2024 09:28:13 PDT Closed input file "np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 103.141 214.119 367.556 219.392 68.6007 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000882245 0.00323127 0.00670751 0.00234652 0.00212871 35
produce:fembfilter:PDHDFEMBFilter 0.915307 0.929969 0.966312 0.928316 0.00898036 35
produce:wclsdatahd:WireCellToolkit 51.9174 55.5488 57.8872 55.6881 1.30852 35
produce:gaushit:GausHitFinder 0.810583 1.41291 2.02067 1.39037 0.301909 35
produce:nhitsfilter:NumberOfHitsFilter 0.00032033 0.000612258 0.00090292 0.000611219 0.000123408 35
produce:reco3d:SpacePointSolver 0.299674 2.64066 7.77396 2.31613 1.62259 35
produce:hitpdune:DisambigFromSpacePoints 0.323683 1.56225 2.80067 1.53338 0.683723 35
produce:pandora:StandardPandora 12.5935 75.9208 187.76 67.5711 46.2405 35
produce:pandoraWriter:StandardPandora 0.164165 0.294018 0.403057 0.288162 0.0603126 35
produce:pandoraTrack:LArPandoraTrackCreation 1.3921 6.26766 12.6512 6.07565 2.95044 35
produce:pandoraShower:LArPandoraShowerCreation 1.41828 6.48248 14.9769 6.05968 3.17657 35
produce:pandoracalo:Calorimetry 0.697433 2.6259 5.34486 2.58808 1.2158 35
produce:pandoracalonosce:Calorimetry 0.641149 2.48885 5.12111 2.46669 1.16395 35
produce:pandorapid:Chi2ParticleID 0.00203098 0.00355901 0.00606827 0.0036184 0.000874899 35
produce:pandoraShowercalo:ShowerCalorimetry 1.21331 4.98731 11.2348 4.72624 2.30975 35
produce:pandoraShowercalonosce:ShowerCalorimetry 1.21234 4.78152 10.9758 4.63446 2.2302 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.136839 0.210529 0.311148 0.211699 0.0417414 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0480524 0.0751971 0.111697 0.0749698 0.0147665 35
produce:emtrkmichelid:EmTrackMichelId 25.6205 44.2258 59.688 43.1618 8.86828 35
[art]:TriggerResults:TriggerResultInserter 2.975e-05 5.27858e-05 9.9769e-05 4.9888e-05 1.22069e-05 35
end_path:out1:RootOutput 1.0531e-05 1.40222e-05 3.0562e-05 1.2679e-05 4.11163e-06 35
end_path:michelremoving:michelremoving 0.0328138 0.0831491 0.319775 0.0596484 0.069772 35
end_path:michelremovinggnocchi:michelremoving 0.0301586 0.0771159 0.313734 0.0542299 0.0691167 35
end_path:calibanagnocchi:CalibAnaTree 0.474859 1.93843 3.9377 1.87315 0.889775 35
end_path:out1:RootOutput(write) 0.806025 1.35909 1.9004 1.33794 0.274035 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5041.89 MB
Peak resident set size usage (VmHWM): 2718.48 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup.root
\tHists: np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727446943.0,
"core.end_time": 1727454494.0,
"core.events": [
22007,
22011,
22015,
22019,
22023,
22027,
22031,
22035,
22039,
22043,
22047,
22051,
22055,
22059,
22063,
22067,
22071,
22075,
22079,
22083,
22087,
22091,
22095,
22099,
22103,
22107,
22111,
22115,
22119,
22123,
22127,
22131,
22135,
22139,
22143
],
"core.event_count": 35,
"core.first_event_number": 22007,
"core.last_event_number": 22143,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27333
],
"core.runs_subruns": [
2733300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T162813_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727446943.0,
"core.end_time": 1727454494.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27333
],
"core.runs_subruns": [
2733300001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027333_0157_dataflow3_datawriter_0_20240621T024654.hdf5"
}
]
}