Jobsub ID 262685.103@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262685.103@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3449 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-26 02:56:57 | |
| Site | UK_Durham | |
| Entry | DUNE_UK_SGridDurham_ce3 | |
| Last heartbeat | 2024-09-26 06:40:31 | |
| From worker node | Hostname | n259.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-26 04:14:50 | |
| Input files | hd-protodune:np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4835s) | |
| CPU time | 48m (2926s = 60%) | |
| Outputting started | 2024-09-26 05:35:25 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup.root hd-protodune-det-reco:np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup_hists.root | |
| Finished | 2024-09-26 06:40:31 | |
| Saved logs | justin-logs:262685.103-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
coincidences...
C:0 T:1 18284 XUs and 21772 XVs -> 3017 XUVs
C:0 T:2 63662 XUs and 54095 XVs -> 2371 XUVs
C:0 T:3 176 XUs and 131 XVs -> 1 XUVs
C:0 T:4 76 XUs and 115 XVs -> 3 XUVs
C:0 T:5 24562 XUs and 19019 XVs -> 1520 XUVs
C:0 T:6 69002 XUs and 61590 XVs -> 1722 XUVs
C:0 T:7 353 XUs and 415 XVs -> 8 XUVs
8642 XUVs total
2465 collection wire objects
8642 potential space points
Neighbour search...
720490 tests to find 370150 neighbours
Iterating with no regularization...
Begin: 2.158e+07
0 1.9767e+07
1 1.96456e+07
2 1.96294e+07
Now with regularization...
Begin: 1.85813e+07
0 1.85744e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 145220 TrkackID 17 startx, y, z 190.113 605.159 64.4617 wireno, peakt tpcno 216 5597.99 2 dist 72.438min T, max_T3215 5641.86
no of hits closeby 0 event 145220 TrkackID 17 startx, y, z 190.113 605.159 64.4617 wireno, peakt tpcno 216 5597.99 2 dist 72.438min T, max_T3215 5641.86
26-Sep-2024 06:35:14 BST Closed output file "np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup.root"
26-Sep-2024 06:35:14 BST Closed input file "np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 32.7696 67.309 114.163 65.4871 16.3259 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000380662 0.00204461 0.0037438 0.00211619 0.00082041 30
produce:fembfilter:PDHDFEMBFilter 0.451258 0.583684 0.697775 0.659276 0.101677 30
produce:wclsdatahd:WireCellToolkit 24.9335 28.3828 36.8928 26.5187 3.63778 30
produce:gaushit:GausHitFinder 0.242756 0.504967 1.03604 0.490692 0.156717 30
produce:nhitsfilter:NumberOfHitsFilter 0.000160033 0.000280812 0.000471133 0.000264842 6.69812e-05 30
produce:reco3d:SpacePointSolver 0.14054 0.803875 2.08241 0.635275 0.575932 29
produce:hitpdune:DisambigFromSpacePoints 0.100415 0.383091 1.43854 0.326964 0.255377 29
produce:pandora:StandardPandora 2.45488 9.54659 35.8421 8.05745 6.06884 29
produce:pandoraWriter:StandardPandora 0.0527114 0.114564 0.266103 0.103896 0.0438746 29
produce:pandoraTrack:LArPandoraTrackCreation 0.303777 0.842982 2.55547 0.733058 0.455024 29
produce:pandoraShower:LArPandoraShowerCreation 0.26432 0.985811 2.8874 0.855355 0.620902 29
produce:pandoracalo:Calorimetry 0.178062 0.449066 1.12014 0.406175 0.200664 29
produce:pandoracalonosce:Calorimetry 0.157098 0.420604 1.26151 0.374189 0.220641 29
produce:pandorapid:Chi2ParticleID 0.00090757 0.00149393 0.00310389 0.0013232 0.000469335 29
produce:pandoraShowercalo:ShowerCalorimetry 0.23045 0.924739 2.9814 0.82255 0.595011 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.22786 0.92244 3.04666 0.778751 0.618467 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0505358 0.105435 0.243685 0.0892946 0.0507745 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0166606 0.0362298 0.0797619 0.0306509 0.0169455 29
produce:emtrkmichelid:EmTrackMichelId 15.0994 22.1898 37.7097 22.3075 5.01889 29
[art]:TriggerResults:TriggerResultInserter 1.7724e-05 3.40601e-05 7.6545e-05 3.0112e-05 1.29425e-05 30
end_path:out1:RootOutput 7.795e-06 1.18465e-05 2.9065e-05 1.0966e-05 4.20392e-06 30
end_path:michelremoving:michelremoving 1.8465e-05 0.0861712 0.335872 0.0336022 0.0914461 30
end_path:michelremovinggnocchi:michelremoving 8.075e-06 0.0822951 0.325669 0.0294985 0.0899793 30
end_path:calibanagnocchi:CalibAnaTree 6.232e-06 0.3757 0.931808 0.36423 0.177638 30
end_path:out1:RootOutput(write) 0.242447 0.715923 1.26657 0.718718 0.236012 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4898.27 MB
Peak resident set size usage (VmHWM): 2570.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup.root
\tHists: np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727326861.0,
"core.end_time": 1727328915.0,
"core.events": [
144964,
144972,
144980,
145012,
145020,
145028,
145036,
145044,
145052,
145060,
145068,
145076,
145084,
145092,
145100,
145108,
145116,
145124,
145132,
145140,
145148,
145156,
145164,
145172,
145180,
145188,
145196,
145204,
145212,
145220
],
"core.event_count": 30,
"core.first_event_number": 144964,
"core.last_event_number": 145220,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141_reco_stage1_reco_stage2_20240926T053514_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727326861.0,
"core.end_time": 1727328915.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0604_dataflow4_datawriter_0_20240907T012141.hdf5"
}
]
}