Jobsub ID 273291.184@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 273291.184@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3670 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-10-11 04:10:38 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2024-10-11 07:43:19 |
| From worker node | Hostname | cdr694.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-11 05:52:12 |
| Input files | hd-protodune:np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003.hdf5
|
| Outputting started | 2024-10-11 07:42:03 |
| Output files | |
| Finished | 2024-10-11 07:43:19 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
auss with 51098 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51098 traces tagged "gauss"
FrameSaver: q=1.91335e+06 n=879080 tag=gauss
wclsFrameSaver: saving 70500 traces tagged "wiener"
FrameSaver: q=2.1395e+06 n=804410 tag=wiener
2113 hits in TPC 0
2869 hits in TPC 1
5798 hits in TPC 2
3275 hits in TPC 3
3867 hits in TPC 4
7473 hits in TPC 5
10467 hits in TPC 6
4341 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 7 XUs and 13 XVs -> 0 XUVs
C:0 T:1 957 XUs and 505 XVs -> 7 XUVs
C:0 T:2 82447 XUs and 90838 XVs -> 2596 XUVs
C:0 T:3 123 XUs and 80 XVs -> 4 XUVs
C:0 T:4 19 XUs and 15 XVs -> 0 XUVs
C:0 T:5 27924 XUs and 39229 XVs -> 7239 XUVs
C:0 T:6 72796 XUs and 87802 XVs -> 2546 XUVs
C:0 T:7 1805 XUs and 1583 XVs -> 47 XUVs
12439 XUVs total
2155 collection wire objects
12439 potential space points
Neighbour search...
1697555 tests to find 844554 neighbours
Iterating with no regularization...
Begin: 4.07511e+07
0 3.43834e+07
1 3.38102e+07
2 3.37104e+07
3 3.36788e+07
Now with regularization...
Begin: 3.0965e+07
0 3.09297e+07
1 3.09136e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
11-Oct-2024 00:41:55 PDT Closed output file "np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup.root"
11-Oct-2024 00:41:55 PDT Closed input file "np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 51.2667 134.163 198.609 131.79 31.4877 31
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000656231 0.00273788 0.00452071 0.0029974 0.00111301 31
produce:fembfilter:PDHDFEMBFilter 0.730945 0.746113 0.787192 0.746901 0.0098748 31
produce:wclsdatahd:WireCellToolkit 45.1817 47.3558 48.8515 47.2035 0.883758 31
produce:gaushit:GausHitFinder 0.737686 1.08316 1.47283 1.05005 0.169441 31
produce:nhitsfilter:NumberOfHitsFilter 0.000376279 0.000549219 0.000711687 0.000533639 8.56916e-05 31
produce:reco3d:SpacePointSolver 0.889871 5.22981 15.4961 4.60918 3.32675 29
produce:hitpdune:DisambigFromSpacePoints 0.453054 1.41315 2.36386 1.36229 0.541467 29
produce:pandora:StandardPandora 11.7592 29.2797 74.0653 28.665 11.6932 29
produce:pandoraWriter:StandardPandora 0.152848 0.220368 0.282441 0.21623 0.0333816 29
produce:pandoraTrack:LArPandoraTrackCreation 1.5086 3.40936 6.46878 3.32144 1.11966 29
produce:pandoraShower:LArPandoraShowerCreation 2.00209 3.92647 8.97424 3.30552 1.57106 29
produce:pandoracalo:Calorimetry 0.737834 1.44136 2.59082 1.38336 0.423218 29
produce:pandoracalonosce:Calorimetry 0.713967 1.34804 2.07826 1.3278 0.365264 29
produce:pandorapid:Chi2ParticleID 0.00170314 0.00251778 0.00354328 0.0024649 0.000388076 29
produce:pandoraShowercalo:ShowerCalorimetry 1.56299 3.1345 7.04235 2.72719 1.22334 29
produce:pandoraShowercalonosce:ShowerCalorimetry 1.48762 3.01614 6.60706 2.6537 1.13623 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.127656 0.173151 0.24699 0.170298 0.0252523 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0475202 0.064349 0.0852753 0.0658089 0.00911857 29
produce:emtrkmichelid:EmTrackMichelId 25.9735 35.7356 46.0677 35.4434 5.0247 29
[art]:TriggerResults:TriggerResultInserter 1.8607e-05 3.34442e-05 6.8639e-05 3.2819e-05 1.04719e-05 31
end_path:out1:RootOutput 7.527e-06 1.31154e-05 2.6862e-05 1.2661e-05 3.98205e-06 31
end_path:michelremoving:michelremoving 3.4722e-05 0.0774712 0.193221 0.0528305 0.0536873 31
end_path:michelremovinggnocchi:michelremoving 1.0405e-05 0.074538 0.189088 0.0523076 0.0525281 31
end_path:calibanagnocchi:CalibAnaTree 1.1337e-05 0.986442 1.78484 1.00846 0.39155 31
end_path:out1:RootOutput(write) 0.444023 1.02432 1.4256 1.04672 0.212363 31
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4970.86 MB
Peak resident set size usage (VmHWM): 2648.35 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup.root
\tHists: np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728628310.0,
"core.end_time": 1728632515.0,
"core.events": [
3269,
3277,
3285,
3293,
3301,
3309,
3317,
3325,
3333,
3341,
3349,
3357,
3365,
3373,
3381,
3389,
3397,
3405,
3413,
3421,
3429,
3437,
3445,
3453,
3461,
3469,
3477,
3485,
3493,
3501,
3509
],
"core.event_count": 31,
"core.first_event_number": 3269,
"core.last_event_number": 3509,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27938
],
"core.runs_subruns": [
2793800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003_reco_stage1_reco_stage2_20241011T074155_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728628310.0,
"core.end_time": 1728632515.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27938
],
"core.runs_subruns": [
2793800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027938_0013_dataflow5_datawriter_0_20240710T054003.hdf5"
}
]
} 