Jobsub ID 264690.173@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 264690.173@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3518 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 06:04:26 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2024-09-27 11:16:59 |
| From worker node | Hostname | cdr821.int.cedar.computecanada.ca |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 07:34:54 |
| Input files | hd-protodune:np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605.hdf5
|
| Outputting started | 2024-09-27 11:15:19 |
| Output files | |
| Finished | 2024-09-27 11:16:59 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
with 67350 traces, 67350 summary
Retagger: tagging trace set: gauss with 48321 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48321 traces tagged "gauss"
FrameSaver: q=1.75011e+06 n=833768 tag=gauss
wclsFrameSaver: saving 67350 traces tagged "wiener"
FrameSaver: q=1.92265e+06 n=753962 tag=wiener
4479 hits in TPC 0
3889 hits in TPC 1
7571 hits in TPC 2
5255 hits in TPC 3
3900 hits in TPC 4
7150 hits in TPC 5
1826 hits in TPC 6
832 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2124 XUs and 1752 XVs -> 29 XUVs
C:0 T:2 51273 XUs and 48117 XVs -> 2264 XUVs
C:0 T:3 699 XUs and 849 XVs -> 47 XUVs
C:0 T:4 89 XUs and 140 XVs -> 7 XUVs
C:0 T:5 17984 XUs and 40863 XVs -> 1370 XUVs
C:0 T:6 1554 XUs and 1908 XVs -> 106 XUVs
C:0 T:7 44 XUs and 73 XVs -> 1 XUVs
3824 XUVs total
1771 collection wire objects
3824 potential space points
Neighbour search...
89406 tests to find 53668 neighbours
Iterating with no regularization...
Begin: 6.01645e+07
0 5.48575e+07
1 5.45378e+07
2 5.45085e+07
Now with regularization...
Begin: 5.17402e+07
0 5.17307e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 04:15:08 PDT Closed output file "np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup.root"
27-Sep-2024 04:15:08 PDT Closed input file "np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 86.0778 122.866 164.03 120.523 19.095 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000808725 0.00249304 0.00392446 0.00289938 0.00103579 35
produce:fembfilter:PDHDFEMBFilter 0.902641 0.913968 0.951807 0.913306 0.0075021 35
produce:wclsdatahd:WireCellToolkit 53.1479 54.8726 55.9773 55.0504 0.763581 35
produce:gaushit:GausHitFinder 0.588889 1.00892 1.40905 1.0287 0.195577 35
produce:nhitsfilter:NumberOfHitsFilter 0.000238739 0.000396812 0.000528256 0.000402072 7.20742e-05 35
produce:reco3d:SpacePointSolver 0.206831 0.997242 2.91814 0.901976 0.584708 35
produce:hitpdune:DisambigFromSpacePoints 0.231561 0.865021 1.84956 0.795787 0.374502 35
produce:pandora:StandardPandora 7.94063 20.8779 40.4761 18.1867 8.49207 35
produce:pandoraWriter:StandardPandora 0.102235 0.184094 0.271155 0.185755 0.0363238 35
produce:pandoraTrack:LArPandoraTrackCreation 0.907807 1.94393 3.16603 1.88256 0.604504 35
produce:pandoraShower:LArPandoraShowerCreation 0.634236 2.2551 4.38127 2.17016 0.940448 35
produce:pandoracalo:Calorimetry 0.41869 0.936075 1.57483 0.921466 0.281568 35
produce:pandoracalonosce:Calorimetry 0.387303 0.865165 1.46164 0.865183 0.265829 35
produce:pandorapid:Chi2ParticleID 0.00182 0.0023662 0.00334091 0.00230768 0.000380856 35
produce:pandoraShowercalo:ShowerCalorimetry 0.53991 2.03707 4.08107 2.01511 0.826846 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.523622 1.95985 3.87514 1.91242 0.785777 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0837153 0.158647 0.243281 0.160018 0.0373878 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0323439 0.0564947 0.0835519 0.0591765 0.0125466 35
produce:emtrkmichelid:EmTrackMichelId 18.0693 31.0156 45.5988 30.9658 5.76008 35
[art]:TriggerResults:TriggerResultInserter 2.7252e-05 3.63395e-05 7.6856e-05 3.5125e-05 8.57156e-06 35
end_path:out1:RootOutput 9.447e-06 1.31453e-05 2.7725e-05 1.2624e-05 2.8694e-06 35
end_path:michelremoving:michelremoving 0.02151 0.0660087 0.233835 0.0385033 0.0550405 35
end_path:michelremovinggnocchi:michelremoving 0.0193023 0.0616912 0.228796 0.0343571 0.0550594 35
end_path:calibanagnocchi:CalibAnaTree 0.301744 0.705164 1.09715 0.661114 0.215737 35
end_path:out1:RootOutput(write) 0.544788 0.984729 1.4462 0.977042 0.203612 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4989.87 MB
Peak resident set size usage (VmHWM): 2669.47 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup.root
\tHists: np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727431357.0,
"core.end_time": 1727435708.0,
"core.events": [
11632,
11636,
11640,
11644,
11648,
11652,
11656,
11660,
11664,
11668,
11672,
11676,
11680,
11684,
11688,
11692,
11696,
11700,
11704,
11708,
11712,
11716,
11720,
11724,
11728,
11732,
11736,
11740,
11744,
11748,
11752,
11756,
11760,
11764,
11768
],
"core.event_count": 35,
"core.first_event_number": 11632,
"core.last_event_number": 11768,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27402
],
"core.runs_subruns": [
2740200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605_reco_stage1_reco_stage2_20240927T111508_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727431357.0,
"core.end_time": 1727435708.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27402
],
"core.runs_subruns": [
2740200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027402_0083_dataflow0_datawriter_0_20240624T085605.hdf5"
}
]
} 