Jobsub ID 262671.80@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262671.80@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3449 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-26 02:33:54 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce04 |
| Last heartbeat | 2024-09-26 05:31:31 |
| From worker node | Hostname | ccwcondor0598 |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-26 03:40:20 |
| Input files | hd-protodune:np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106.hdf5
|
| Outputting started | 2024-09-26 04:45:45 |
| Output files | |
| Finished | 2024-09-26 06:17:42 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
trace set: gauss with 53973 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53973 traces tagged "gauss"
FrameSaver: q=1.12958e+06 n=992648 tag=gauss
wclsFrameSaver: saving 73753 traces tagged "wiener"
FrameSaver: q=1.20486e+06 n=886167 tag=wiener
4201 hits in TPC 0
4554 hits in TPC 1
6746 hits in TPC 2
4395 hits in TPC 3
2258 hits in TPC 4
5327 hits in TPC 5
6946 hits in TPC 6
3420 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 449 XUs and 243 XVs -> 8 XUVs
C:0 T:2 21751 XUs and 30189 XVs -> 851 XUVs
C:0 T:3 298 XUs and 377 XVs -> 23 XUVs
C:0 T:4 148 XUs and 101 XVs -> 0 XUVs
C:0 T:5 25172 XUs and 29011 XVs -> 1156 XUVs
C:0 T:6 19881 XUs and 24699 XVs -> 907 XUVs
C:0 T:7 121 XUs and 135 XVs -> 3 XUVs
2948 XUVs total
1289 collection wire objects
2948 potential space points
Neighbour search...
128990 tests to find 66310 neighbours
Iterating with no regularization...
Begin: 5.45229e+06
0 5.06027e+06
1 5.01823e+06
2 5.01479e+06
Now with regularization...
Begin: 4.59992e+06
0 4.59867e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 06:45:35 CEST Closed output file "np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup.root"
26-Sep-2024 06:45:35 CEST Closed input file "np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 60.6802 98.8294 212.797 94.3958 26.2172 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000356889 0.00302898 0.00584242 0.00318788 0.00124045 30
produce:fembfilter:PDHDFEMBFilter 0.490764 0.649073 0.819251 0.667496 0.102851 30
produce:wclsdatahd:WireCellToolkit 31.723 39.2164 46.3981 40.0244 3.87598 30
produce:gaushit:GausHitFinder 0.379482 0.720012 1.04265 0.700256 0.167237 30
produce:nhitsfilter:NumberOfHitsFilter 0.000243215 0.000354911 0.000534322 0.00034447 7.13084e-05 30
produce:reco3d:SpacePointSolver 0.190333 1.06865 2.66794 0.863904 0.663438 30
produce:hitpdune:DisambigFromSpacePoints 0.189925 0.588005 2.13717 0.543549 0.35482 30
produce:pandora:StandardPandora 5.43829 14.8651 82.7114 12.1056 13.3543 30
produce:pandoraWriter:StandardPandora 0.0884756 0.154527 0.306275 0.147745 0.0427311 30
produce:pandoraTrack:LArPandoraTrackCreation 0.774122 1.81748 5.73342 1.55416 0.919496 30
produce:pandoraShower:LArPandoraShowerCreation 0.657378 2.20993 4.61902 2.07234 1.09531 30
produce:pandoracalo:Calorimetry 0.378925 0.895448 2.55469 0.804889 0.414567 30
produce:pandoracalonosce:Calorimetry 0.330067 0.838473 1.80692 0.787951 0.358071 30
produce:pandorapid:Chi2ParticleID 0.00137159 0.00222964 0.00479662 0.00203245 0.000680288 30
produce:pandoraShowercalo:ShowerCalorimetry 0.655336 1.89591 3.4739 1.66473 0.864786 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.602326 1.81924 3.47897 1.62352 0.825247 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0623885 0.140749 0.252294 0.136742 0.0405141 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0247861 0.050696 0.0779062 0.0507422 0.0145551 30
produce:emtrkmichelid:EmTrackMichelId 17.69 30.1464 57.5379 28.853 8.09644 30
[art]:TriggerResults:TriggerResultInserter 3.3313e-05 6.64909e-05 0.000107071 6.7211e-05 1.3606e-05 30
end_path:out1:RootOutput 1.1411e-05 2.04105e-05 3.8432e-05 1.85945e-05 6.40513e-06 30
end_path:michelremoving:michelremoving 0.0210062 0.088692 0.286518 0.0540467 0.0736348 30
end_path:michelremovinggnocchi:michelremoving 0.0194974 0.085505 0.344896 0.0473675 0.0792919 30
end_path:calibanagnocchi:CalibAnaTree 0.275473 0.634391 1.5084 0.584401 0.291064 30
end_path:out1:RootOutput(write) 0.386949 0.72225 1.19369 0.654673 0.182718 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4954.82 MB
Peak resident set size usage (VmHWM): 2378.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup.root
\tHists: np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727322925.0,
"core.end_time": 1727325936.0,
"core.events": [
169226,
169234,
169242,
169250,
169258,
169266,
169274,
169282,
169290,
169298,
169306,
169314,
169322,
169330,
169338,
169346,
169354,
169362,
169370,
169378,
169386,
169394,
169402,
169410,
169418,
169426,
169434,
169442,
169450,
169458
],
"core.event_count": 30,
"core.first_event_number": 169226,
"core.last_event_number": 169458,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106_reco_stage1_reco_stage2_20240926T044535_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727322925.0,
"core.end_time": 1727325936.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0705_dataflow2_datawriter_0_20240907T024106.hdf5"
}
]
} 