Jobsub ID 77733.30@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 77733.30@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3454 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-25 22:43:55 |
Site | FR_CCIN2P3 |
Entry | DUNE_FR_CCIN2P3_cccondorce04 |
Last heartbeat | 2024-09-26 02:42:56 |
From worker node | Hostname | ccwcondor0557 |
cpuinfo | AMD EPYC 7453 28-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 106200 (29 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 01:12:54 |
Input files | hd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5
|
Outputting started | 2024-09-26 02:21:59 |
Output files | |
Finished | 2024-09-26 03:12:12 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
tagging trace set: wiener with 50924 traces, 50924 summary
Retagger: tagging trace set: gauss with 36978 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 36978 traces tagged "gauss"
FrameSaver: q=729171 n=648735 tag=gauss
wclsFrameSaver: saving 50924 traces tagged "wiener"
FrameSaver: q=800127 n=585574 tag=wiener
4296 hits in TPC 0
4731 hits in TPC 1
2565 hits in TPC 2
1365 hits in TPC 3
2561 hits in TPC 4
4110 hits in TPC 5
3457 hits in TPC 6
2468 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 12221 XUs and 10317 XVs -> 323 XUVs
C:0 T:2 3766 XUs and 5324 XVs -> 111 XUVs
C:0 T:3 53 XUs and 70 XVs -> 6 XUVs
C:0 T:4 978 XUs and 794 XVs -> 30 XUVs
C:0 T:5 12566 XUs and 12064 XVs -> 827 XUVs
C:0 T:6 9610 XUs and 23888 XVs -> 395 XUVs
C:0 T:7 366 XUs and 384 XVs -> 19 XUVs
1711 XUVs total
845 collection wire objects
1711 potential space points
Neighbour search...
65905 tests to find 37602 neighbours
Iterating with no regularization...
Begin: 4.04202e+06
0 3.73165e+06
1 3.7166e+06
2 3.71466e+06
Now with regularization...
Begin: 3.49165e+06
0 3.49115e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 04:21:23 CEST Closed output file "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root"
26-Sep-2024 04:21:23 CEST Closed input file "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 71.9795 103.76 154.029 107.513 17.8116 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00067169 0.0030645 0.0051898 0.00317343 0.00122 30
produce:fembfilter:PDHDFEMBFilter 0.574075 0.741517 0.883806 0.751255 0.0614363 30
produce:wclsdatahd:WireCellToolkit 38.6805 45.0174 48.2436 45.5583 2.57526 30
produce:gaushit:GausHitFinder 0.482153 0.7818 1.09674 0.781415 0.184561 30
produce:nhitsfilter:NumberOfHitsFilter 0.000263254 0.000411396 0.00136486 0.000372002 0.000190138 30
produce:reco3d:SpacePointSolver 0.207506 1.20361 3.45649 0.97182 0.831252 30
produce:hitpdune:DisambigFromSpacePoints 0.186843 0.580862 1.11921 0.551582 0.246811 30
produce:pandora:StandardPandora 5.32594 12.4885 32.1298 11.9937 5.06398 30
produce:pandoraWriter:StandardPandora 0.107346 0.169156 0.242304 0.165676 0.0366419 30
produce:pandoraTrack:LArPandoraTrackCreation 0.513946 1.90354 4.13549 1.70098 0.842896 30
produce:pandoraShower:LArPandoraShowerCreation 0.49293 2.23278 4.84679 2.2366 1.16455 30
produce:pandoracalo:Calorimetry 0.293022 0.891649 1.86632 0.879834 0.356124 30
produce:pandoracalonosce:Calorimetry 0.242552 0.812097 1.97477 0.731098 0.360285 30
produce:pandorapid:Chi2ParticleID 0.00131623 0.00224955 0.00369211 0.00225397 0.00052748 30
produce:pandoraShowercalo:ShowerCalorimetry 0.360999 1.89902 4.33614 1.91217 0.964921 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.305224 1.80115 3.88055 1.59767 0.892008 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.06916 0.168761 0.342758 0.155005 0.0525862 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0269071 0.0578124 0.0916362 0.055726 0.0166847 30
produce:emtrkmichelid:EmTrackMichelId 17.4769 31.2375 44.7196 32.3549 6.44855 30
[art]:TriggerResults:TriggerResultInserter 4.2771e-05 7.4785e-05 0.000140423 7.3909e-05 1.69301e-05 30
end_path:out1:RootOutput 1.077e-05 2.07052e-05 5.9211e-05 1.92715e-05 8.76747e-06 30
end_path:michelremoving:michelremoving 0.0207984 0.0915267 0.381336 0.0590895 0.0848477 30
end_path:michelremovinggnocchi:michelremoving 0.0169185 0.0817925 0.311665 0.0456785 0.0795839 30
end_path:calibanagnocchi:CalibAnaTree 0.177222 0.586042 1.30273 0.520467 0.240361 30
end_path:out1:RootOutput(write) 0.466724 0.787927 1.16526 0.772706 0.167298 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4906.87 MB
Peak resident set size usage (VmHWM): 2327.71 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root
\tHists: np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727314080.0,
"core.end_time": 1727317285.0,
"core.events": [
8186,
8194,
8202,
8210,
8218,
8226,
8234,
8242,
8250,
8258,
8266,
8274,
8282,
8290,
8298,
8306,
8314,
8322,
8330,
8338,
8346,
8354,
8362,
8370,
8378,
8386,
8394,
8402,
8410,
8418
],
"core.event_count": 30,
"core.first_event_number": 8186,
"core.last_event_number": 8418,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29108
],
"core.runs_subruns": [
2910800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714_reco_stage1_reco_stage2_20240926T022123_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727314080.0,
"core.end_time": 1727317285.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29108
],
"core.runs_subruns": [
2910800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029108_0034_dataflow2_datawriter_0_20240909T074714.hdf5"
}
]
}