Jobsub ID 265826.9@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 265826.9@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3543 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-28 10:12:25 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce04 | |
| Last heartbeat | 2024-09-28 10:18:51 | |
| From worker node | Hostname | ccwcondor0523.in2p3.fr |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-28 10:13:46 | |
| Input files | hd-protodune:np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 3m (195s) | |
| CPU time | 2m (138s = 70%) | |
| Outputting started | 2024-09-28 10:17:01 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup.root hd-protodune-det-reco:np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup_hists.root | |
| Finished | 2024-09-28 10:18:51 | |
| Saved logs | justin-logs:265826.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
.4643e-05 9.64594e-05 4
produce:tpcrawdecoder:PDHDTPCReader 5.16146 5.50091 5.90823 5.46697 0.26728 4
produce:triggerrawdecoder:PDHDTriggerReader3 0.11666 0.134072 0.159447 0.13009 0.0170456 4
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00378668 0.00511112 0.00779721 0.0044303 0.00160009 4
produce:pdhddaphne:DAPHNEReaderPDHD 0.000148129 0.000244596 0.000460619 0.000184819 0.000125692 4
produce:fembfilter:PDHDFEMBFilter 9.2485e-05 0.000184443 0.000396278 0.000124505 0.000123789 4
[art]:TriggerResults:TriggerResultInserter 1.6401e-05 2.54183e-05 4.9915e-05 1.76785e-05 1.41559e-05 4
end_path:out1:RootOutput 5.099e-06 9.48025e-06 2.0008e-05 6.407e-06 6.16299e-06 4
end_path:out1:RootOutput(write) 2.53347 2.62306 2.76291 2.59793 0.0858921 4
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2408.37 MB
Peak resident set size usage (VmHWM): 873.165 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
calibana
crtreco
crttag
opdec
opflash
ophitspe
opslicer
pdhddaphne
timingrawdecoder
tpcrawdecoder
triggerrawdecoder
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_02d01/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25608 nodes/ 5535 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
DAPHNE Channel Map: Building DAPHNE channel map from file DAPHNE_test5_ChannelMap_v1.txt
PD2HD Channel Map: Building TPC wiremap from file PD2HDChannelMap_WIBEth_electronics_v1.txt
tf_graph loaded ProtoBuf graph with status: OK
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce channel summary named "threshold"
28-Sep-2024 12:16:40 CEST Initiating request to open input file "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1.root"
28-Sep-2024 12:16:40 CEST Opened input file "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1.root"
job begin...
job begin...
Scale HitLimit based on readout window size 5859
HitLimit = 19530
Begin processing the 1st record. run: 29382 subRun: 1 event: 5539 at 28-Sep-2024 12:16:42 CEST
28-Sep-2024 12:16:42 CEST Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 5541 at 28-Sep-2024 12:16:44 CEST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 5543 at 28-Sep-2024 12:16:45 CEST
Begin processing the 4th record. run: 29382 subRun: 1 event: 5545 at 28-Sep-2024 12:16:45 CEST
28-Sep-2024 12:16:47 CEST Closed output file "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup.root"
28-Sep-2024 12:16:47 CEST Closed input file "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 0.734323 0.779155 0.849429 0.766434 0.043028 4
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000337066 0.000671347 0.0014453 0.000451513 0.000451681 4
produce:fembfilter:PDHDFEMBFilter 0.731545 0.774902 0.840422 0.763821 0.0404334 4
[art]:TriggerResults:TriggerResultInserter 4.9443e-05 9.48538e-05 0.000176563 7.67045e-05 4.87831e-05 4
end_path:out1:RootOutput 6.692e-06 1.5241e-05 3.1219e-05 1.15265e-05 9.44616e-06 4
end_path:michelremoving:michelremoving 2.2693e-05 0.00010483 0.000346504 2.5062e-05 0.000139541 4
end_path:michelremovinggnocchi:michelremoving 5.5e-06 3.0159e-05 9.4167e-05 1.04845e-05 3.71191e-05 4
end_path:calibanagnocchi:CalibAnaTree 5.69e-06 2.66475e-05 8.3978e-05 8.461e-06 3.3157e-05 4
end_path:out1:RootOutput(write) 0.00105615 0.00261635 0.00575324 0.001828 0.00183854 4
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3629.23 MB
Peak resident set size usage (VmHWM): 1040.13 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup.root
\tHists: np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727518551.0,
"core.end_time": 1727518607.0,
"core.events": [
5539,
5541,
5543,
5545
],
"core.event_count": 4,
"core.first_event_number": 5539,
"core.last_event_number": 5545,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29382
],
"core.runs_subruns": [
2938200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059_reco_stage1_reco_stage2_20240928T101647_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727518551.0,
"core.end_time": 1727518607.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29382
],
"core.runs_subruns": [
2938200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029382_0071_dataflow1_datawriter_0_20240928T095059.hdf5"
}
]
}