Jobsub ID 77778.101@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 77778.101@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3450 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-26 00:21:23 |
Site | CERN |
Entry | CMSHTPC_T2_CH_CERN_ce514 |
Last heartbeat | 2024-09-26 05:15:24 |
From worker node | Hostname | b9p25p1579.cern.ch |
cpuinfo | AMD EPYC 7302 16-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 03:45:05 |
Input files | hd-protodune:np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858.hdf5
|
Outputting started | 2024-09-26 04:47:05 |
Output files | |
Finished | 2024-09-26 05:15:24 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
6269 summary
Retagger: tagging trace set: gauss with 40964 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 40964 traces tagged "gauss"
FrameSaver: q=804533 n=725001 tag=gauss
wclsFrameSaver: saving 56269 traces tagged "wiener"
FrameSaver: q=874916 n=650172 tag=wiener
2523 hits in TPC 0
2752 hits in TPC 1
4068 hits in TPC 2
2481 hits in TPC 3
4130 hits in TPC 4
5125 hits in TPC 5
4593 hits in TPC 6
2498 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1397 XUs and 906 XVs -> 107 XUVs
C:0 T:2 8569 XUs and 11115 XVs -> 403 XUVs
C:0 T:3 266 XUs and 350 XVs -> 7 XUVs
C:0 T:4 235 XUs and 240 XVs -> 8 XUVs
C:0 T:5 32387 XUs and 61745 XVs -> 612 XUVs
C:0 T:6 12250 XUs and 9066 XVs -> 177 XUVs
C:0 T:7 38 XUs and 56 XVs -> 4 XUVs
1318 XUVs total
783 collection wire objects
1318 potential space points
Neighbour search...
28638 tests to find 18228 neighbours
Iterating with no regularization...
Begin: 5.03911e+06
0 4.91818e+06
1 4.91349e+06
Now with regularization...
Begin: 4.7129e+06
0 4.71252e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 06:46:53 CEST Closed output file "np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup.root"
26-Sep-2024 06:46:53 CEST Closed input file "np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 66.6257 89.4715 124.081 89.0242 14.7861 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000460066 0.00235084 0.00386026 0.00252155 0.00108924 30
produce:fembfilter:PDHDFEMBFilter 0.553837 0.727411 0.81742 0.745464 0.0582593 30
produce:wclsdatahd:WireCellToolkit 34.7772 38.3188 41.9298 38.7264 1.37986 30
produce:gaushit:GausHitFinder 0.416043 0.747364 1.14923 0.725167 0.170498 30
produce:nhitsfilter:NumberOfHitsFilter 0.000307724 0.000407853 0.000543357 0.000406531 6.15328e-05 30
produce:reco3d:SpacePointSolver 0.100669 0.913028 3.42368 0.627142 0.736854 30
produce:hitpdune:DisambigFromSpacePoints 0.104402 0.565229 1.35581 0.517941 0.256963 30
produce:pandora:StandardPandora 4.44621 12.6677 22.9093 12.0383 4.70558 30
produce:pandoraWriter:StandardPandora 0.112606 0.174866 0.255321 0.171235 0.0385054 30
produce:pandoraTrack:LArPandoraTrackCreation 0.455285 1.13078 2.33451 1.0564 0.467908 30
produce:pandoraShower:LArPandoraShowerCreation 0.45065 1.29061 3.61602 1.06872 0.726113 30
produce:pandoracalo:Calorimetry 0.246296 0.572751 1.03603 0.547087 0.198751 30
produce:pandoracalonosce:Calorimetry 0.181543 0.498589 0.973399 0.49113 0.18385 30
produce:pandorapid:Chi2ParticleID 0.00106572 0.002001 0.00345801 0.00199482 0.000498301 30
produce:pandoraShowercalo:ShowerCalorimetry 0.40353 1.15237 3.33995 0.955428 0.676937 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.378847 1.14116 3.14583 0.976779 0.646878 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0955613 0.169127 0.268958 0.170611 0.043747 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0248668 0.056722 0.097439 0.0567166 0.0145195 30
produce:emtrkmichelid:EmTrackMichelId 17.2462 27.771 43.6031 27.5938 6.05336 30
[art]:TriggerResults:TriggerResultInserter 2.0511e-05 4.47535e-05 0.000104221 3.5155e-05 2.43394e-05 30
end_path:out1:RootOutput 7.99e-06 1.21537e-05 5.322e-05 1.03e-05 7.87865e-06 30
end_path:michelremoving:michelremoving 0.0166165 0.0830904 0.414523 0.0369699 0.090392 30
end_path:michelremovinggnocchi:michelremoving 0.0148511 0.079361 0.405531 0.0341648 0.0890292 30
end_path:calibanagnocchi:CalibAnaTree 0.162767 0.405087 0.702997 0.397319 0.150438 30
end_path:out1:RootOutput(write) 0.515765 0.887585 1.35326 0.882132 0.222828 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4907.88 MB
Peak resident set size usage (VmHWM): 2569.16 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup.root
\tHists: np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727323281.0,
"core.end_time": 1727326014.0,
"core.events": [
334108,
334116,
334124,
334132,
334140,
334148,
334156,
334164,
334172,
334180,
334188,
334196,
334204,
334212,
334220,
334228,
334236,
334244,
334252,
334260,
334268,
334276,
334284,
334292,
334300,
334308,
334316,
334324,
334332,
334340
],
"core.event_count": 30,
"core.first_event_number": 334108,
"core.last_event_number": 334340,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858_reco_stage1_reco_stage2_20240926T044653_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727323281.0,
"core.end_time": 1727326014.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1392_dataflow4_datawriter_0_20240907T140858.hdf5"
}
]
}