Jobsub ID 78121.69@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 78121.69@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3451 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-26 06:09:37 |
Site | FR_CCIN2P3 |
Entry | DUNE_FR_CCIN2P3_cccondorce04 |
Last heartbeat | 2024-09-26 09:28:55 |
From worker node | Hostname | ccwcondor0732.in2p3.fr |
cpuinfo | AMD EPYC 7302 16-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 106200 (29 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 07:48:52 |
Input files | hd-protodune:np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045.hdf5
|
Outputting started | 2024-09-26 08:49:12 |
Output files | |
Finished | 2024-09-26 09:57:03 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ting with no regularization...
Begin: 9.13903e+06
0 7.45855e+06
1 7.36798e+06
2 7.35662e+06
3 7.35312e+06
Now with regularization...
Begin: 7.03708e+06
0 7.03508e+06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0713222 0.0636158 0.0499116 0.0562975 0.0463573 0.0528905 0.0501332 0.054833 0.0527597 0.0601127 0.0540083
----view 1: 0.000705123 0.000705063 0.000705063 0.000705123 0.000705063 0.000705063 0.000705123 0.000705063 0.000705063 0.000705123 0.000705063
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.0636158 0.0499116 0.0562975 0.0463573 0.0528905 0.0501332 0.054833 0.0527597 0.0601127 0.0540083 0.061906
----view 1: 0.000705063 0.000705063 0.000705123 0.000705063 0.000705063 0.000705123 0.000705063 0.000705063 0.000705123 0.000705063 0.000705063
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 10:48:52 CEST Closed output file "np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup.root"
26-Sep-2024 10:48:52 CEST Closed input file "np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.5504 87.0583 140.348 85.6333 16.757 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000500223 0.00242564 0.00441005 0.00235791 0.000927821 30
produce:fembfilter:PDHDFEMBFilter 0.53464 0.65304 0.819553 0.651524 0.0830782 30
produce:wclsdatahd:WireCellToolkit 34.6615 40.5683 46.7082 41.4203 3.00609 30
produce:gaushit:GausHitFinder 0.30589 0.591698 1.00465 0.51545 0.19072 30
produce:nhitsfilter:NumberOfHitsFilter 0.00019596 0.000368819 0.000654343 0.000341453 0.000111862 30
produce:reco3d:SpacePointSolver 0.134616 0.664733 2.52228 0.581501 0.510415 30
produce:hitpdune:DisambigFromSpacePoints 0.120956 0.394232 0.80842 0.339263 0.197967 30
produce:pandora:StandardPandora 4.15032 10.7842 38.3189 8.87192 6.48478 30
produce:pandoraWriter:StandardPandora 0.0646613 0.129717 0.209038 0.124586 0.0409086 30
produce:pandoraTrack:LArPandoraTrackCreation 0.373371 0.995683 2.47631 0.822449 0.522572 30
produce:pandoraShower:LArPandoraShowerCreation 0.34124 1.12018 2.66513 0.744275 0.645628 30
produce:pandoracalo:Calorimetry 0.206981 0.51045 1.28076 0.439046 0.247125 30
produce:pandoracalonosce:Calorimetry 0.187705 0.462805 1.13334 0.375159 0.22753 30
produce:pandorapid:Chi2ParticleID 0.000844341 0.0016834 0.00511925 0.00152257 0.000806113 30
produce:pandoraShowercalo:ShowerCalorimetry 0.294287 1.0178 2.38988 0.801715 0.561505 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.286234 0.946095 1.90363 0.779711 0.489437 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0582461 0.129942 0.264819 0.124353 0.0460865 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0208818 0.0430862 0.0669726 0.0424114 0.0131297 30
produce:emtrkmichelid:EmTrackMichelId 14.9482 26.6604 37.0924 26.495 6.06592 30
[art]:TriggerResults:TriggerResultInserter 1.9226e-05 4.31493e-05 9.7664e-05 3.3729e-05 2.24056e-05 30
end_path:out1:RootOutput 7.945e-06 1.14279e-05 2.8083e-05 9.7935e-06 5.23865e-06 30
end_path:michelremoving:michelremoving 0.0140946 0.0803917 0.354338 0.0390316 0.0846153 30
end_path:michelremovinggnocchi:michelremoving 0.0127445 0.0826746 0.416062 0.0338388 0.0936043 30
end_path:calibanagnocchi:CalibAnaTree 0.131991 0.376423 0.843461 0.351309 0.175199 30
end_path:out1:RootOutput(write) 0.413824 0.7244 1.08548 0.688354 0.190587 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4909.97 MB
Peak resident set size usage (VmHWM): 2332.69 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup.root
\tHists: np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727337860.0,
"core.end_time": 1727340533.0,
"core.events": [
540026,
540034,
540042,
540050,
540058,
540066,
540074,
540082,
540090,
540098,
540106,
540114,
540122,
540130,
540138,
540146,
540154,
540162,
540170,
540178,
540186,
540194,
540202,
540210,
540218,
540226,
540234,
540250,
540258,
540266
],
"core.event_count": 30,
"core.first_event_number": 540026,
"core.last_event_number": 540266,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045_reco_stage1_reco_stage2_20240926T084852_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727337860.0,
"core.end_time": 1727340533.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_2250_dataflow2_datawriter_0_20240908T042045.hdf5"
}
]
}